Aug 04 10:36:49.147895 ip-10-0-136-162 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 10:36:49.586188 ip-10-0-136-162 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 10:36:49.586188 ip-10-0-136-162 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 10:36:49.586188 ip-10-0-136-162 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 10:36:49.586188 ip-10-0-136-162 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 10:36:49.586188 ip-10-0-136-162 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 10:36:49.587292 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.587214    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592461    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592478    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592483    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592486    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592489    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592492    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592495    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592497    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592500    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592503    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592505    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592507    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592510    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592512    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592515    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592517    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592520    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592529    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592532    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 10:36:49.597013 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592534    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592537    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592540    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592543    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592545    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592548    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592550    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592554    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592558    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592561    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592564    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592567    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592569    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592573    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592576    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592579    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592582    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592585    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592587    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592590    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 10:36:49.597479 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592593    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592595    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592598    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592600    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592603    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592605    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592608    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592611    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592614    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592617    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592620    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592622    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592624    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592627    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592629    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592631    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592634    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592649    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592652    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 10:36:49.597981 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592657    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592661    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592664    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592666    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592669    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592671    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592674    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592677    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592680    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592682    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592685    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592688    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592690    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592693    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592696    2559 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592698    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592701    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592703    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592706    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592708    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 10:36:49.598434 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592711    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592713    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592716    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592718    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592721    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592723    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592726    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592728    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592731    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592733    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592736    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592739    2559 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592742    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592745    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592747    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592749    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592752    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592755    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592757    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592760    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 10:36:49.598913 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.592762    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593422    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593428    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593432    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593434    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593437    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593440    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593442    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593445    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593447    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593450    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593452    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593456    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593461    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593464    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593467    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593469    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593472    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593475    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593478    2559 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 10:36:49.599369 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593480    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593484    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593487    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593490    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593493    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593496    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593498    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593503    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593506    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593508    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593511    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593513    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593516    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593519    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593521    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593524    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593527    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593530    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 10:36:49.599905 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593532    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593535    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593537    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593540    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593542    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593545    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593547    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593550    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593553    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593555    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593558    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593560    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593563    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593565    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593567    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593570    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593572    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593575    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593577    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593579    2559 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 10:36:49.600376 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593582    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593584    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593587    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593589    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593591    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593594    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593596    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593599    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593601    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593604    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593607    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593609    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593612    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593614    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593617    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593620    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593622    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593624    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593626    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593629    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 10:36:49.600860 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593632    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593651    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593654    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593658    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593661    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593663    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593666    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593668    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593671    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593674    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593676    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593679    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593681    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593684    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593687    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593690    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593692    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593694    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593697    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593699    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 10:36:49.601328 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593702    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.593704    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594118    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594124    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594127    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594130    2559 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594133    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594136    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594139    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594142    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594145    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594148    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594150    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594153    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594155    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594158    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594160    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594162    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594166    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594170    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 10:36:49.601796 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594173    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594176    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594178    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594181    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594184    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594187    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594190    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594192    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594196    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594199    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594202    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594205    2559 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594207    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594210    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594213    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594215    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594218    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594221    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594223    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594226    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 10:36:49.602267 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594229    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594231    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594233    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594236    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594238    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594240    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594243    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594245    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594248    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594250    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594253    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594255    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594257    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594260    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594262    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594265    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594267    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594272    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594274    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594276    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 10:36:49.602735 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594279    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594281    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594284    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594286    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594289    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594292    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594295    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594297    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594302    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594305    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594308    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594310    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594314    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594316    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594318    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594321    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594323    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594325    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594328    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 10:36:49.603198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594330    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594333    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594335    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594337    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594340    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594342    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594344    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594347    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594349    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594351    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594355    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594357    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594359    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594362    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594365    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594367    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594369    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594372    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594378    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 10:36:49.603674 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594381    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594383    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.594386    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594464    2559 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594474    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594482    2559 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594488    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594495    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594500    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594505    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594509    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594512    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594515    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594518    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594521    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594524    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594527    2559 flags.go:64] FLAG: --cgroup-root=""
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594530    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594532    2559 flags.go:64] FLAG: --client-ca-file=""
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594536    2559 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594539    2559 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594543    2559 flags.go:64] FLAG: --cluster-domain=""
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594546    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594550    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 10:36:49.604119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594553    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594557    2559 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594561    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594563    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594566    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594569    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594572    2559 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594576    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594579    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594582    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594585    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594589    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594592    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594594    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594597    2559 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594599    2559 flags.go:64] FLAG: --enable-server="true"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594603    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594607    2559 flags.go:64] FLAG: --event-burst="100"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594610    2559 flags.go:64] FLAG: --event-qps="50"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594612    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594615    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594618    2559 flags.go:64] FLAG: --eviction-hard=""
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594621    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594624    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594627    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 10:36:49.604687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594629    2559 flags.go:64] FLAG: --eviction-soft=""
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594632    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594649    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594653    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594656    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594659    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594663    2559 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594666    2559 flags.go:64] FLAG: --feature-gates=""
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594670    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594672    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594675    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594678    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594681    2559 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594683    2559 flags.go:64] FLAG: --help="false"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594688    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-136-162.ec2.internal"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594691    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594694    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594696    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594699    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594703    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594705    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594708    2559 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594711    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 10:36:49.605279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594713    2559 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594717    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594720    2559 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594722    2559 flags.go:64] FLAG: --kube-reserved=""
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594725    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594728    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594730    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594733    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594736    2559 flags.go:64] FLAG: --lock-file=""
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594738    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594741    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594743    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594753    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594756    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594758    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594762    2559 flags.go:64] FLAG: --logging-format="text"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594765    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594768    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594771    2559 flags.go:64] FLAG: --manifest-url=""
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594774    2559 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594778    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594781    2559 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594785    2559 flags.go:64] FLAG: --max-pods="110"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594789    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594792    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 10:36:49.606114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594795    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594797    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594800    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594803    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594806    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594812    2559 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594815    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594818    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594821    2559 flags.go:64] FLAG: --pod-cidr=""
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594824    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594829    2559 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594832    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594835    2559 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594838    2559 flags.go:64] FLAG: --port="10250"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594840    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594844    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-064416e5008a646bb"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594847    2559 flags.go:64] FLAG: --qos-reserved=""
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594849    2559 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594852    2559 flags.go:64] FLAG: --register-node="true"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594855    2559 flags.go:64] FLAG: --register-with-taints=""
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594858    2559 flags.go:64] FLAG: --registry-burst="10"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594861    2559 flags.go:64] FLAG: --registry-qps="5"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594863    2559 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594867    2559 flags.go:64] FLAG: --reserved-memory=""
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594870    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 10:36:49.606837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594873    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594876    2559 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594878    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594881    2559 flags.go:64] FLAG: --runonce="false"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594884    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594888    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594891    2559 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594893    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594896    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594899    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594902    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594905    2559 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594907    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594910    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594913    2559 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594915    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594918    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594921    2559 flags.go:64] FLAG: --system-cgroups=""
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594924    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594929    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594932    2559 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594935    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594939    2559 flags.go:64] FLAG: --tls-min-version=""
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594941    2559 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594944    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 10:36:49.607527 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594946    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594949    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594951    2559 flags.go:64] FLAG: --v="2"
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594955    2559 flags.go:64] FLAG: --version="false"
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594959    2559 flags.go:64] FLAG: --vmodule=""
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594963    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.594966    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595093    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595097    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595100    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595103    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595105    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595110    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595113    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595115    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595118    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595120    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595122    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595125    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595127    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595130    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595132    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 10:36:49.608229 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595134    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595137    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595139    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595142    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595144    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595147    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595149    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595151    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595154    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595156    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595158    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595160    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595163    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595165    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595167    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595171    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595174    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595178    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595181    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 10:36:49.608814 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595184    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595187    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595190    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595194    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595197    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595200    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595203    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595205    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595209    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595213    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595215    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595219    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595222    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595225    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595228    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595230    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595233    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595236    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595239    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 10:36:49.609260 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595242    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595244    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595247    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595249    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595252    2559 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595254    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595256    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595259    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595261    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595265    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595268    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595270    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595273    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595275    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595278    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595280    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595284    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595286    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595289    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595291    2559 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 10:36:49.609865 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595293    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595296    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595298    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595301    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595303    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595305    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595308    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595310    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595313    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595315    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595318    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595320    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595323    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595325    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595328    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595330    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595332    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595335    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595337    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595340    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 10:36:49.610331 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595342    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 10:36:49.610894 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595346    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 10:36:49.610894 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595349    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 10:36:49.610894 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595351    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 10:36:49.610894 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595354    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 10:36:49.610894 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.595356    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 10:36:49.610894 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.596395    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 10:36:49.610894 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.603265    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 10:36:49.610894 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.603279    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 10:36:49.610894 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.603298    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 10:36:49.610894 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.603304    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 10:36:49.610894 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603357    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 10:36:49.610894 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603363    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 10:36:49.610894 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603367    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 10:36:49.610894 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603370    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603373    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603375    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603378    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603381    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603384    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603386    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603389    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603392    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603394    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603397    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603399    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603401    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603404    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603407    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603409    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603411    2559 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603414    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603417    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603419    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 10:36:49.611248 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603422    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603424    2559 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603427    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603429    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603432    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603435    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603440    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603443    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603445    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603448    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603450    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603453    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603455    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603457    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603460    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603462    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603464    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603467    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603469    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603472    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 10:36:49.611770 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603474    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603476    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603479    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603481    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603484    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603486    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603489    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603491    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603493    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603496    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603499    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603501    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603503    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603506    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603516    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603520    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603523    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603525    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603528    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 10:36:49.612554 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603531    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603533    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603536    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603538    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603541    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603543    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603545    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603548    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603550    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603552    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603555    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603557    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603559    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603562    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603564    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603566    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603569    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603571    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603573    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603576    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 10:36:49.613195 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603578    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603581    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603583    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603586    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603589    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603591    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603593    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603597    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603601    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603604    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603607    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603609    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603612    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603615    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603617    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603619    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 10:36:49.613708 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603621    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 10:36:49.614308 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.603626    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 10:36:49.614308 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603755    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 10:36:49.614308 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603760    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 10:36:49.614308 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603763    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 10:36:49.614308 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603766    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 10:36:49.614308 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603769    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 10:36:49.614308 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603771    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 10:36:49.614308 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603774    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 10:36:49.614308 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603777    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 10:36:49.614308 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603779    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 10:36:49.614308 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603783    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 10:36:49.614308 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603786    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 10:36:49.614308 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603789    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 10:36:49.614308 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603791    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603794    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603797    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603799    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603802    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603805    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603807    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603810    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603812    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603815    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603817    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603820    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603822    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603824    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603827    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603829    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603832    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603835    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603837    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603840    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 10:36:49.614681 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603842    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603845    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603847    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603849    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603852    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603854    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603856    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603858    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603861    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603863    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603865    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603868    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603870    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603873    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603875    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603878    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603880    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603882    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603886    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603889    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 10:36:49.615159 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603892    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603894    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603896    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603900    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603903    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603906    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603909    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603911    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603914    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603917    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603920    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603922    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603925    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603927    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603929    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603932    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603934    2559 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603937    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603939    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603941    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 10:36:49.615659 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603944    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603946    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603948    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603951    2559 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603953    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603955    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603958    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603960    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603963    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603965    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603968    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603970    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603972    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603975    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603977    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603980    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603982    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603984    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603987    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603989    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 10:36:49.616258 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603991    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 10:36:49.616795 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603994    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 10:36:49.616795 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603996    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 10:36:49.616795 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.603999    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 10:36:49.616795 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.604001    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 10:36:49.616795 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.604003    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 10:36:49.616795 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:49.604005    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 10:36:49.616795 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.604010    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 10:36:49.616795 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.604100    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 10:36:49.616795 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.607672    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 10:36:49.616795 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.609416    2559 server.go:1019] "Starting client certificate rotation"
Aug 04 10:36:49.616795 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.609538    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 10:36:49.616795 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.609589    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 10:36:49.616795 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.612202    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 10:36:49.617137 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.613348    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 10:36:49.626617 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.626603    2559 log.go:25] "Validated CRI v1 runtime API"
Aug 04 10:36:49.629187 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.629173    2559 log.go:25] "Validated CRI v1 image API"
Aug 04 10:36:49.629979 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.629965    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 10:36:49.634154 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.634136    2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 91e24201-0069-4985-b14b-475eb5d17fff:/dev/nvme0n1p4 9f740335-3376-48d8-abe3-ec3bd270e354:/dev/nvme0n1p3]
Aug 04 10:36:49.634221 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.634153    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 10:36:49.640790 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.640682    2559 manager.go:216] Machine: {Timestamp:2026-08-04 10:36:49.639399392 +0000 UTC m=+0.365469718 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3169223 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a9c1ec09f501f46c63923be59031b SystemUUID:ec2a9c1e-c09f-501f-46c6-3923be59031b BootID:2f75997a-a7a3-4a2e-8afc-48037b98a49a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3b:f2:69:50:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3b:f2:69:50:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:3f:df:aa:81:2b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 10:36:49.640790 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.640787    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 10:36:49.640891 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.640884    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 10:36:49.644932 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.644906    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 10:36:49.645054 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.644936    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 10:36:49.645907 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.645896    2559 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 10:36:49.645942 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.645909    2559 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 10:36:49.645942 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.645916    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 10:36:49.645942 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.645925    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 10:36:49.646554 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.646540    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 10:36:49.647568 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.647557    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 10:36:49.652454 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.652443    2559 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 10:36:49.652570 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.652560    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 10:36:49.652607 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.652592    2559 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 10:36:49.652607 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.652603    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 10:36:49.652686 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.652617    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 10:36:49.652686 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.652627    2559 kubelet.go:398] "Adding apiserver pod source"
Aug 04 10:36:49.652686 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.652652    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 10:36:49.653214 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.653187    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 10:36:49.653214 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.653219    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 10:36:49.656624 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.656609    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 10:36:49.658259 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.658246    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 10:36:49.658322 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.658276    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 10:36:49.659109 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.659099    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 10:36:49.659150 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.659115    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 10:36:49.659150 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.659121    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 10:36:49.659150 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.659126    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 10:36:49.659150 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.659134    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 10:36:49.659150 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.659139    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 10:36:49.659307 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.659299    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 10:36:49.659363 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.659307    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 10:36:49.659363 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.659313    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 10:36:49.659363 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.659319    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 10:36:49.659363 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.659327    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 10:36:49.659363 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.659334    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 10:36:49.660336 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.660323    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 10:36:49.660374 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.660338    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 10:36:49.663297 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.663285    2559 server.go:1268] "Started kubelet"
Aug 04 10:36:49.663421 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.663393    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 10:36:49.663474 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.663400    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 10:36:49.663474 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.663465    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 10:36:49.664081 ip-10-0-136-162 systemd[1]: Started Kubernetes Kubelet.
Aug 04 10:36:49.665318 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.665300    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 10:36:49.666093 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.666075    2559 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 10:36:49.667348 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.667329    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 10:36:49.667557 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.667535    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 10:36:49.667628 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.667579    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 10:36:49.670123 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.670106    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 10:36:49.672853 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.671442    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c893d858bad898  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-08-04 10:36:49.663260824 +0000 UTC m=+0.389331150,LastTimestamp:2026-08-04 10:36:49.663260824 +0000 UTC m=+0.389331150,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}"
Aug 04 10:36:49.673217 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.673198    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 10:36:49.673217 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.673213    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 10:36:49.673349 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.673292    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found"
Aug 04 10:36:49.673979 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.673962    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 10:36:49.673979 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.673982    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 10:36:49.674109 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.673959    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 10:36:49.674156 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.674109    2559 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 10:36:49.674156 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.674117    2559 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 10:36:49.674249 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.674233    2559 factory.go:55] Registering systemd factory
Aug 04 10:36:49.674296 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.674253    2559 factory.go:223] Registration of the systemd container factory successfully
Aug 04 10:36:49.674485 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.674467    2559 factory.go:153] Registering CRI-O factory
Aug 04 10:36:49.674485 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.674484    2559 factory.go:223] Registration of the crio container factory successfully
Aug 04 10:36:49.674655 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.674547    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 10:36:49.674655 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.674565    2559 factory.go:103] Registering Raw factory
Aug 04 10:36:49.674655 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.674575    2559 manager.go:1196] Started watching for new ooms in manager
Aug 04 10:36:49.675178 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.675104    2559 manager.go:349] Starting recovery of all containers
Aug 04 10:36:49.679926 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.679898    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 04 10:36:49.680063 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.680038    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 04 10:36:49.686422 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.686406    2559 manager.go:354] Recovery completed
Aug 04 10:36:49.690490 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.690478    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 10:36:49.692208 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.692192    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 10:36:49.692265 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.692219    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 10:36:49.692265 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.692234    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID"
Aug 04 10:36:49.692699 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.692680    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 10:36:49.692699 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.692692    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 10:36:49.692821 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.692708    2559 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 10:36:49.692821 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.692760    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 10:36:49.693420 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.693406    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 10:36:49.693461 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.693431    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 10:36:49.693461 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.693440    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID"
Aug 04 10:36:49.694807 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.694796    2559 policy_none.go:49] "None policy: Start"
Aug 04 10:36:49.694849 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.694811    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 10:36:49.694849 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.694821    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 10:36:49.696770 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.696760    2559 policy_none.go:47] "Start"
Aug 04 10:36:49.698235 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.698173    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c893d85a748a11  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-162.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-08-04 10:36:49.692207633 +0000 UTC m=+0.418277957,LastTimestamp:2026-08-04 10:36:49.692207633 +0000 UTC m=+0.418277957,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}"
Aug 04 10:36:49.707522 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.707455    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c893d85a74d1d6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-162.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-08-04 10:36:49.692226006 +0000 UTC m=+0.418296334,LastTimestamp:2026-08-04 10:36:49.692226006 +0000 UTC m=+0.418296334,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}"
Aug 04 10:36:49.733517 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.733360    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c893d85a75035e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-162.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-08-04 10:36:49.692238686 +0000 UTC m=+0.418309011,LastTimestamp:2026-08-04 10:36:49.692238686 +0000 UTC m=+0.418309011,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}"
Aug 04 10:36:49.756285 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.742191    2559 manager.go:337] "Starting Device Plugin manager"
Aug 04 10:36:49.756285 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.742217    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 10:36:49.756285 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.742225    2559 server.go:87] "Starting device plugin registration server"
Aug 04 10:36:49.756285 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.742450    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 10:36:49.756285 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.742467    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 10:36:49.756285 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.742570    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 10:36:49.756285 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.742662    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 10:36:49.756285 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.742671    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 10:36:49.756285 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.743086    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 10:36:49.756285 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.743130    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-162.ec2.internal\" not found"
Aug 04 10:36:49.756285 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.743501    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-162.ec2.internal.18c893d85a748a11\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c893d85a748a11  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-162.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-08-04 10:36:49.692207633 +0000 UTC m=+0.418277957,LastTimestamp:2026-08-04 10:36:49.693420296 +0000 UTC m=+0.419490620,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}"
Aug 04 10:36:49.756285 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.755421    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-162.ec2.internal.18c893d85a74d1d6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c893d85a74d1d6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-162.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-08-04 10:36:49.692226006 +0000 UTC m=+0.418296334,LastTimestamp:2026-08-04 10:36:49.693435748 +0000 UTC m=+0.419506072,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}"
Aug 04 10:36:49.768579 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.768524    2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-162.ec2.internal.18c893d85a75035e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c893d85a75035e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-162.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-08-04 10:36:49.692238686 +0000 UTC m=+0.418309011,LastTimestamp:2026-08-04 10:36:49.693444113 +0000 UTC m=+0.419514438,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}"
Aug 04 10:36:49.773473 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.773446    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 10:36:49.774752 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.774732    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 10:36:49.774827 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.774774    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 10:36:49.774827 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.774798    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 10:36:49.774906 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.774839    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 10:36:49.779197 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.779137    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-162.ec2.internal.18c893d85d8fc408  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-162.ec2.internal,UID:ip-10-0-136-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-136-162.ec2.internal,},FirstTimestamp:2026-08-04 10:36:49.744323592 +0000 UTC m=+0.470393905,LastTimestamp:2026-08-04 10:36:49.744323592 +0000 UTC m=+0.470393905,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-162.ec2.internal,}"
Aug 04 10:36:49.783007 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.782986    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Aug 04 10:36:49.800427 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.800407    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hk648"
Aug 04 10:36:49.817255 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.817240    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hk648"
Aug 04 10:36:49.842563 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.842544    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 10:36:49.843588 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.843564    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 10:36:49.843700 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.843602    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 10:36:49.843700 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.843615    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID"
Aug 04 10:36:49.843700 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.843666    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-162.ec2.internal"
Aug 04 10:36:49.859028 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.859009    2559 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-136-162.ec2.internal\" not found" node="ip-10-0-136-162.ec2.internal"
Aug 04 10:36:49.875827 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.875801    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal"]
Aug 04 10:36:49.875879 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.875874    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 10:36:49.876618 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.876606    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 10:36:49.876693 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.876630    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 10:36:49.876693 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.876661    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID"
Aug 04 10:36:49.879196 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.879184    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 10:36:49.879317 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.879303    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal"
Aug 04 10:36:49.879354 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.879332    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 10:36:49.879864 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.879849    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 10:36:49.879917 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.879874    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 10:36:49.879917 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.879883    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID"
Aug 04 10:36:49.880439 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.880425    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 10:36:49.880486 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.880449    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 10:36:49.880486 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.880457    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID"
Aug 04 10:36:49.882466 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.882453    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal"
Aug 04 10:36:49.882511 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.882474    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 10:36:49.883083 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.883067    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 10:36:49.883142 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.883096    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 10:36:49.883142 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.883110    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID"
Aug 04 10:36:49.887108 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.887093    2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-162.ec2.internal\" not found" node="ip-10-0-136-162.ec2.internal"
Aug 04 10:36:49.906140 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.906121    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-162.ec2.internal\" not found" node="ip-10-0-136-162.ec2.internal"
Aug 04 10:36:49.910145 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:49.910132    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-162.ec2.internal\" not found" node="ip-10-0-136-162.ec2.internal"
Aug 04 10:36:49.974796 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:49.974772    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c34789147362cd8ef060a7cb919d707-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal\" (UID: \"4c34789147362cd8ef060a7cb919d707\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal"
Aug 04 10:36:50.059762 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.059731    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 10:36:50.060589 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.060574    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 10:36:50.060687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.060602    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 10:36:50.060687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.060615    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID"
Aug 04 10:36:50.060687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.060663    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-162.ec2.internal"
Aug 04 10:36:50.075283 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.075260    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c34789147362cd8ef060a7cb919d707-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal\" (UID: \"4c34789147362cd8ef060a7cb919d707\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal"
Aug 04 10:36:50.075380 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.075303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c34789147362cd8ef060a7cb919d707-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal\" (UID: \"4c34789147362cd8ef060a7cb919d707\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal"
Aug 04 10:36:50.075380 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.075329    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c6c3d58b6fed20e5c5b5b141f5402cf-config\") pod \"kube-apiserver-proxy-ip-10-0-136-162.ec2.internal\" (UID: \"9c6c3d58b6fed20e5c5b5b141f5402cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal"
Aug 04 10:36:50.075380 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.075351    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c34789147362cd8ef060a7cb919d707-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal\" (UID: \"4c34789147362cd8ef060a7cb919d707\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal"
Aug 04 10:36:50.077329 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.077316    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-162.ec2.internal"
Aug 04 10:36:50.077371 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:50.077335    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-162.ec2.internal\": node \"ip-10-0-136-162.ec2.internal\" not found"
Aug 04 10:36:50.105171 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:50.105126    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found"
Aug 04 10:36:50.175613 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.175594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c34789147362cd8ef060a7cb919d707-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal\" (UID: \"4c34789147362cd8ef060a7cb919d707\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal"
Aug 04 10:36:50.175692 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.175620    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c6c3d58b6fed20e5c5b5b141f5402cf-config\") pod \"kube-apiserver-proxy-ip-10-0-136-162.ec2.internal\" (UID: \"9c6c3d58b6fed20e5c5b5b141f5402cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal"
Aug 04 10:36:50.175692 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.175671    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c34789147362cd8ef060a7cb919d707-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal\" (UID: \"4c34789147362cd8ef060a7cb919d707\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal"
Aug 04 10:36:50.175692 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.175664    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c6c3d58b6fed20e5c5b5b141f5402cf-config\") pod \"kube-apiserver-proxy-ip-10-0-136-162.ec2.internal\" (UID: \"9c6c3d58b6fed20e5c5b5b141f5402cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal"
Aug 04 10:36:50.205703 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:50.205685    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found"
Aug 04 10:36:50.207859 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.207849    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal"
Aug 04 10:36:50.212916 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.212697    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal"
Aug 04 10:36:50.306414 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:50.306390    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found"
Aug 04 10:36:50.406990 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:50.406935    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found"
Aug 04 10:36:50.507393 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:50.507372    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found"
Aug 04 10:36:50.607915 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:50.607896    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found"
Aug 04 10:36:50.609008 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.608990    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 10:36:50.707979 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:50.707930    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found"
Aug 04 10:36:50.768059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.768040    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 10:36:50.808703 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:50.808673    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found"
Aug 04 10:36:50.823848 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.823816    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 10:31:50 +0000 UTC" deadline="2028-02-06 00:20:35.168598316 +0000 UTC"
Aug 04 10:36:50.823848 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.823843    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13213h43m44.344758565s"
Aug 04 10:36:50.880202 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.880183    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 10:36:50.881325 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.881308    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 10:36:50.881406 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.881341    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 10:36:50.881406 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.881352    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeHasSufficientPID"
Aug 04 10:36:50.883690 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:50.883659    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c34789147362cd8ef060a7cb919d707.slice/crio-110fd50076ad94781184ede08fc8cea746b6a69894b8be4f8c26b83afbe0715c WatchSource:0}: Error finding container 110fd50076ad94781184ede08fc8cea746b6a69894b8be4f8c26b83afbe0715c: Status 404 returned error can't find the container with id 110fd50076ad94781184ede08fc8cea746b6a69894b8be4f8c26b83afbe0715c
Aug 04 10:36:50.884591 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:50.884574    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6c3d58b6fed20e5c5b5b141f5402cf.slice/crio-7e8254c62b2bf6f22d8a0a39379193ea0766ac889268e869dec970c44c6aa0bd WatchSource:0}: Error finding container 7e8254c62b2bf6f22d8a0a39379193ea0766ac889268e869dec970c44c6aa0bd: Status 404 returned error can't find the container with id 7e8254c62b2bf6f22d8a0a39379193ea0766ac889268e869dec970c44c6aa0bd
Aug 04 10:36:50.888186 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:50.888173    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 10:36:50.909028 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:50.909003    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found"
Aug 04 10:36:51.009677 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:51.009605    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found"
Aug 04 10:36:51.103465 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.103447    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 10:36:51.110266 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:51.110249    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-162.ec2.internal\" not found"
Aug 04 10:36:51.129351 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.129334    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 10:36:51.174132 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.174098    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal"
Aug 04 10:36:51.198799 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.198779    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 10:36:51.200953 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.200939    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal"
Aug 04 10:36:51.211352 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.211328    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 10:36:51.213425 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.213409    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 10:36:51.655187 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.655158    2559 apiserver.go:52] "Watching apiserver"
Aug 04 10:36:51.665290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.665001    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 10:36:51.666574 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.666238    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-rvnjq","kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29","openshift-cluster-node-tuning-operator/tuned-vrzwr","openshift-multus/network-metrics-daemon-45gv2","openshift-network-diagnostics/network-check-target-vg4bn","openshift-network-operator/iptables-alerter-qcdc2","openshift-ovn-kubernetes/ovnkube-node-5mgdp","kube-system/global-pull-secret-syncer-mtxjn","openshift-dns/node-resolver-mg8tk","openshift-image-registry/node-ca-nc4hz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal","openshift-multus/multus-9xldn","openshift-multus/multus-additional-cni-plugins-pqvvw"]
Aug 04 10:36:51.668791 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.668757    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qcdc2"
Aug 04 10:36:51.671725 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.671697    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.674033 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.674015    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 10:36:51.674135 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.674060    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.674951 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.674889    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 10:36:51.675048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.674961    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 10:36:51.675485 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.675224    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wxd4t\""
Aug 04 10:36:51.675485 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.675231    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cpp52\""
Aug 04 10:36:51.675485 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.675369    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 10:36:51.676621 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.675812    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 10:36:51.676621 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.676217    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.676621 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.676615    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 10:36:51.676835 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.676690    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 10:36:51.676950 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.676928    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 10:36:51.677449 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.677231    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 10:36:51.678034 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.677675    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 10:36:51.680467 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.678464    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 10:36:51.680467 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.678953    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-49rzq\""
Aug 04 10:36:51.680467 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.679102    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4frx8\""
Aug 04 10:36:51.680467 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.680191    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:36:51.680467 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:51.680266    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:36:51.682486 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.682466    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:36:51.682581 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:51.682525    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:36:51.683972 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.683951    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-socket-dir\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.684067 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.683987    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-run-netns\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.684067 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684014    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2ce67fc-2c75-4e55-bd6d-2ffe62272e70-iptables-alerter-script\") pod \"iptables-alerter-qcdc2\" (UID: \"c2ce67fc-2c75-4e55-bd6d-2ffe62272e70\") " pod="openshift-network-operator/iptables-alerter-qcdc2"
Aug 04 10:36:51.684067 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684042    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvm78\" (UniqueName: \"kubernetes.io/projected/c2ce67fc-2c75-4e55-bd6d-2ffe62272e70-kube-api-access-xvm78\") pod \"iptables-alerter-qcdc2\" (UID: \"c2ce67fc-2c75-4e55-bd6d-2ffe62272e70\") " pod="openshift-network-operator/iptables-alerter-qcdc2"
Aug 04 10:36:51.684226 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684067    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-run-k8s-cni-cncf-io\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.684226 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684090    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-hostroot\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.684226 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684113    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-sys-fs\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.684226 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684136    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7zd7\" (UniqueName: \"kubernetes.io/projected/c3993d68-2b6a-4352-b1b3-cdedaccff424-kube-api-access-n7zd7\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.684226 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684162    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-device-dir\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.684226 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-sysconfig\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.684226 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684191    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-kubernetes\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.684226 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684205    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-sysctl-conf\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.684515 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684231    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-run\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.684515 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-sys\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.684515 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684263    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-var-lib-kubelet\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.684515 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684279    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-var-lib-cni-bin\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.684515 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684319    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-var-lib-cni-multus\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.684515 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.684515 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684368    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-sysctl-d\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.684515 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684390    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77cd6c46-e4ca-480b-aa39-004d2c4a760f-cni-binary-copy\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.684515 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684416    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-multus-socket-dir-parent\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.684515 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684447    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-var-lib-kubelet\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.684515 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684479    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-run-multus-certs\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.684515 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684504    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5jkv\" (UniqueName: \"kubernetes.io/projected/2f70cd04-2975-43ba-bd5e-d09eaaf13480-kube-api-access-w5jkv\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.684925 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684529    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m9rc\" (UniqueName: \"kubernetes.io/projected/77cd6c46-e4ca-480b-aa39-004d2c4a760f-kube-api-access-5m9rc\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.684925 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684553    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-registration-dir\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.684925 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684577    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-multus-cni-dir\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.684925 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684600    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-os-release\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.684925 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684622    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-multus-conf-dir\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.684925 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684672    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-tuned\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.685180 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.685159    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:51.685223 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.684698    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f70cd04-2975-43ba-bd5e-d09eaaf13480-tmp\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.685259 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:51.685231    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:36:51.685259 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.685240    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-etc-selinux\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.685325 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.685266    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-modprobe-d\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.685325 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.685291    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-systemd\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.685385 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.685333    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2ce67fc-2c75-4e55-bd6d-2ffe62272e70-host-slash\") pod \"iptables-alerter-qcdc2\" (UID: \"c2ce67fc-2c75-4e55-bd6d-2ffe62272e70\") " pod="openshift-network-operator/iptables-alerter-qcdc2"
Aug 04 10:36:51.685385 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.685367    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-cnibin\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.685444 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.685389    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/77cd6c46-e4ca-480b-aa39-004d2c4a760f-multus-daemon-config\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.685444 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.685414    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-etc-kubernetes\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.685444 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.685431    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-host\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.685559 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.685465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-system-cni-dir\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.685559 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.685485    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-lib-modules\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.688115 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.687993    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rvnjq"
Aug 04 10:36:51.688413 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.688373    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 10:36:51.689754 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.689662    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 10:36:51.691154 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.691135    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 10:36:51.691451 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.691433    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 10:36:51.692055 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.692034    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nqdv6\""
Aug 04 10:36:51.692773 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.692749    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.692976 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.692955    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mg8tk"
Aug 04 10:36:51.694091 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.693974    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 10:36:51.696781 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.695341    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qp6sn\""
Aug 04 10:36:51.697448 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.697426    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 10:36:51.697637 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.697615    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lkxqm\""
Aug 04 10:36:51.697703 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.697643    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 10:36:51.697791 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.697740    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 10:36:51.697791 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.697643    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 10:36:51.698669 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.698638    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nc4hz"
Aug 04 10:36:51.701117 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.701094    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.702469 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.702448    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 10:36:51.702754 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.702736    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 10:36:51.702994 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.702979    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c7z65\""
Aug 04 10:36:51.703768 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.702581    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 10:36:51.706165 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.706149    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 10:36:51.706807 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.706564    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 10:36:51.706807 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.706571    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 10:36:51.707875 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.707858    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 10:36:51.707954 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.707884    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z2nlr\""
Aug 04 10:36:51.708087 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.708065    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 10:36:51.708147 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.708118    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 10:36:51.778223 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.778196    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 10:36:51.779888 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.779840    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal" event={"ID":"9c6c3d58b6fed20e5c5b5b141f5402cf","Type":"ContainerStarted","Data":"7e8254c62b2bf6f22d8a0a39379193ea0766ac889268e869dec970c44c6aa0bd"}
Aug 04 10:36:51.781473 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.781448    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" event={"ID":"4c34789147362cd8ef060a7cb919d707","Type":"ContainerStarted","Data":"110fd50076ad94781184ede08fc8cea746b6a69894b8be4f8c26b83afbe0715c"}
Aug 04 10:36:51.785751 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.785725    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-node-log\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.785850 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.785757    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-cni-bin\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.785850 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.785782    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab573cce-21c5-4ed1-b424-eb762d565a94-env-overrides\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.785850 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.785809    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-etc-openvswitch\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.785850 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.785838    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m9rc\" (UniqueName: \"kubernetes.io/projected/77cd6c46-e4ca-480b-aa39-004d2c4a760f-kube-api-access-5m9rc\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.786056 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.785864    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-multus-cni-dir\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.786056 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.785899    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-os-release\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.786056 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.785923    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-multus-conf-dir\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.786056 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.785947    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-tuned\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.786056 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.785970    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f70cd04-2975-43ba-bd5e-d09eaaf13480-tmp\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.786056 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786007    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.786056 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786033    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-systemd\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.786344 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786062    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/790dd286-529d-47d2-a860-6f692d635f80-kubelet-config\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:51.786344 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786089    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2ce67fc-2c75-4e55-bd6d-2ffe62272e70-host-slash\") pod \"iptables-alerter-qcdc2\" (UID: \"c2ce67fc-2c75-4e55-bd6d-2ffe62272e70\") " pod="openshift-network-operator/iptables-alerter-qcdc2"
Aug 04 10:36:51.786344 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786111    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-cnibin\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.786344 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786134    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/77cd6c46-e4ca-480b-aa39-004d2c4a760f-multus-daemon-config\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.786344 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786157    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-etc-kubernetes\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.786344 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786181    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs\") pod \"network-metrics-daemon-45gv2\" (UID: \"3797c942-ece8-4151-bfb3-5c0ed4a61cd9\") " pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:36:51.786344 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3df3887-c14e-494d-9eee-c0bf6d22f716-system-cni-dir\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.786344 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786240    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-var-lib-openvswitch\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.786344 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786265    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/790dd286-529d-47d2-a860-6f692d635f80-dbus\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:51.786344 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786288    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb5ca508-8941-4f0a-b418-defcadef5c2e-agent-certs\") pod \"konnectivity-agent-rvnjq\" (UID: \"eb5ca508-8941-4f0a-b418-defcadef5c2e\") " pod="kube-system/konnectivity-agent-rvnjq"
Aug 04 10:36:51.786344 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2ce67fc-2c75-4e55-bd6d-2ffe62272e70-iptables-alerter-script\") pod \"iptables-alerter-qcdc2\" (UID: \"c2ce67fc-2c75-4e55-bd6d-2ffe62272e70\") " pod="openshift-network-operator/iptables-alerter-qcdc2"
Aug 04 10:36:51.786344 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786339    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-sys-fs\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.786779 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786366    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7zd7\" (UniqueName: \"kubernetes.io/projected/c3993d68-2b6a-4352-b1b3-cdedaccff424-kube-api-access-n7zd7\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.786779 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786392    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-var-lib-kubelet\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.786779 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5jkv\" (UniqueName: \"kubernetes.io/projected/2f70cd04-2975-43ba-bd5e-d09eaaf13480-kube-api-access-w5jkv\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.786779 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786456    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-cni-netd\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.786779 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786489    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab573cce-21c5-4ed1-b424-eb762d565a94-ovnkube-config\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.786779 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786518    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpmls\" (UniqueName: \"kubernetes.io/projected/ab573cce-21c5-4ed1-b424-eb762d565a94-kube-api-access-tpmls\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.786779 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786543    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-run\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.786779 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786566    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-sys\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.786779 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786587    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-systemd-units\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.786779 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786613    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-run-openvswitch\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.786779 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786643    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-log-socket\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.786779 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786670    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddccaa00-a3b0-4696-9f37-7e86195ddf41-tmp-dir\") pod \"node-resolver-mg8tk\" (UID: \"ddccaa00-a3b0-4696-9f37-7e86195ddf41\") " pod="openshift-dns/node-resolver-mg8tk"
Aug 04 10:36:51.786779 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786693    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3df3887-c14e-494d-9eee-c0bf6d22f716-os-release\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.786779 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786736    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-var-lib-cni-multus\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.786779 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786786    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-sysctl-d\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786812    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4stl\" (UniqueName: \"kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl\") pod \"network-check-target-vg4bn\" (UID: \"362a23fd-e433-4252-9828-05cf8ad8c756\") " pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786836    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ddccaa00-a3b0-4696-9f37-7e86195ddf41-hosts-file\") pod \"node-resolver-mg8tk\" (UID: \"ddccaa00-a3b0-4696-9f37-7e86195ddf41\") " pod="openshift-dns/node-resolver-mg8tk"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786876    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77cd6c46-e4ca-480b-aa39-004d2c4a760f-cni-binary-copy\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786904    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-run-netns\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786932    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb5ca508-8941-4f0a-b418-defcadef5c2e-konnectivity-ca\") pod \"konnectivity-agent-rvnjq\" (UID: \"eb5ca508-8941-4f0a-b418-defcadef5c2e\") " pod="kube-system/konnectivity-agent-rvnjq"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786957    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3df3887-c14e-494d-9eee-c0bf6d22f716-cni-binary-copy\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.786987    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-registration-dir\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787013    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-kubelet\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787039    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/781d93fa-f41a-4510-836a-deadf3c3be42-serviceca\") pod \"node-ca-nc4hz\" (UID: \"781d93fa-f41a-4510-836a-deadf3c3be42\") " pod="openshift-image-registry/node-ca-nc4hz"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787066    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-etc-selinux\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787098    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-modprobe-d\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787125    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-host\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787149    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-run-systemd\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787176    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-run-ovn-kubernetes\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787201    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3df3887-c14e-494d-9eee-c0bf6d22f716-cnibin\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.787290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-system-cni-dir\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787258    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-lib-modules\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab573cce-21c5-4ed1-b424-eb762d565a94-ovnkube-script-lib\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnvv5\" (UniqueName: \"kubernetes.io/projected/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-kube-api-access-tnvv5\") pod \"network-metrics-daemon-45gv2\" (UID: \"3797c942-ece8-4151-bfb3-5c0ed4a61cd9\") " pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787328    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfnzm\" (UniqueName: \"kubernetes.io/projected/ddccaa00-a3b0-4696-9f37-7e86195ddf41-kube-api-access-cfnzm\") pod \"node-resolver-mg8tk\" (UID: \"ddccaa00-a3b0-4696-9f37-7e86195ddf41\") " pod="openshift-dns/node-resolver-mg8tk"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787353    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-socket-dir\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787379    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-run-netns\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787397    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvm78\" (UniqueName: \"kubernetes.io/projected/c2ce67fc-2c75-4e55-bd6d-2ffe62272e70-kube-api-access-xvm78\") pod \"iptables-alerter-qcdc2\" (UID: \"c2ce67fc-2c75-4e55-bd6d-2ffe62272e70\") " pod="openshift-network-operator/iptables-alerter-qcdc2"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787413    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-run-k8s-cni-cncf-io\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-hostroot\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787444    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-sysctl-conf\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787461    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-slash\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787476    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn6pm\" (UniqueName: \"kubernetes.io/projected/b3df3887-c14e-494d-9eee-c0bf6d22f716-kube-api-access-fn6pm\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787499    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-device-dir\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787515    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-sysconfig\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787533    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-kubernetes\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787550    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab573cce-21c5-4ed1-b424-eb762d565a94-ovn-node-metrics-cert\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.788048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787574    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:51.788544 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787600    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3df3887-c14e-494d-9eee-c0bf6d22f716-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.788544 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787617    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcvx4\" (UniqueName: \"kubernetes.io/projected/781d93fa-f41a-4510-836a-deadf3c3be42-kube-api-access-jcvx4\") pod \"node-ca-nc4hz\" (UID: \"781d93fa-f41a-4510-836a-deadf3c3be42\") " pod="openshift-image-registry/node-ca-nc4hz"
Aug 04 10:36:51.788544 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787633    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-var-lib-cni-bin\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.788544 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787649    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-run-ovn\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.788544 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787668    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3df3887-c14e-494d-9eee-c0bf6d22f716-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.788544 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787684    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3df3887-c14e-494d-9eee-c0bf6d22f716-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.788544 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787700    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/781d93fa-f41a-4510-836a-deadf3c3be42-host\") pod \"node-ca-nc4hz\" (UID: \"781d93fa-f41a-4510-836a-deadf3c3be42\") " pod="openshift-image-registry/node-ca-nc4hz"
Aug 04 10:36:51.788544 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787734    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-multus-socket-dir-parent\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.788544 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787752    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-var-lib-kubelet\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.788544 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787773    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-run-multus-certs\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.788544 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.787846    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-run-multus-certs\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.788544 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.788246    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-multus-cni-dir\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.788544 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.788295    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-os-release\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.788544 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.788332    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-multus-conf-dir\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.789061 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.788578    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 10:36:51.789061 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.788905    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z4q9f"
Aug 04 10:36:51.789061 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.788961    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-run-k8s-cni-cncf-io\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.789061 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.789003    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-registration-dir\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.789252 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.789126    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-etc-selinux\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.789252 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.789167    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-hostroot\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.789252 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.789215    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-modprobe-d\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.789382 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.789265    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-host\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.789382 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.789291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-sysctl-conf\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.789382 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.789357    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-system-cni-dir\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.789523 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.789503    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-socket-dir\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.789573 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.789555    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-run-netns\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.789734    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-systemd\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.789819    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-device-dir\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.789822    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-cnibin\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.789873    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-sysconfig\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.790121    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-kubernetes\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.790174    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-var-lib-cni-bin\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.790191    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-lib-modules\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.790215    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2ce67fc-2c75-4e55-bd6d-2ffe62272e70-host-slash\") pod \"iptables-alerter-qcdc2\" (UID: \"c2ce67fc-2c75-4e55-bd6d-2ffe62272e70\") " pod="openshift-network-operator/iptables-alerter-qcdc2"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.790225    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-var-lib-cni-multus\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.790234    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-host-var-lib-kubelet\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.790257    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-run\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.790280    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-sys\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.790290    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-etc-kubernetes\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.790326    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-sysctl-d\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.790329    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/77cd6c46-e4ca-480b-aa39-004d2c4a760f-multus-socket-dir-parent\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.790441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.790389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-sys-fs\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.792843 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.790610    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f70cd04-2975-43ba-bd5e-d09eaaf13480-var-lib-kubelet\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.792843 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.790617    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3993d68-2b6a-4352-b1b3-cdedaccff424-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.792843 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.790922    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2ce67fc-2c75-4e55-bd6d-2ffe62272e70-iptables-alerter-script\") pod \"iptables-alerter-qcdc2\" (UID: \"c2ce67fc-2c75-4e55-bd6d-2ffe62272e70\") " pod="openshift-network-operator/iptables-alerter-qcdc2"
Aug 04 10:36:51.792843 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.791559    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/77cd6c46-e4ca-480b-aa39-004d2c4a760f-multus-daemon-config\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.792843 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.791978    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77cd6c46-e4ca-480b-aa39-004d2c4a760f-cni-binary-copy\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.792843 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.792812    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2f70cd04-2975-43ba-bd5e-d09eaaf13480-etc-tuned\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.794497 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.794457    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f70cd04-2975-43ba-bd5e-d09eaaf13480-tmp\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.804121 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.804097    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z4q9f"
Aug 04 10:36:51.804244 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.804218    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m9rc\" (UniqueName: \"kubernetes.io/projected/77cd6c46-e4ca-480b-aa39-004d2c4a760f-kube-api-access-5m9rc\") pod \"multus-9xldn\" (UID: \"77cd6c46-e4ca-480b-aa39-004d2c4a760f\") " pod="openshift-multus/multus-9xldn"
Aug 04 10:36:51.805935 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.805911    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5jkv\" (UniqueName: \"kubernetes.io/projected/2f70cd04-2975-43ba-bd5e-d09eaaf13480-kube-api-access-w5jkv\") pod \"tuned-vrzwr\" (UID: \"2f70cd04-2975-43ba-bd5e-d09eaaf13480\") " pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:51.806703 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.806650    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvm78\" (UniqueName: \"kubernetes.io/projected/c2ce67fc-2c75-4e55-bd6d-2ffe62272e70-kube-api-access-xvm78\") pod \"iptables-alerter-qcdc2\" (UID: \"c2ce67fc-2c75-4e55-bd6d-2ffe62272e70\") " pod="openshift-network-operator/iptables-alerter-qcdc2"
Aug 04 10:36:51.807334 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.807311    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7zd7\" (UniqueName: \"kubernetes.io/projected/c3993d68-2b6a-4352-b1b3-cdedaccff424-kube-api-access-n7zd7\") pod \"aws-ebs-csi-driver-node-rzj29\" (UID: \"c3993d68-2b6a-4352-b1b3-cdedaccff424\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:51.888737 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.888704    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab573cce-21c5-4ed1-b424-eb762d565a94-ovnkube-script-lib\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.888875 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.888741    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnvv5\" (UniqueName: \"kubernetes.io/projected/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-kube-api-access-tnvv5\") pod \"network-metrics-daemon-45gv2\" (UID: \"3797c942-ece8-4151-bfb3-5c0ed4a61cd9\") " pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:36:51.888875 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.888765    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfnzm\" (UniqueName: \"kubernetes.io/projected/ddccaa00-a3b0-4696-9f37-7e86195ddf41-kube-api-access-cfnzm\") pod \"node-resolver-mg8tk\" (UID: \"ddccaa00-a3b0-4696-9f37-7e86195ddf41\") " pod="openshift-dns/node-resolver-mg8tk"
Aug 04 10:36:51.888955 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.888911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-slash\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.889001 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.888952    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn6pm\" (UniqueName: \"kubernetes.io/projected/b3df3887-c14e-494d-9eee-c0bf6d22f716-kube-api-access-fn6pm\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.889001 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.888986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab573cce-21c5-4ed1-b424-eb762d565a94-ovn-node-metrics-cert\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.889069 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889025    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-slash\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.889069 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889011    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:51.889129 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889082    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3df3887-c14e-494d-9eee-c0bf6d22f716-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.889129 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889110    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcvx4\" (UniqueName: \"kubernetes.io/projected/781d93fa-f41a-4510-836a-deadf3c3be42-kube-api-access-jcvx4\") pod \"node-ca-nc4hz\" (UID: \"781d93fa-f41a-4510-836a-deadf3c3be42\") " pod="openshift-image-registry/node-ca-nc4hz"
Aug 04 10:36:51.889193 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889135    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-run-ovn\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.889226 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889161    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3df3887-c14e-494d-9eee-c0bf6d22f716-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.889259 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889223    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3df3887-c14e-494d-9eee-c0bf6d22f716-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.889259 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:51.889228    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 10:36:51.889259 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889249    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/781d93fa-f41a-4510-836a-deadf3c3be42-host\") pod \"node-ca-nc4hz\" (UID: \"781d93fa-f41a-4510-836a-deadf3c3be42\") " pod="openshift-image-registry/node-ca-nc4hz"
Aug 04 10:36:51.889348 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889277    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-node-log\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.889348 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:51.889291    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret podName:790dd286-529d-47d2-a860-6f692d635f80 nodeName:}" failed. No retries permitted until 2026-08-04 10:36:52.389273659 +0000 UTC m=+3.115343973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret") pod "global-pull-secret-syncer-mtxjn" (UID: "790dd286-529d-47d2-a860-6f692d635f80") : object "kube-system"/"original-pull-secret" not registered
Aug 04 10:36:51.889348 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889316    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-cni-bin\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.889348 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889319    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-node-log\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.889528 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889390    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab573cce-21c5-4ed1-b424-eb762d565a94-ovnkube-script-lib\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.889528 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889472    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-cni-bin\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.889528 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab573cce-21c5-4ed1-b424-eb762d565a94-env-overrides\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.889528 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889517    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/781d93fa-f41a-4510-836a-deadf3c3be42-host\") pod \"node-ca-nc4hz\" (UID: \"781d93fa-f41a-4510-836a-deadf3c3be42\") " pod="openshift-image-registry/node-ca-nc4hz"
Aug 04 10:36:51.889746 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889540    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-etc-openvswitch\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.889746 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889550    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3df3887-c14e-494d-9eee-c0bf6d22f716-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.889746 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889574    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.889746 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889601    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/790dd286-529d-47d2-a860-6f692d635f80-kubelet-config\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:51.889746 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889636    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.889746 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889632    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs\") pod \"network-metrics-daemon-45gv2\" (UID: \"3797c942-ece8-4151-bfb3-5c0ed4a61cd9\") " pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:36:51.889746 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889678    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3df3887-c14e-494d-9eee-c0bf6d22f716-system-cni-dir\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.889746 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889687    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/790dd286-529d-47d2-a860-6f692d635f80-kubelet-config\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:51.889746 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889599    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-etc-openvswitch\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.889746 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889748    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-var-lib-openvswitch\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889775    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/790dd286-529d-47d2-a860-6f692d635f80-dbus\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:51.889791    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889798    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb5ca508-8941-4f0a-b418-defcadef5c2e-agent-certs\") pod \"konnectivity-agent-rvnjq\" (UID: \"eb5ca508-8941-4f0a-b418-defcadef5c2e\") " pod="kube-system/konnectivity-agent-rvnjq"
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889826    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-cni-netd\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:51.889844    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs podName:3797c942-ece8-4151-bfb3-5c0ed4a61cd9 nodeName:}" failed. No retries permitted until 2026-08-04 10:36:52.389823929 +0000 UTC m=+3.115894252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs") pod "network-metrics-daemon-45gv2" (UID: "3797c942-ece8-4151-bfb3-5c0ed4a61cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889861    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-cni-netd\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889858    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-var-lib-openvswitch\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab573cce-21c5-4ed1-b424-eb762d565a94-ovnkube-config\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889897    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpmls\" (UniqueName: \"kubernetes.io/projected/ab573cce-21c5-4ed1-b424-eb762d565a94-kube-api-access-tpmls\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889899    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3df3887-c14e-494d-9eee-c0bf6d22f716-system-cni-dir\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889922    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/790dd286-529d-47d2-a860-6f692d635f80-dbus\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-systemd-units\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889955    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-systemd-units\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889962    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-run-openvswitch\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889972    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab573cce-21c5-4ed1-b424-eb762d565a94-env-overrides\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889737    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-run-ovn\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.890229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.889993    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-log-socket\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890023    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddccaa00-a3b0-4696-9f37-7e86195ddf41-tmp-dir\") pod \"node-resolver-mg8tk\" (UID: \"ddccaa00-a3b0-4696-9f37-7e86195ddf41\") " pod="openshift-dns/node-resolver-mg8tk"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890048    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3df3887-c14e-494d-9eee-c0bf6d22f716-os-release\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890081    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4stl\" (UniqueName: \"kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl\") pod \"network-check-target-vg4bn\" (UID: \"362a23fd-e433-4252-9828-05cf8ad8c756\") " pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890106    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ddccaa00-a3b0-4696-9f37-7e86195ddf41-hosts-file\") pod \"node-resolver-mg8tk\" (UID: \"ddccaa00-a3b0-4696-9f37-7e86195ddf41\") " pod="openshift-dns/node-resolver-mg8tk"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890131    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3df3887-c14e-494d-9eee-c0bf6d22f716-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890174    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-log-socket\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890184    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-run-netns\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890214    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-run-openvswitch\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890132    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-run-netns\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890220    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3df3887-c14e-494d-9eee-c0bf6d22f716-os-release\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890279    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3df3887-c14e-494d-9eee-c0bf6d22f716-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890286    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ddccaa00-a3b0-4696-9f37-7e86195ddf41-hosts-file\") pod \"node-resolver-mg8tk\" (UID: \"ddccaa00-a3b0-4696-9f37-7e86195ddf41\") " pod="openshift-dns/node-resolver-mg8tk"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890312    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb5ca508-8941-4f0a-b418-defcadef5c2e-konnectivity-ca\") pod \"konnectivity-agent-rvnjq\" (UID: \"eb5ca508-8941-4f0a-b418-defcadef5c2e\") " pod="kube-system/konnectivity-agent-rvnjq"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890338    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3df3887-c14e-494d-9eee-c0bf6d22f716-cni-binary-copy\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-kubelet\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890386    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/781d93fa-f41a-4510-836a-deadf3c3be42-serviceca\") pod \"node-ca-nc4hz\" (UID: \"781d93fa-f41a-4510-836a-deadf3c3be42\") " pod="openshift-image-registry/node-ca-nc4hz"
Aug 04 10:36:51.891059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890410    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab573cce-21c5-4ed1-b424-eb762d565a94-ovnkube-config\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.891678 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890414    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-run-systemd\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.891678 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890436    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-kubelet\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.891678 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890458    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-run-ovn-kubernetes\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.891678 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890465    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-run-systemd\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.891678 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890469    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddccaa00-a3b0-4696-9f37-7e86195ddf41-tmp-dir\") pod \"node-resolver-mg8tk\" (UID: \"ddccaa00-a3b0-4696-9f37-7e86195ddf41\") " pod="openshift-dns/node-resolver-mg8tk"
Aug 04 10:36:51.891678 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890486    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3df3887-c14e-494d-9eee-c0bf6d22f716-cnibin\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.891678 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890518    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3df3887-c14e-494d-9eee-c0bf6d22f716-cnibin\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.891678 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890523    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab573cce-21c5-4ed1-b424-eb762d565a94-host-run-ovn-kubernetes\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.891678 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890831    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/781d93fa-f41a-4510-836a-deadf3c3be42-serviceca\") pod \"node-ca-nc4hz\" (UID: \"781d93fa-f41a-4510-836a-deadf3c3be42\") " pod="openshift-image-registry/node-ca-nc4hz"
Aug 04 10:36:51.891678 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890908    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3df3887-c14e-494d-9eee-c0bf6d22f716-cni-binary-copy\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.891678 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.890909    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/eb5ca508-8941-4f0a-b418-defcadef5c2e-konnectivity-ca\") pod \"konnectivity-agent-rvnjq\" (UID: \"eb5ca508-8941-4f0a-b418-defcadef5c2e\") " pod="kube-system/konnectivity-agent-rvnjq"
Aug 04 10:36:51.893096 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.893068    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab573cce-21c5-4ed1-b424-eb762d565a94-ovn-node-metrics-cert\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.893192 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.893173    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/eb5ca508-8941-4f0a-b418-defcadef5c2e-agent-certs\") pod \"konnectivity-agent-rvnjq\" (UID: \"eb5ca508-8941-4f0a-b418-defcadef5c2e\") " pod="kube-system/konnectivity-agent-rvnjq"
Aug 04 10:36:51.904516 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:51.904494    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 10:36:51.904623 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:51.904523    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 10:36:51.904623 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:51.904535    2559 projected.go:196] Error preparing data for projected volume kube-api-access-b4stl for pod openshift-network-diagnostics/network-check-target-vg4bn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 10:36:51.904733 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:51.904637    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl podName:362a23fd-e433-4252-9828-05cf8ad8c756 nodeName:}" failed. No retries permitted until 2026-08-04 10:36:52.404582725 +0000 UTC m=+3.130653046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b4stl" (UniqueName: "kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl") pod "network-check-target-vg4bn" (UID: "362a23fd-e433-4252-9828-05cf8ad8c756") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 10:36:51.906660 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.906610    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnvv5\" (UniqueName: \"kubernetes.io/projected/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-kube-api-access-tnvv5\") pod \"network-metrics-daemon-45gv2\" (UID: \"3797c942-ece8-4151-bfb3-5c0ed4a61cd9\") " pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:36:51.908144 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.908124    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpmls\" (UniqueName: \"kubernetes.io/projected/ab573cce-21c5-4ed1-b424-eb762d565a94-kube-api-access-tpmls\") pod \"ovnkube-node-5mgdp\" (UID: \"ab573cce-21c5-4ed1-b424-eb762d565a94\") " pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:51.910612 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.910593    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfnzm\" (UniqueName: \"kubernetes.io/projected/ddccaa00-a3b0-4696-9f37-7e86195ddf41-kube-api-access-cfnzm\") pod \"node-resolver-mg8tk\" (UID: \"ddccaa00-a3b0-4696-9f37-7e86195ddf41\") " pod="openshift-dns/node-resolver-mg8tk"
Aug 04 10:36:51.911090 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.911068    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn6pm\" (UniqueName: \"kubernetes.io/projected/b3df3887-c14e-494d-9eee-c0bf6d22f716-kube-api-access-fn6pm\") pod \"multus-additional-cni-plugins-pqvvw\" (UID: \"b3df3887-c14e-494d-9eee-c0bf6d22f716\") " pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:51.912326 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.912307    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcvx4\" (UniqueName: \"kubernetes.io/projected/781d93fa-f41a-4510-836a-deadf3c3be42-kube-api-access-jcvx4\") pod \"node-ca-nc4hz\" (UID: \"781d93fa-f41a-4510-836a-deadf3c3be42\") " pod="openshift-image-registry/node-ca-nc4hz"
Aug 04 10:36:51.985753 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.985730    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qcdc2"
Aug 04 10:36:51.999174 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:51.999149    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29"
Aug 04 10:36:52.002864 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:52.002846    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9xldn"
Aug 04 10:36:52.011829 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:52.011811    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vrzwr"
Aug 04 10:36:52.021808 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:52.021789    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rvnjq"
Aug 04 10:36:52.041366 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:52.041343    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mg8tk"
Aug 04 10:36:52.049327 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:52.049307    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pqvvw"
Aug 04 10:36:52.057183 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:52.057163    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nc4hz"
Aug 04 10:36:52.058388 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:52.058365    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:36:52.393089 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:52.393056    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs\") pod \"network-metrics-daemon-45gv2\" (UID: \"3797c942-ece8-4151-bfb3-5c0ed4a61cd9\") " pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:36:52.393249 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:52.393136    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:52.393249 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:52.393233    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 10:36:52.393249 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:52.393233    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 10:36:52.393413 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:52.393302    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret podName:790dd286-529d-47d2-a860-6f692d635f80 nodeName:}" failed. No retries permitted until 2026-08-04 10:36:53.39327942 +0000 UTC m=+4.119349741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret") pod "global-pull-secret-syncer-mtxjn" (UID: "790dd286-529d-47d2-a860-6f692d635f80") : object "kube-system"/"original-pull-secret" not registered
Aug 04 10:36:52.393413 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:52.393319    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs podName:3797c942-ece8-4151-bfb3-5c0ed4a61cd9 nodeName:}" failed. No retries permitted until 2026-08-04 10:36:53.393309591 +0000 UTC m=+4.119379906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs") pod "network-metrics-daemon-45gv2" (UID: "3797c942-ece8-4151-bfb3-5c0ed4a61cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 10:36:52.494538 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:52.494497    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4stl\" (UniqueName: \"kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl\") pod \"network-check-target-vg4bn\" (UID: \"362a23fd-e433-4252-9828-05cf8ad8c756\") " pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:36:52.494754 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:52.494683    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 10:36:52.494754 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:52.494702    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 10:36:52.494754 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:52.494713    2559 projected.go:196] Error preparing data for projected volume kube-api-access-b4stl for pod openshift-network-diagnostics/network-check-target-vg4bn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 10:36:52.494874 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:52.494768    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl podName:362a23fd-e433-4252-9828-05cf8ad8c756 nodeName:}" failed. No retries permitted until 2026-08-04 10:36:53.494750719 +0000 UTC m=+4.220821050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4stl" (UniqueName: "kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl") pod "network-check-target-vg4bn" (UID: "362a23fd-e433-4252-9828-05cf8ad8c756") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 10:36:52.775256 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:52.775177    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:36:52.775865 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:52.775337    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:36:52.807059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:52.807018    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 10:31:52 +0000 UTC" deadline="2028-04-28 03:05:24.808212342 +0000 UTC"
Aug 04 10:36:52.807059 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:52.807052    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15184h28m32.001164202s"
Aug 04 10:36:53.044211 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:53.044185    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f70cd04_2975_43ba_bd5e_d09eaaf13480.slice/crio-3972d008cad425a7e729e80d39c1fa58d436c04e798e5f293ebdd4d57ea7a355 WatchSource:0}: Error finding container 3972d008cad425a7e729e80d39c1fa58d436c04e798e5f293ebdd4d57ea7a355: Status 404 returned error can't find the container with id 3972d008cad425a7e729e80d39c1fa58d436c04e798e5f293ebdd4d57ea7a355
Aug 04 10:36:53.049164 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:36:53.049135    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddccaa00_a3b0_4696_9f37_7e86195ddf41.slice/crio-a05b0da86312b95d175fcf43073066ab88793a31974f585a36a728e4e3a57dd3 WatchSource:0}: Error finding container a05b0da86312b95d175fcf43073066ab88793a31974f585a36a728e4e3a57dd3: Status 404 returned error can't find the container with id a05b0da86312b95d175fcf43073066ab88793a31974f585a36a728e4e3a57dd3
Aug 04 10:36:53.402956 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.402929    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs\") pod \"network-metrics-daemon-45gv2\" (UID: \"3797c942-ece8-4151-bfb3-5c0ed4a61cd9\") " pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:36:53.403080 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.402989    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:53.403140 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:53.403088    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 10:36:53.403140 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:53.403094    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 10:36:53.403231 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:53.403142    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret podName:790dd286-529d-47d2-a860-6f692d635f80 nodeName:}" failed. No retries permitted until 2026-08-04 10:36:55.403125613 +0000 UTC m=+6.129195942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret") pod "global-pull-secret-syncer-mtxjn" (UID: "790dd286-529d-47d2-a860-6f692d635f80") : object "kube-system"/"original-pull-secret" not registered
Aug 04 10:36:53.403231 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:53.403158    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs podName:3797c942-ece8-4151-bfb3-5c0ed4a61cd9 nodeName:}" failed. No retries permitted until 2026-08-04 10:36:55.403150901 +0000 UTC m=+6.129221216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs") pod "network-metrics-daemon-45gv2" (UID: "3797c942-ece8-4151-bfb3-5c0ed4a61cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 10:36:53.503319 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.503288    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4stl\" (UniqueName: \"kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl\") pod \"network-check-target-vg4bn\" (UID: \"362a23fd-e433-4252-9828-05cf8ad8c756\") " pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:36:53.503463 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:53.503445    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 10:36:53.503530 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:53.503472    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 10:36:53.503530 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:53.503486    2559 projected.go:196] Error preparing data for projected volume kube-api-access-b4stl for pod openshift-network-diagnostics/network-check-target-vg4bn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 10:36:53.503633 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:53.503549    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl podName:362a23fd-e433-4252-9828-05cf8ad8c756 nodeName:}" failed. No retries permitted until 2026-08-04 10:36:55.503529765 +0000 UTC m=+6.229600080 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4stl" (UniqueName: "kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl") pod "network-check-target-vg4bn" (UID: "362a23fd-e433-4252-9828-05cf8ad8c756") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 10:36:53.777445 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.776832    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:36:53.777445 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:53.776955    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:36:53.778395 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.778239    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:53.778395 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:53.778345    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:36:53.797303 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.797270    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal" event={"ID":"9c6c3d58b6fed20e5c5b5b141f5402cf","Type":"ContainerStarted","Data":"23a4e198761bb5ce089a959cadcd07be194d1be729518fab1db06e41a786a046"}
Aug 04 10:36:53.799757 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.799728    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9xldn" event={"ID":"77cd6c46-e4ca-480b-aa39-004d2c4a760f","Type":"ContainerStarted","Data":"88797f80f5ad8b92db9c8bb26c7184806480d074b6851f6a2367b4451f1939c1"}
Aug 04 10:36:53.801274 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.801225    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rvnjq" event={"ID":"eb5ca508-8941-4f0a-b418-defcadef5c2e","Type":"ContainerStarted","Data":"e281236b7f71b4e81c92317b219d7a255fefa137e15b28fd43d737e3a9942b6e"}
Aug 04 10:36:53.803273 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.803247    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp" event={"ID":"ab573cce-21c5-4ed1-b424-eb762d565a94","Type":"ContainerStarted","Data":"402b68b4b5ed2bcf8694b1a8eb61fe1aeffdf32e45bf4f4ae2ad1bcd50917aca"}
Aug 04 10:36:53.806805 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.806774    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mg8tk" event={"ID":"ddccaa00-a3b0-4696-9f37-7e86195ddf41","Type":"ContainerStarted","Data":"a05b0da86312b95d175fcf43073066ab88793a31974f585a36a728e4e3a57dd3"}
Aug 04 10:36:53.807260 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.807191    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 10:31:52 +0000 UTC" deadline="2028-03-25 04:01:25.343049131 +0000 UTC"
Aug 04 10:36:53.807260 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.807240    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14369h24m31.535813253s"
Aug 04 10:36:53.811959 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.811929    2559 generic.go:356] "Generic (PLEG): container finished" podID="4c34789147362cd8ef060a7cb919d707" containerID="ea424d86524bccd45b2a72c1d430e66672b5d3b794c8c58134a794627dff35de" exitCode=0
Aug 04 10:36:53.812219 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.812190    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" event={"ID":"4c34789147362cd8ef060a7cb919d707","Type":"ContainerDied","Data":"ea424d86524bccd45b2a72c1d430e66672b5d3b794c8c58134a794627dff35de"}
Aug 04 10:36:53.816563 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.816530    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29" event={"ID":"c3993d68-2b6a-4352-b1b3-cdedaccff424","Type":"ContainerStarted","Data":"739ab3e966dcbd90e4907ee27837dc655e8a6f4a8ef73561b5d2f812a1977864"}
Aug 04 10:36:53.822928 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.822901    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nc4hz" event={"ID":"781d93fa-f41a-4510-836a-deadf3c3be42","Type":"ContainerStarted","Data":"66f59c278ba30a0b5f6271c9a3759606f64cf7ff08484d9624fbf4e671564085"}
Aug 04 10:36:53.830312 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.830286    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qcdc2" event={"ID":"c2ce67fc-2c75-4e55-bd6d-2ffe62272e70","Type":"ContainerStarted","Data":"185b2f3f6eb79f0d342502847f606aa5415b130e402b6de9ad3f8683993a1d6d"}
Aug 04 10:36:53.838610 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.838584    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqvvw" event={"ID":"b3df3887-c14e-494d-9eee-c0bf6d22f716","Type":"ContainerStarted","Data":"5010de113b1365992c8c19ceb4206f9aee27cca0d9de902a01bb14071aac144c"}
Aug 04 10:36:53.841659 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.841634    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vrzwr" event={"ID":"2f70cd04-2975-43ba-bd5e-d09eaaf13480","Type":"ContainerStarted","Data":"3972d008cad425a7e729e80d39c1fa58d436c04e798e5f293ebdd4d57ea7a355"}
Aug 04 10:36:53.864390 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:53.864332    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-162.ec2.internal" podStartSLOduration=1.864311722 podStartE2EDuration="1.864311722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:36:53.832735116 +0000 UTC m=+4.558805452" watchObservedRunningTime="2026-08-04 10:36:53.864311722 +0000 UTC m=+4.590382062"
Aug 04 10:36:54.775289 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:54.775249    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:36:54.775475 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:54.775411    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:36:54.855333 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:54.855294    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" event={"ID":"4c34789147362cd8ef060a7cb919d707","Type":"ContainerStarted","Data":"7bd223545e6e30e7470d75683356081de0ed16da88bb8dce350b72083835fea3"}
Aug 04 10:36:54.890243 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:54.890179    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-162.ec2.internal" podStartSLOduration=2.890152879 podStartE2EDuration="2.890152879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:36:54.889009114 +0000 UTC m=+5.615079504" watchObservedRunningTime="2026-08-04 10:36:54.890152879 +0000 UTC m=+5.616223216"
Aug 04 10:36:55.420535 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:55.420501    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:55.420535 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:55.420545    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs\") pod \"network-metrics-daemon-45gv2\" (UID: \"3797c942-ece8-4151-bfb3-5c0ed4a61cd9\") " pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:36:55.420818 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:55.420688    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 10:36:55.420818 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:55.420752    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs podName:3797c942-ece8-4151-bfb3-5c0ed4a61cd9 nodeName:}" failed. No retries permitted until 2026-08-04 10:36:59.420732259 +0000 UTC m=+10.146802572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs") pod "network-metrics-daemon-45gv2" (UID: "3797c942-ece8-4151-bfb3-5c0ed4a61cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 10:36:55.421329 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:55.421217    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 10:36:55.421329 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:55.421275    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret podName:790dd286-529d-47d2-a860-6f692d635f80 nodeName:}" failed. No retries permitted until 2026-08-04 10:36:59.421259882 +0000 UTC m=+10.147330217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret") pod "global-pull-secret-syncer-mtxjn" (UID: "790dd286-529d-47d2-a860-6f692d635f80") : object "kube-system"/"original-pull-secret" not registered
Aug 04 10:36:55.521999 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:55.521950    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4stl\" (UniqueName: \"kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl\") pod \"network-check-target-vg4bn\" (UID: \"362a23fd-e433-4252-9828-05cf8ad8c756\") " pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:36:55.522171 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:55.522142    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 10:36:55.522171 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:55.522166    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 10:36:55.522304 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:55.522180    2559 projected.go:196] Error preparing data for projected volume kube-api-access-b4stl for pod openshift-network-diagnostics/network-check-target-vg4bn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 10:36:55.522304 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:55.522239    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl podName:362a23fd-e433-4252-9828-05cf8ad8c756 nodeName:}" failed. No retries permitted until 2026-08-04 10:36:59.522220426 +0000 UTC m=+10.248290743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4stl" (UniqueName: "kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl") pod "network-check-target-vg4bn" (UID: "362a23fd-e433-4252-9828-05cf8ad8c756") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 10:36:55.776919 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:55.776827    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:36:55.777077 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:55.776963    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:36:55.779084 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:55.779061    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:55.779228 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:55.779163    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:36:56.775911 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:56.775680    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:36:56.775911 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:56.775854    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:36:57.777931 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:57.777870    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:36:57.778294 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:57.778005    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:36:57.778408 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:57.778376    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:57.778521 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:57.778471    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:36:58.776208 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:58.776171    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:36:58.776402 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:58.776318    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:36:59.455350 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:59.455312    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:59.455853 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:59.455382    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs\") pod \"network-metrics-daemon-45gv2\" (UID: \"3797c942-ece8-4151-bfb3-5c0ed4a61cd9\") " pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:36:59.455853 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:59.455537    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 10:36:59.455853 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:59.455595    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs podName:3797c942-ece8-4151-bfb3-5c0ed4a61cd9 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:07.455577657 +0000 UTC m=+18.181647977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs") pod "network-metrics-daemon-45gv2" (UID: "3797c942-ece8-4151-bfb3-5c0ed4a61cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 10:36:59.455853 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:59.455802    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 10:36:59.456085 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:59.455860    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret podName:790dd286-529d-47d2-a860-6f692d635f80 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:07.455843389 +0000 UTC m=+18.181913712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret") pod "global-pull-secret-syncer-mtxjn" (UID: "790dd286-529d-47d2-a860-6f692d635f80") : object "kube-system"/"original-pull-secret" not registered
Aug 04 10:36:59.556688 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:59.556623    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4stl\" (UniqueName: \"kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl\") pod \"network-check-target-vg4bn\" (UID: \"362a23fd-e433-4252-9828-05cf8ad8c756\") " pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:36:59.556955 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:59.556808    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 10:36:59.556955 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:59.556833    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 10:36:59.556955 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:59.556846    2559 projected.go:196] Error preparing data for projected volume kube-api-access-b4stl for pod openshift-network-diagnostics/network-check-target-vg4bn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 10:36:59.556955 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:59.556913    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl podName:362a23fd-e433-4252-9828-05cf8ad8c756 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:07.556892603 +0000 UTC m=+18.282962922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4stl" (UniqueName: "kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl") pod "network-check-target-vg4bn" (UID: "362a23fd-e433-4252-9828-05cf8ad8c756") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 10:36:59.776111 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:59.776034    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:36:59.776250 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:59.776150    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:36:59.776250 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:36:59.776215    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:36:59.776318 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:36:59.776287    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:37:00.775921 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:00.775884    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:00.776433 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:00.776037    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:37:01.775037 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:01.775000    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:01.775248 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:01.775141    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:37:01.775450 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:01.775430    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:01.775549 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:01.775531    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:37:02.776049 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:02.775986    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:02.776535 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:02.776122    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:37:03.775891 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:03.775862    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:03.776067 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:03.775992    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:37:03.776067 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:03.776043    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:03.776454 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:03.776145    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:37:04.775963 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:04.775922    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:04.776112 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:04.776072    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:37:05.775979 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:05.775949    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:05.776155 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:05.775951    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:05.776155 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:05.776080    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:37:05.776525 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:05.776149    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:37:06.775511 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:06.775472    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:06.775762 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:06.775606    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:37:07.519443 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:07.519403    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:07.519958 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:07.519464    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs\") pod \"network-metrics-daemon-45gv2\" (UID: \"3797c942-ece8-4151-bfb3-5c0ed4a61cd9\") " pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:07.519958 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:07.519547    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 10:37:07.519958 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:07.519582    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 10:37:07.519958 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:07.519618    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret podName:790dd286-529d-47d2-a860-6f692d635f80 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:23.519602118 +0000 UTC m=+34.245672434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret") pod "global-pull-secret-syncer-mtxjn" (UID: "790dd286-529d-47d2-a860-6f692d635f80") : object "kube-system"/"original-pull-secret" not registered
Aug 04 10:37:07.519958 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:07.519652    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs podName:3797c942-ece8-4151-bfb3-5c0ed4a61cd9 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:23.519627506 +0000 UTC m=+34.245697827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs") pod "network-metrics-daemon-45gv2" (UID: "3797c942-ece8-4151-bfb3-5c0ed4a61cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 10:37:07.620036 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:07.620005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4stl\" (UniqueName: \"kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl\") pod \"network-check-target-vg4bn\" (UID: \"362a23fd-e433-4252-9828-05cf8ad8c756\") " pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:07.620203 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:07.620163    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 10:37:07.620203 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:07.620180    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 10:37:07.620203 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:07.620190    2559 projected.go:196] Error preparing data for projected volume kube-api-access-b4stl for pod openshift-network-diagnostics/network-check-target-vg4bn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 10:37:07.620328 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:07.620243    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl podName:362a23fd-e433-4252-9828-05cf8ad8c756 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:23.62022567 +0000 UTC m=+34.346295999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4stl" (UniqueName: "kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl") pod "network-check-target-vg4bn" (UID: "362a23fd-e433-4252-9828-05cf8ad8c756") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 10:37:07.775069 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:07.774993    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:07.775215 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:07.775116    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:37:07.775215 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:07.775168    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:07.775330 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:07.775261    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:37:08.775593 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:08.775558    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:08.776052 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:08.775711    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:37:09.777801 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:09.777772    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:09.778250 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:09.777885    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:37:09.778250 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:09.777933    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:09.778250 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:09.778031    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:37:10.775298 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:10.775266    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:10.775466 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:10.775389    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:37:11.778982 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:11.778955    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:11.779347 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:11.779065    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:37:11.779347 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:11.779133    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:11.779347 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:11.779210    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:37:12.777616 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.775810    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:12.777616 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:12.776346    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:37:12.895076 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.895035    2559 generic.go:356] "Generic (PLEG): container finished" podID="b3df3887-c14e-494d-9eee-c0bf6d22f716" containerID="93a22b4e0ee2b6c8973ab60421b110edc78430223ad588b08bc3ce800856e381" exitCode=0
Aug 04 10:37:12.895908 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.895132    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqvvw" event={"ID":"b3df3887-c14e-494d-9eee-c0bf6d22f716","Type":"ContainerDied","Data":"93a22b4e0ee2b6c8973ab60421b110edc78430223ad588b08bc3ce800856e381"}
Aug 04 10:37:12.897872 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.897848    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vrzwr" event={"ID":"2f70cd04-2975-43ba-bd5e-d09eaaf13480","Type":"ContainerStarted","Data":"fe542f8ecf4ffb81a9f3fabb9cc772b0a41d85566b94861d3d380a6eaa101641"}
Aug 04 10:37:12.899629 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.899602    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9xldn" event={"ID":"77cd6c46-e4ca-480b-aa39-004d2c4a760f","Type":"ContainerStarted","Data":"bfe1752fc6caf42e9037e148fdb05f0d89d3e076fb67b706b1ab46860ee72adc"}
Aug 04 10:37:12.901596 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.901569    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rvnjq" event={"ID":"eb5ca508-8941-4f0a-b418-defcadef5c2e","Type":"ContainerStarted","Data":"ae39ac3508db29f05de4096ee563796745d196af164834ce8c9883318a7bc1ab"}
Aug 04 10:37:12.905156 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.905133    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp" event={"ID":"ab573cce-21c5-4ed1-b424-eb762d565a94","Type":"ContainerStarted","Data":"203d9b731b2f74dbfbc3e4c643c1995eb3917990407ca21385871094a90830e4"}
Aug 04 10:37:12.905255 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.905193    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp" event={"ID":"ab573cce-21c5-4ed1-b424-eb762d565a94","Type":"ContainerStarted","Data":"4d3bc67547ea1f201238059ea858c40f56d928f56ab9bb9befb43078eff45e9c"}
Aug 04 10:37:12.905255 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.905234    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp" event={"ID":"ab573cce-21c5-4ed1-b424-eb762d565a94","Type":"ContainerStarted","Data":"0849c538002ad5d1702bc636d8e5861f0470c6e70fa7a480641e9ecadbded745"}
Aug 04 10:37:12.905363 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.905276    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp" event={"ID":"ab573cce-21c5-4ed1-b424-eb762d565a94","Type":"ContainerStarted","Data":"b3843b05896f9b9bb197e73af95ad5abd05880fdf843fd0e6c1a3f1f53870f41"}
Aug 04 10:37:12.905363 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.905322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp" event={"ID":"ab573cce-21c5-4ed1-b424-eb762d565a94","Type":"ContainerStarted","Data":"75b24af38920a95224a6f90e9e06177a581be90c6234521e1888ecdaef8cf5a2"}
Aug 04 10:37:12.905363 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.905354    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp" event={"ID":"ab573cce-21c5-4ed1-b424-eb762d565a94","Type":"ContainerStarted","Data":"281441d8e40e9ed042c989c344b142ba6c40d7c88071abdb0c441fdd4a091700"}
Aug 04 10:37:12.906865 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.906839    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mg8tk" event={"ID":"ddccaa00-a3b0-4696-9f37-7e86195ddf41","Type":"ContainerStarted","Data":"2f072d74e3c26c533ce2c49bd6618480a41752d740a7c8142a14597b19aa34d7"}
Aug 04 10:37:12.908496 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.908462    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29" event={"ID":"c3993d68-2b6a-4352-b1b3-cdedaccff424","Type":"ContainerStarted","Data":"883a593de16a82af11c76ac18a222d6e0bc3c0283688499940d0d050c9e8b79b"}
Aug 04 10:37:12.910022 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.909992    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nc4hz" event={"ID":"781d93fa-f41a-4510-836a-deadf3c3be42","Type":"ContainerStarted","Data":"5f51f91e387e0d005130ef132c4519958131f6312b0f9825301c56dddcf3294b"}
Aug 04 10:37:12.934538 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.934488    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9xldn" podStartSLOduration=2.95465593 podStartE2EDuration="21.934472726s" totalImagesPullingTime="18.979816796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:12.934043735 +0000 UTC m=+23.660114086" watchObservedRunningTime="2026-08-04 10:37:12.934472726 +0000 UTC m=+23.660543060"
Aug 04 10:37:12.970994 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.970947    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mg8tk" podStartSLOduration=3.020590479 podStartE2EDuration="21.970934777s" totalImagesPullingTime="18.950344298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:12.949139538 +0000 UTC m=+23.675209871" watchObservedRunningTime="2026-08-04 10:37:12.970934777 +0000 UTC m=+23.697005123"
Aug 04 10:37:12.971253 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:12.971233    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vrzwr" podStartSLOduration=2.992749094 podStartE2EDuration="21.971229341s" totalImagesPullingTime="18.978480247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:12.968899799 +0000 UTC m=+23.694970133" watchObservedRunningTime="2026-08-04 10:37:12.971229341 +0000 UTC m=+23.697299674"
Aug 04 10:37:13.015442 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:13.015391    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nc4hz" podStartSLOduration=3.104278662 podStartE2EDuration="22.015373388s" totalImagesPullingTime="18.911094726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:13.01509997 +0000 UTC m=+23.741170313" watchObservedRunningTime="2026-08-04 10:37:13.015373388 +0000 UTC m=+23.741443726"
Aug 04 10:37:13.015741 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:13.015713    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rvnjq" podStartSLOduration=6.9153969669999995 podStartE2EDuration="22.015704078s" totalImagesPullingTime="15.100307111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:12.992928869 +0000 UTC m=+23.718999203" watchObservedRunningTime="2026-08-04 10:37:13.015704078 +0000 UTC m=+23.741774412"
Aug 04 10:37:13.564668 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:13.564630    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 10:37:13.764729 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:13.764563    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T10:37:13.564663055Z","UUID":"654b8b63-7812-48a3-ab1e-ac8342b9fd6c","Handler":null,"Name":"","Endpoint":""}
Aug 04 10:37:13.766198 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:13.766176    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 10:37:13.766317 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:13.766235    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 10:37:13.778472 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:13.778452    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:13.778621 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:13.778454    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:13.778621 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:13.778555    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:37:13.778759 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:13.778664    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:37:13.913747 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:13.913714    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29" event={"ID":"c3993d68-2b6a-4352-b1b3-cdedaccff424","Type":"ContainerStarted","Data":"230333871c64d8264a6cb61a89ddab4ca8654787283769a0f72a34b3f8f4c96e"}
Aug 04 10:37:13.915356 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:13.915330    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qcdc2" event={"ID":"c2ce67fc-2c75-4e55-bd6d-2ffe62272e70","Type":"ContainerStarted","Data":"ae6cc40a644aadfee75d7341a1141944f98a6e6a8623b2c723f32b537cbea8fb"}
Aug 04 10:37:13.941013 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:13.940962    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qcdc2" podStartSLOduration=4.024917443 podStartE2EDuration="22.940943006s" totalImagesPullingTime="18.916025563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:13.940434449 +0000 UTC m=+24.666504796" watchObservedRunningTime="2026-08-04 10:37:13.940943006 +0000 UTC m=+24.667013341"
Aug 04 10:37:14.775706 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:14.775674    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:14.775977 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:14.775785    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:37:15.778002 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:15.777839    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:15.778369 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:15.777839    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:15.778369 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:15.778108    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:37:15.778369 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:15.778163    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:37:15.920674 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:15.920626    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29" event={"ID":"c3993d68-2b6a-4352-b1b3-cdedaccff424","Type":"ContainerStarted","Data":"32473e129f03df95caecf0ed7edddef3baf079385925f1a3d6d9feef25305b8a"}
Aug 04 10:37:15.923558 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:15.923538    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp" event={"ID":"ab573cce-21c5-4ed1-b424-eb762d565a94","Type":"ContainerStarted","Data":"9c10c39e75c0f33a4fc17179b22f86e7c1d4669f03f26a408c68a3e99158c087"}
Aug 04 10:37:15.944867 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:15.944826    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rzj29" podStartSLOduration=3.277893826 podStartE2EDuration="24.944809057s" totalImagesPullingTime="21.666915231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:36:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:15.944537607 +0000 UTC m=+26.670607942" watchObservedRunningTime="2026-08-04 10:37:15.944809057 +0000 UTC m=+26.670879392"
Aug 04 10:37:16.775413 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:16.775378    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:16.775602 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:16.775497    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:37:16.979632 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:16.979600    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rvnjq"
Aug 04 10:37:16.980202 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:16.980186    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rvnjq"
Aug 04 10:37:17.779500 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:17.779475    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:17.779684 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:17.779572    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:37:17.779684 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:17.779627    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:17.779772 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:17.779734    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:37:17.928160 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:17.928132    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rvnjq"
Aug 04 10:37:17.928564 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:17.928550    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rvnjq"
Aug 04 10:37:18.775379 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:18.775206    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:18.776008 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:18.775446    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:37:18.931910 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:18.931880    2559 generic.go:356] "Generic (PLEG): container finished" podID="b3df3887-c14e-494d-9eee-c0bf6d22f716" containerID="6d1888f1ae1accef436f15df2b399d6b32e25c8b56c5027f13913280467fe8ff" exitCode=0
Aug 04 10:37:18.932062 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:18.931972    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqvvw" event={"ID":"b3df3887-c14e-494d-9eee-c0bf6d22f716","Type":"ContainerDied","Data":"6d1888f1ae1accef436f15df2b399d6b32e25c8b56c5027f13913280467fe8ff"}
Aug 04 10:37:18.935588 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:18.935566    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp" event={"ID":"ab573cce-21c5-4ed1-b424-eb762d565a94","Type":"ContainerStarted","Data":"c376876340fb433dc912cf4c9cbbe3664075065c5027c725286183095a138af1"}
Aug 04 10:37:18.987317 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:18.987283    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp" podStartSLOduration=9.007749935 podStartE2EDuration="27.987270164s" totalImagesPullingTime="18.979520229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:18.986920366 +0000 UTC m=+29.712990700" watchObservedRunningTime="2026-08-04 10:37:18.987270164 +0000 UTC m=+29.713340497"
Aug 04 10:37:19.776561 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:19.776533    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:19.776995 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:19.776629    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:37:19.776995 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:19.776666    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:19.776995 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:19.776764    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:37:19.939005 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:19.938970    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:37:19.939155 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:19.939043    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:37:19.939155 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:19.939085    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:37:19.953472 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:19.953447    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:37:19.953872 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:19.953856    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:37:20.271455 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:20.271422    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtxjn"]
Aug 04 10:37:20.271631 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:20.271557    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:20.271721 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:20.271666    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:37:20.276959 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:20.276926    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-45gv2"]
Aug 04 10:37:20.277071 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:20.277026    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:20.277144 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:20.277124    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:37:20.283471 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:20.283448    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vg4bn"]
Aug 04 10:37:20.283566 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:20.283532    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:20.283624 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:20.283602    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:37:21.775183 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:21.775159    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:21.775482 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:21.775158    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:21.775482 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:21.775274    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:37:21.775482 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:21.775159    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:21.775482 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:21.775334    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:37:21.775482 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:21.775455    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:37:22.946285 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:22.946036    2559 generic.go:356] "Generic (PLEG): container finished" podID="b3df3887-c14e-494d-9eee-c0bf6d22f716" containerID="bef6c4b5f4ec40134427c61d92ad1415a37af06f926ab1f76ae7131cb9364f28" exitCode=0
Aug 04 10:37:22.946657 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:22.946121    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqvvw" event={"ID":"b3df3887-c14e-494d-9eee-c0bf6d22f716","Type":"ContainerDied","Data":"bef6c4b5f4ec40134427c61d92ad1415a37af06f926ab1f76ae7131cb9364f28"}
Aug 04 10:37:23.549100 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:23.549038    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:23.549100 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:23.549097    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs\") pod \"network-metrics-daemon-45gv2\" (UID: \"3797c942-ece8-4151-bfb3-5c0ed4a61cd9\") " pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:23.549313 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:23.549205    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 10:37:23.549313 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:23.549212    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 10:37:23.549313 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:23.549265    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs podName:3797c942-ece8-4151-bfb3-5c0ed4a61cd9 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:55.549250539 +0000 UTC m=+66.275320851 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs") pod "network-metrics-daemon-45gv2" (UID: "3797c942-ece8-4151-bfb3-5c0ed4a61cd9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 10:37:23.549313 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:23.549282    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret podName:790dd286-529d-47d2-a860-6f692d635f80 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:55.549273073 +0000 UTC m=+66.275343385 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret") pod "global-pull-secret-syncer-mtxjn" (UID: "790dd286-529d-47d2-a860-6f692d635f80") : object "kube-system"/"original-pull-secret" not registered
Aug 04 10:37:23.649574 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:23.649544    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4stl\" (UniqueName: \"kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl\") pod \"network-check-target-vg4bn\" (UID: \"362a23fd-e433-4252-9828-05cf8ad8c756\") " pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:23.649736 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:23.649677    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 10:37:23.649736 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:23.649697    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 10:37:23.649736 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:23.649706    2559 projected.go:196] Error preparing data for projected volume kube-api-access-b4stl for pod openshift-network-diagnostics/network-check-target-vg4bn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 10:37:23.649849 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:23.649756    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl podName:362a23fd-e433-4252-9828-05cf8ad8c756 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:55.649740186 +0000 UTC m=+66.375810498 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4stl" (UniqueName: "kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl") pod "network-check-target-vg4bn" (UID: "362a23fd-e433-4252-9828-05cf8ad8c756") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 10:37:23.775461 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:23.775445    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:23.775564 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:23.775444    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:23.775605 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:23.775566    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:37:23.775721 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:23.775702    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:23.775828 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:23.775696    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vg4bn" podUID="362a23fd-e433-4252-9828-05cf8ad8c756"
Aug 04 10:37:23.775879 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:23.775818    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtxjn" podUID="790dd286-529d-47d2-a860-6f692d635f80"
Aug 04 10:37:23.950784 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:23.950721    2559 generic.go:356] "Generic (PLEG): container finished" podID="b3df3887-c14e-494d-9eee-c0bf6d22f716" containerID="8348bb39a02fc1a06cd8dcf97a89f82c2845a22c1f4b9081b2a8b16eb96bacf4" exitCode=0
Aug 04 10:37:23.950784 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:23.950765    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqvvw" event={"ID":"b3df3887-c14e-494d-9eee-c0bf6d22f716","Type":"ContainerDied","Data":"8348bb39a02fc1a06cd8dcf97a89f82c2845a22c1f4b9081b2a8b16eb96bacf4"}
Aug 04 10:37:24.625145 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.625121    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-162.ec2.internal" event="NodeReady"
Aug 04 10:37:24.625245 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.625229    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 10:37:24.667340 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.667243    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-96759bd45-7gqgd"]
Aug 04 10:37:24.669459 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.669444    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.673435 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.673410    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b96cb89f4-mp2hm"]
Aug 04 10:37:24.673958 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.673729    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 04 10:37:24.673958 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.673743    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 04 10:37:24.673958 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.673772    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xjf6f\""
Aug 04 10:37:24.673958 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.673793    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 04 10:37:24.676587 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.676569    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"]
Aug 04 10:37:24.677303 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.676718    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b96cb89f4-mp2hm"
Aug 04 10:37:24.679359 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.679342    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Aug 04 10:37:24.679359 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.679357    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"]
Aug 04 10:37:24.679514 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.679477    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"
Aug 04 10:37:24.681722 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.681394    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Aug 04 10:37:24.682146 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.682119    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Aug 04 10:37:24.682318 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.682302    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Aug 04 10:37:24.682421 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.682403    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Aug 04 10:37:24.683665 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.683435    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cv7q7\""
Aug 04 10:37:24.684785 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.684765    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.684884 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.684851    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 04 10:37:24.687418 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.687402    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Aug 04 10:37:24.688195 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.688179    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Aug 04 10:37:24.688840 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.688694    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Aug 04 10:37:24.689043 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.689025    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Aug 04 10:37:24.689101 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.689065    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2c279"]
Aug 04 10:37:24.691562 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.691547    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qf66x"]
Aug 04 10:37:24.691665 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.691652    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:24.693903 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.693886    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f4ggs\""
Aug 04 10:37:24.693967 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.693957    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qf66x"
Aug 04 10:37:24.694032 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.694018    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 10:37:24.694084 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.694026    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 10:37:24.698072 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.698043    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 10:37:24.698162 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.698049    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 10:37:24.698266 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.698251    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 10:37:24.698788 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.698771    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b96cb89f4-mp2hm"]
Aug 04 10:37:24.699552 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.699534    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-96759bd45-7gqgd"]
Aug 04 10:37:24.699715 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.699702    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l5h9c\""
Aug 04 10:37:24.704828 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.704809    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"]
Aug 04 10:37:24.709981 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.709962    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2c279"]
Aug 04 10:37:24.718325 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.718304    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"]
Aug 04 10:37:24.721166 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.721144    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qf66x"]
Aug 04 10:37:24.757986 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.757961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7224dab-0bfa-4972-aeac-9d4fa258488f-trusted-ca\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.757986 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.757986    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aea227ab-cc13-4599-a9d7-1e7538611293-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b96cb89f4-mp2hm\" (UID: \"aea227ab-cc13-4599-a9d7-1e7538611293\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b96cb89f4-mp2hm"
Aug 04 10:37:24.758112 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758010    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/797dcad8-70f8-41af-a502-fdb6de3b00c5-ca\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.758112 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758043    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7224dab-0bfa-4972-aeac-9d4fa258488f-image-registry-private-configuration\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.758188 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758113    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7224dab-0bfa-4972-aeac-9d4fa258488f-ca-trust-extracted\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.758188 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/797dcad8-70f8-41af-a502-fdb6de3b00c5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.758188 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758156    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/797dcad8-70f8-41af-a502-fdb6de3b00c5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.758280 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758202    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7224dab-0bfa-4972-aeac-9d4fa258488f-installation-pull-secrets\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.758280 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758217    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/797dcad8-70f8-41af-a502-fdb6de3b00c5-hub\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.758280 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjqgk\" (UniqueName: \"kubernetes.io/projected/1d62c507-141e-4847-8ebe-85f1f4fff40a-kube-api-access-mjqgk\") pod \"klusterlet-addon-workmgr-58ddd69f6b-kzzf7\" (UID: \"1d62c507-141e-4847-8ebe-85f1f4fff40a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"
Aug 04 10:37:24.758280 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758262    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.758461 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758326    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqcq5\" (UniqueName: \"kubernetes.io/projected/797dcad8-70f8-41af-a502-fdb6de3b00c5-kube-api-access-rqcq5\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.758461 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-certificates\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.758461 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758414    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8lj6\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-kube-api-access-f8lj6\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.758461 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758438    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rccg\" (UniqueName: \"kubernetes.io/projected/aea227ab-cc13-4599-a9d7-1e7538611293-kube-api-access-4rccg\") pod \"managed-serviceaccount-addon-agent-b96cb89f4-mp2hm\" (UID: \"aea227ab-cc13-4599-a9d7-1e7538611293\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b96cb89f4-mp2hm"
Aug 04 10:37:24.758633 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758468    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1d62c507-141e-4847-8ebe-85f1f4fff40a-klusterlet-config\") pod \"klusterlet-addon-workmgr-58ddd69f6b-kzzf7\" (UID: \"1d62c507-141e-4847-8ebe-85f1f4fff40a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"
Aug 04 10:37:24.758633 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758499    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/797dcad8-70f8-41af-a502-fdb6de3b00c5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.758633 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758530    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-bound-sa-token\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.758633 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.758552    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d62c507-141e-4847-8ebe-85f1f4fff40a-tmp\") pod \"klusterlet-addon-workmgr-58ddd69f6b-kzzf7\" (UID: \"1d62c507-141e-4847-8ebe-85f1f4fff40a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"
Aug 04 10:37:24.859492 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.859474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7224dab-0bfa-4972-aeac-9d4fa258488f-installation-pull-secrets\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.859662 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.859498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/797dcad8-70f8-41af-a502-fdb6de3b00c5-hub\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.859662 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.859520    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dznrl\" (UniqueName: \"kubernetes.io/projected/66434394-a392-41f9-b8ff-1d93cd551961-kube-api-access-dznrl\") pod \"ingress-canary-qf66x\" (UID: \"66434394-a392-41f9-b8ff-1d93cd551961\") " pod="openshift-ingress-canary/ingress-canary-qf66x"
Aug 04 10:37:24.859662 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.859542    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7c57\" (UniqueName: \"kubernetes.io/projected/568a8a46-1a19-47c9-8070-c5de70047dad-kube-api-access-c7c57\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:24.859662 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.859572    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjqgk\" (UniqueName: \"kubernetes.io/projected/1d62c507-141e-4847-8ebe-85f1f4fff40a-kube-api-access-mjqgk\") pod \"klusterlet-addon-workmgr-58ddd69f6b-kzzf7\" (UID: \"1d62c507-141e-4847-8ebe-85f1f4fff40a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"
Aug 04 10:37:24.859662 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.859628    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.859893 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.859680    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66434394-a392-41f9-b8ff-1d93cd551961-cert\") pod \"ingress-canary-qf66x\" (UID: \"66434394-a392-41f9-b8ff-1d93cd551961\") " pod="openshift-ingress-canary/ingress-canary-qf66x"
Aug 04 10:37:24.859893 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.859727    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqcq5\" (UniqueName: \"kubernetes.io/projected/797dcad8-70f8-41af-a502-fdb6de3b00c5-kube-api-access-rqcq5\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.859893 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:24.859776    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 10:37:24.859893 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:24.859790    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96759bd45-7gqgd: secret "image-registry-tls" not found
Aug 04 10:37:24.859893 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.859836    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-certificates\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.859893 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:24.859852    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls podName:e7224dab-0bfa-4972-aeac-9d4fa258488f nodeName:}" failed. No retries permitted until 2026-08-04 10:37:25.359829431 +0000 UTC m=+36.085899773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls") pod "image-registry-96759bd45-7gqgd" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f") : secret "image-registry-tls" not found
Aug 04 10:37:24.859893 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.859887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8lj6\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-kube-api-access-f8lj6\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.860168 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.859913    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rccg\" (UniqueName: \"kubernetes.io/projected/aea227ab-cc13-4599-a9d7-1e7538611293-kube-api-access-4rccg\") pod \"managed-serviceaccount-addon-agent-b96cb89f4-mp2hm\" (UID: \"aea227ab-cc13-4599-a9d7-1e7538611293\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b96cb89f4-mp2hm"
Aug 04 10:37:24.860168 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.859937    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1d62c507-141e-4847-8ebe-85f1f4fff40a-klusterlet-config\") pod \"klusterlet-addon-workmgr-58ddd69f6b-kzzf7\" (UID: \"1d62c507-141e-4847-8ebe-85f1f4fff40a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"
Aug 04 10:37:24.860168 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.859958    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/797dcad8-70f8-41af-a502-fdb6de3b00c5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.860168 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.859988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-bound-sa-token\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.860168 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.860008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d62c507-141e-4847-8ebe-85f1f4fff40a-tmp\") pod \"klusterlet-addon-workmgr-58ddd69f6b-kzzf7\" (UID: \"1d62c507-141e-4847-8ebe-85f1f4fff40a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"
Aug 04 10:37:24.860168 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.860030    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:24.860168 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.860064    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7224dab-0bfa-4972-aeac-9d4fa258488f-trusted-ca\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.860168 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.860105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aea227ab-cc13-4599-a9d7-1e7538611293-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b96cb89f4-mp2hm\" (UID: \"aea227ab-cc13-4599-a9d7-1e7538611293\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b96cb89f4-mp2hm"
Aug 04 10:37:24.860168 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.860129    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/797dcad8-70f8-41af-a502-fdb6de3b00c5-ca\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.860168 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.860149    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/568a8a46-1a19-47c9-8070-c5de70047dad-config-volume\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:24.860168 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.860170    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/568a8a46-1a19-47c9-8070-c5de70047dad-tmp-dir\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:24.860593 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.860212    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7224dab-0bfa-4972-aeac-9d4fa258488f-image-registry-private-configuration\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.860593 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.860253    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7224dab-0bfa-4972-aeac-9d4fa258488f-ca-trust-extracted\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.860593 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.860275    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/797dcad8-70f8-41af-a502-fdb6de3b00c5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.860593 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.860307    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/797dcad8-70f8-41af-a502-fdb6de3b00c5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.860593 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.860413    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-certificates\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.860827 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.860609    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d62c507-141e-4847-8ebe-85f1f4fff40a-tmp\") pod \"klusterlet-addon-workmgr-58ddd69f6b-kzzf7\" (UID: \"1d62c507-141e-4847-8ebe-85f1f4fff40a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"
Aug 04 10:37:24.861600 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.861550    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7224dab-0bfa-4972-aeac-9d4fa258488f-trusted-ca\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.861600 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.861550    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7224dab-0bfa-4972-aeac-9d4fa258488f-ca-trust-extracted\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.862944 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.862499    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/797dcad8-70f8-41af-a502-fdb6de3b00c5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.865056 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.865035    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/797dcad8-70f8-41af-a502-fdb6de3b00c5-ca\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.865056 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.865049    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/797dcad8-70f8-41af-a502-fdb6de3b00c5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.865236 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.865074    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1d62c507-141e-4847-8ebe-85f1f4fff40a-klusterlet-config\") pod \"klusterlet-addon-workmgr-58ddd69f6b-kzzf7\" (UID: \"1d62c507-141e-4847-8ebe-85f1f4fff40a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"
Aug 04 10:37:24.865236 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.865078    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/797dcad8-70f8-41af-a502-fdb6de3b00c5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.865236 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.865156    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aea227ab-cc13-4599-a9d7-1e7538611293-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b96cb89f4-mp2hm\" (UID: \"aea227ab-cc13-4599-a9d7-1e7538611293\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b96cb89f4-mp2hm"
Aug 04 10:37:24.865379 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.865324    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7224dab-0bfa-4972-aeac-9d4fa258488f-image-registry-private-configuration\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.865379 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.865359    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7224dab-0bfa-4972-aeac-9d4fa258488f-installation-pull-secrets\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.865483 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.865467    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/797dcad8-70f8-41af-a502-fdb6de3b00c5-hub\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.870134 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.870112    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqcq5\" (UniqueName: \"kubernetes.io/projected/797dcad8-70f8-41af-a502-fdb6de3b00c5-kube-api-access-rqcq5\") pod \"cluster-proxy-proxy-agent-75646df4bd-dg67x\" (UID: \"797dcad8-70f8-41af-a502-fdb6de3b00c5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:24.870215 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.870198    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjqgk\" (UniqueName: \"kubernetes.io/projected/1d62c507-141e-4847-8ebe-85f1f4fff40a-kube-api-access-mjqgk\") pod \"klusterlet-addon-workmgr-58ddd69f6b-kzzf7\" (UID: \"1d62c507-141e-4847-8ebe-85f1f4fff40a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"
Aug 04 10:37:24.871137 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.871113    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-bound-sa-token\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.871217 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.871115    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8lj6\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-kube-api-access-f8lj6\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:24.871570 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.871553    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rccg\" (UniqueName: \"kubernetes.io/projected/aea227ab-cc13-4599-a9d7-1e7538611293-kube-api-access-4rccg\") pod \"managed-serviceaccount-addon-agent-b96cb89f4-mp2hm\" (UID: \"aea227ab-cc13-4599-a9d7-1e7538611293\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b96cb89f4-mp2hm"
Aug 04 10:37:24.962474 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.961452    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/568a8a46-1a19-47c9-8070-c5de70047dad-config-volume\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:24.962474 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.961490    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/568a8a46-1a19-47c9-8070-c5de70047dad-tmp-dir\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:24.962474 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.961559    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dznrl\" (UniqueName: \"kubernetes.io/projected/66434394-a392-41f9-b8ff-1d93cd551961-kube-api-access-dznrl\") pod \"ingress-canary-qf66x\" (UID: \"66434394-a392-41f9-b8ff-1d93cd551961\") " pod="openshift-ingress-canary/ingress-canary-qf66x"
Aug 04 10:37:24.962474 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.961590    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7c57\" (UniqueName: \"kubernetes.io/projected/568a8a46-1a19-47c9-8070-c5de70047dad-kube-api-access-c7c57\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:24.962474 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.961659    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66434394-a392-41f9-b8ff-1d93cd551961-cert\") pod \"ingress-canary-qf66x\" (UID: \"66434394-a392-41f9-b8ff-1d93cd551961\") " pod="openshift-ingress-canary/ingress-canary-qf66x"
Aug 04 10:37:24.962474 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.961733    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:24.962474 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:24.961880    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 10:37:24.962474 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:24.961953    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls podName:568a8a46-1a19-47c9-8070-c5de70047dad nodeName:}" failed. No retries permitted until 2026-08-04 10:37:25.461934319 +0000 UTC m=+36.188004638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls") pod "dns-default-2c279" (UID: "568a8a46-1a19-47c9-8070-c5de70047dad") : secret "dns-default-metrics-tls" not found
Aug 04 10:37:24.962474 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.962477    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/568a8a46-1a19-47c9-8070-c5de70047dad-config-volume\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:24.963350 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.962737    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/568a8a46-1a19-47c9-8070-c5de70047dad-tmp-dir\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:24.965499 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.965479    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66434394-a392-41f9-b8ff-1d93cd551961-cert\") pod \"ingress-canary-qf66x\" (UID: \"66434394-a392-41f9-b8ff-1d93cd551961\") " pod="openshift-ingress-canary/ingress-canary-qf66x"
Aug 04 10:37:24.971552 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.971528    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dznrl\" (UniqueName: \"kubernetes.io/projected/66434394-a392-41f9-b8ff-1d93cd551961-kube-api-access-dznrl\") pod \"ingress-canary-qf66x\" (UID: \"66434394-a392-41f9-b8ff-1d93cd551961\") " pod="openshift-ingress-canary/ingress-canary-qf66x"
Aug 04 10:37:24.975660 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:24.975624    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7c57\" (UniqueName: \"kubernetes.io/projected/568a8a46-1a19-47c9-8070-c5de70047dad-kube-api-access-c7c57\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:25.000857 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.000833    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b96cb89f4-mp2hm"
Aug 04 10:37:25.009051 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.009032    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"
Aug 04 10:37:25.014764 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.014749    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:37:25.032902 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.032875    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qf66x"
Aug 04 10:37:25.176451 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.176273    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"]
Aug 04 10:37:25.181808 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:37:25.181740    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod797dcad8_70f8_41af_a502_fdb6de3b00c5.slice/crio-dc6b53cdfdb996f776f375e8ae519dbddd260d8ac8ae19f60201684c4226845d WatchSource:0}: Error finding container dc6b53cdfdb996f776f375e8ae519dbddd260d8ac8ae19f60201684c4226845d: Status 404 returned error can't find the container with id dc6b53cdfdb996f776f375e8ae519dbddd260d8ac8ae19f60201684c4226845d
Aug 04 10:37:25.182987 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.182931    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b96cb89f4-mp2hm"]
Aug 04 10:37:25.183721 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.183702    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"]
Aug 04 10:37:25.185149 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:37:25.185132    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d62c507_141e_4847_8ebe_85f1f4fff40a.slice/crio-e43fc248876613a814c413a283ec908dd4d0d460050891427537486ba4aadadc WatchSource:0}: Error finding container e43fc248876613a814c413a283ec908dd4d0d460050891427537486ba4aadadc: Status 404 returned error can't find the container with id e43fc248876613a814c413a283ec908dd4d0d460050891427537486ba4aadadc
Aug 04 10:37:25.185775 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:37:25.185755    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaea227ab_cc13_4599_a9d7_1e7538611293.slice/crio-abc875c0c0adf4f68cd025c007ba634ca4fd57e7eb93d7ce0bed73b6add36219 WatchSource:0}: Error finding container abc875c0c0adf4f68cd025c007ba634ca4fd57e7eb93d7ce0bed73b6add36219: Status 404 returned error can't find the container with id abc875c0c0adf4f68cd025c007ba634ca4fd57e7eb93d7ce0bed73b6add36219
Aug 04 10:37:25.189880 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.189850    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qf66x"]
Aug 04 10:37:25.192500 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:37:25.192474    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66434394_a392_41f9_b8ff_1d93cd551961.slice/crio-ae465581740236a23665596853c81d8dca3e2a232e715393c3941de0f7a6d575 WatchSource:0}: Error finding container ae465581740236a23665596853c81d8dca3e2a232e715393c3941de0f7a6d575: Status 404 returned error can't find the container with id ae465581740236a23665596853c81d8dca3e2a232e715393c3941de0f7a6d575
Aug 04 10:37:25.365147 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.365118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:25.365248 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:25.365224    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 10:37:25.365248 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:25.365235    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96759bd45-7gqgd: secret "image-registry-tls" not found
Aug 04 10:37:25.365314 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:25.365281    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls podName:e7224dab-0bfa-4972-aeac-9d4fa258488f nodeName:}" failed. No retries permitted until 2026-08-04 10:37:26.365266036 +0000 UTC m=+37.091336351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls") pod "image-registry-96759bd45-7gqgd" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f") : secret "image-registry-tls" not found
Aug 04 10:37:25.465427 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.465343    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:25.465529 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:25.465503    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 10:37:25.465592 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:25.465568    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls podName:568a8a46-1a19-47c9-8070-c5de70047dad nodeName:}" failed. No retries permitted until 2026-08-04 10:37:26.465548282 +0000 UTC m=+37.191618613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls") pod "dns-default-2c279" (UID: "568a8a46-1a19-47c9-8070-c5de70047dad") : secret "dns-default-metrics-tls" not found
Aug 04 10:37:25.778610 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.778539    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:25.778765 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.778668    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:25.778765 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.778756    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:25.781804 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.781763    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 10:37:25.781919 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.781807    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 10:37:25.781919 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.781865    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 10:37:25.782115 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.782100    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qf5ds\""
Aug 04 10:37:25.782391 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.782378    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7blv\""
Aug 04 10:37:25.782453 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.782382    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 10:37:25.957102 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.957053    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qf66x" event={"ID":"66434394-a392-41f9-b8ff-1d93cd551961","Type":"ContainerStarted","Data":"ae465581740236a23665596853c81d8dca3e2a232e715393c3941de0f7a6d575"}
Aug 04 10:37:25.959228 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.959199    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b96cb89f4-mp2hm" event={"ID":"aea227ab-cc13-4599-a9d7-1e7538611293","Type":"ContainerStarted","Data":"abc875c0c0adf4f68cd025c007ba634ca4fd57e7eb93d7ce0bed73b6add36219"}
Aug 04 10:37:25.961458 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.961435    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7" event={"ID":"1d62c507-141e-4847-8ebe-85f1f4fff40a","Type":"ContainerStarted","Data":"e43fc248876613a814c413a283ec908dd4d0d460050891427537486ba4aadadc"}
Aug 04 10:37:25.963685 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:25.963659    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x" event={"ID":"797dcad8-70f8-41af-a502-fdb6de3b00c5","Type":"ContainerStarted","Data":"dc6b53cdfdb996f776f375e8ae519dbddd260d8ac8ae19f60201684c4226845d"}
Aug 04 10:37:26.371834 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:26.371797    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:26.372022 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:26.371950    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 10:37:26.372022 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:26.371965    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96759bd45-7gqgd: secret "image-registry-tls" not found
Aug 04 10:37:26.372122 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:26.372043    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls podName:e7224dab-0bfa-4972-aeac-9d4fa258488f nodeName:}" failed. No retries permitted until 2026-08-04 10:37:28.37202413 +0000 UTC m=+39.098094462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls") pod "image-registry-96759bd45-7gqgd" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f") : secret "image-registry-tls" not found
Aug 04 10:37:26.472662 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:26.472614    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:26.472870 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:26.472848    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 10:37:26.472945 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:26.472922    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls podName:568a8a46-1a19-47c9-8070-c5de70047dad nodeName:}" failed. No retries permitted until 2026-08-04 10:37:28.472901444 +0000 UTC m=+39.198971770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls") pod "dns-default-2c279" (UID: "568a8a46-1a19-47c9-8070-c5de70047dad") : secret "dns-default-metrics-tls" not found
Aug 04 10:37:28.390221 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:28.390179    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:28.390617 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:28.390430    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 10:37:28.390617 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:28.390448    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96759bd45-7gqgd: secret "image-registry-tls" not found
Aug 04 10:37:28.390617 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:28.390539    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls podName:e7224dab-0bfa-4972-aeac-9d4fa258488f nodeName:}" failed. No retries permitted until 2026-08-04 10:37:32.390514022 +0000 UTC m=+43.116584354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls") pod "image-registry-96759bd45-7gqgd" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f") : secret "image-registry-tls" not found
Aug 04 10:37:28.490683 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:28.490622    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:28.490866 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:28.490815    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 10:37:28.490944 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:28.490882    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls podName:568a8a46-1a19-47c9-8070-c5de70047dad nodeName:}" failed. No retries permitted until 2026-08-04 10:37:32.490867546 +0000 UTC m=+43.216937872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls") pod "dns-default-2c279" (UID: "568a8a46-1a19-47c9-8070-c5de70047dad") : secret "dns-default-metrics-tls" not found
Aug 04 10:37:32.424279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:32.424245    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:32.424737 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:32.424371    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 10:37:32.424737 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:32.424390    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96759bd45-7gqgd: secret "image-registry-tls" not found
Aug 04 10:37:32.424737 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:32.424459    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls podName:e7224dab-0bfa-4972-aeac-9d4fa258488f nodeName:}" failed. No retries permitted until 2026-08-04 10:37:40.424438886 +0000 UTC m=+51.150509216 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls") pod "image-registry-96759bd45-7gqgd" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f") : secret "image-registry-tls" not found
Aug 04 10:37:32.524799 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:32.524760    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:32.524958 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:32.524913    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 10:37:32.525011 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:32.524973    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls podName:568a8a46-1a19-47c9-8070-c5de70047dad nodeName:}" failed. No retries permitted until 2026-08-04 10:37:40.524957161 +0000 UTC m=+51.251027477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls") pod "dns-default-2c279" (UID: "568a8a46-1a19-47c9-8070-c5de70047dad") : secret "dns-default-metrics-tls" not found
Aug 04 10:37:35.992705 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:35.992673    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7" event={"ID":"1d62c507-141e-4847-8ebe-85f1f4fff40a","Type":"ContainerStarted","Data":"57d122ce7147475c0648a2bb828b1dc7c1150ec0c50ec86bc77d610036db17ff"}
Aug 04 10:37:35.993095 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:35.992851    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"
Aug 04 10:37:35.994476 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:35.994455    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7"
Aug 04 10:37:35.994966 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:35.994937    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x" event={"ID":"797dcad8-70f8-41af-a502-fdb6de3b00c5","Type":"ContainerStarted","Data":"68c80b37dd63298d0f3f070780ebaa99c90a9858ef109c357d2a76d34b3e6c87"}
Aug 04 10:37:35.995056 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:35.994977    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x" event={"ID":"797dcad8-70f8-41af-a502-fdb6de3b00c5","Type":"ContainerStarted","Data":"f7681e9086965d8b8c9e630cf3bbddff6000d141785470395cb8fe1d492bc299"}
Aug 04 10:37:35.996441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:35.996414    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qf66x" event={"ID":"66434394-a392-41f9-b8ff-1d93cd551961","Type":"ContainerStarted","Data":"f99ac24f09e21b345338895ba047ca99020b61004f964028056d1637375b806b"}
Aug 04 10:37:35.999115 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:35.999092    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqvvw" event={"ID":"b3df3887-c14e-494d-9eee-c0bf6d22f716","Type":"ContainerStarted","Data":"5b2b6f1db2008fac2390b491aac656e92f816a9dc0d3f9ee42dad183c5e7f700"}
Aug 04 10:37:36.000404 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:36.000381    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b96cb89f4-mp2hm" event={"ID":"aea227ab-cc13-4599-a9d7-1e7538611293","Type":"ContainerStarted","Data":"99a8da25c5dde61932599b710c99f0f96dbd600e8b1a036ae035bbfa23431e21"}
Aug 04 10:37:36.020922 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:36.020885    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58ddd69f6b-kzzf7" podStartSLOduration=10.73671414 podStartE2EDuration="21.020872458s" totalImagesPullingTime="10.284158318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:36.020553982 +0000 UTC m=+46.746624317" watchObservedRunningTime="2026-08-04 10:37:36.020872458 +0000 UTC m=+46.746942792"
Aug 04 10:37:36.066879 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:36.066840    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b96cb89f4-mp2hm" podStartSLOduration=10.484951391 podStartE2EDuration="21.066827607s" totalImagesPullingTime="10.581876216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:36.065485873 +0000 UTC m=+46.791556206" watchObservedRunningTime="2026-08-04 10:37:36.066827607 +0000 UTC m=+46.792897919"
Aug 04 10:37:36.110844 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:36.110804    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qf66x" podStartSLOduration=1.8510659569999999 podStartE2EDuration="12.110791892s" totalImagesPullingTime="10.259725935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:37:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:36.110766103 +0000 UTC m=+46.836836448" watchObservedRunningTime="2026-08-04 10:37:36.110791892 +0000 UTC m=+46.836862205"
Aug 04 10:37:37.004616 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:37.004586    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x" event={"ID":"797dcad8-70f8-41af-a502-fdb6de3b00c5","Type":"ContainerStarted","Data":"a6baefb08a669963b7106e0b5c3ca67a8d08a9b18e27857f8a077067678e680e"}
Aug 04 10:37:37.007142 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:37.007119    2559 generic.go:356] "Generic (PLEG): container finished" podID="b3df3887-c14e-494d-9eee-c0bf6d22f716" containerID="5b2b6f1db2008fac2390b491aac656e92f816a9dc0d3f9ee42dad183c5e7f700" exitCode=0
Aug 04 10:37:37.007270 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:37.007186    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqvvw" event={"ID":"b3df3887-c14e-494d-9eee-c0bf6d22f716","Type":"ContainerDied","Data":"5b2b6f1db2008fac2390b491aac656e92f816a9dc0d3f9ee42dad183c5e7f700"}
Aug 04 10:37:37.026992 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:37.026957    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x" podStartSLOduration=11.755884344 podStartE2EDuration="22.026938284s" totalImagesPullingTime="10.27105394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:37.026197292 +0000 UTC m=+47.752267636" watchObservedRunningTime="2026-08-04 10:37:37.026938284 +0000 UTC m=+47.753008619"
Aug 04 10:37:38.012690 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:38.012653    2559 generic.go:356] "Generic (PLEG): container finished" podID="b3df3887-c14e-494d-9eee-c0bf6d22f716" containerID="8332d473281f05022f3a509645eb3f63a8594b4a6cd9b76753052ef72e0b0793" exitCode=0
Aug 04 10:37:38.013041 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:38.012735    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqvvw" event={"ID":"b3df3887-c14e-494d-9eee-c0bf6d22f716","Type":"ContainerDied","Data":"8332d473281f05022f3a509645eb3f63a8594b4a6cd9b76753052ef72e0b0793"}
Aug 04 10:37:39.019557 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:39.019524    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqvvw" event={"ID":"b3df3887-c14e-494d-9eee-c0bf6d22f716","Type":"ContainerStarted","Data":"cb07a3c2ce28bd392a64252d741e1d5098afdbcafcb05e3b8cef226ce00e2422"}
Aug 04 10:37:39.046541 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:39.046500    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pqvvw" podStartSLOduration=8.589473727 podStartE2EDuration="48.046485688s" totalImagesPullingTime="39.457011961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:36:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:39.044158765 +0000 UTC m=+49.770229099" watchObservedRunningTime="2026-08-04 10:37:39.046485688 +0000 UTC m=+49.772556021"
Aug 04 10:37:40.484600 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:40.484568    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:40.484951 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:40.484719    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 10:37:40.484951 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:40.484734    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96759bd45-7gqgd: secret "image-registry-tls" not found
Aug 04 10:37:40.484951 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:40.484793    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls podName:e7224dab-0bfa-4972-aeac-9d4fa258488f nodeName:}" failed. No retries permitted until 2026-08-04 10:37:56.484777591 +0000 UTC m=+67.210847924 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls") pod "image-registry-96759bd45-7gqgd" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f") : secret "image-registry-tls" not found
Aug 04 10:37:40.585753 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:40.585726    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:40.585884 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:40.585821    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 10:37:40.585884 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:40.585864    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls podName:568a8a46-1a19-47c9-8070-c5de70047dad nodeName:}" failed. No retries permitted until 2026-08-04 10:37:56.585852932 +0000 UTC m=+67.311923244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls") pod "dns-default-2c279" (UID: "568a8a46-1a19-47c9-8070-c5de70047dad") : secret "dns-default-metrics-tls" not found
Aug 04 10:37:51.952832 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:51.952804    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5mgdp"
Aug 04 10:37:55.604491 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:55.604447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:55.604875 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:55.604506    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs\") pod \"network-metrics-daemon-45gv2\" (UID: \"3797c942-ece8-4151-bfb3-5c0ed4a61cd9\") " pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:37:55.606842 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:55.606823    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 10:37:55.606896 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:55.606840    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 10:37:55.614787 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:55.614766    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 10:37:55.614860 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:55.614834    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs podName:3797c942-ece8-4151-bfb3-5c0ed4a61cd9 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:59.61481313 +0000 UTC m=+130.340883457 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs") pod "network-metrics-daemon-45gv2" (UID: "3797c942-ece8-4151-bfb3-5c0ed4a61cd9") : secret "metrics-daemon-secret" not found
Aug 04 10:37:55.618052 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:55.618033    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/790dd286-529d-47d2-a860-6f692d635f80-original-pull-secret\") pod \"global-pull-secret-syncer-mtxjn\" (UID: \"790dd286-529d-47d2-a860-6f692d635f80\") " pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:55.705663 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:55.705615    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4stl\" (UniqueName: \"kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl\") pod \"network-check-target-vg4bn\" (UID: \"362a23fd-e433-4252-9828-05cf8ad8c756\") " pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:55.707936 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:55.707922    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 10:37:55.718707 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:55.718689    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 10:37:55.729688 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:55.729666    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4stl\" (UniqueName: \"kubernetes.io/projected/362a23fd-e433-4252-9828-05cf8ad8c756-kube-api-access-b4stl\") pod \"network-check-target-vg4bn\" (UID: \"362a23fd-e433-4252-9828-05cf8ad8c756\") " pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:55.797944 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:55.797925    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qf5ds\""
Aug 04 10:37:55.800555 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:55.800542    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtxjn"
Aug 04 10:37:55.806355 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:55.806334    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:37:55.935774 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:55.935744    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtxjn"]
Aug 04 10:37:55.938942 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:37:55.938914    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790dd286_529d_47d2_a860_6f692d635f80.slice/crio-4e6b4ee75c84d2847f2057b9472bcd05f8b3c42409e5c8bb582b9ccb2066c796 WatchSource:0}: Error finding container 4e6b4ee75c84d2847f2057b9472bcd05f8b3c42409e5c8bb582b9ccb2066c796: Status 404 returned error can't find the container with id 4e6b4ee75c84d2847f2057b9472bcd05f8b3c42409e5c8bb582b9ccb2066c796
Aug 04 10:37:55.948846 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:55.948826    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vg4bn"]
Aug 04 10:37:55.951495 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:37:55.951473    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod362a23fd_e433_4252_9828_05cf8ad8c756.slice/crio-0f4229e3a12441784cabb261949d19464ed4b2189b8d31a7bade6c9dd22663bd WatchSource:0}: Error finding container 0f4229e3a12441784cabb261949d19464ed4b2189b8d31a7bade6c9dd22663bd: Status 404 returned error can't find the container with id 0f4229e3a12441784cabb261949d19464ed4b2189b8d31a7bade6c9dd22663bd
Aug 04 10:37:56.067170 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:56.067141    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vg4bn" event={"ID":"362a23fd-e433-4252-9828-05cf8ad8c756","Type":"ContainerStarted","Data":"0f4229e3a12441784cabb261949d19464ed4b2189b8d31a7bade6c9dd22663bd"}
Aug 04 10:37:56.068168 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:56.068147    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtxjn" event={"ID":"790dd286-529d-47d2-a860-6f692d635f80","Type":"ContainerStarted","Data":"4e6b4ee75c84d2847f2057b9472bcd05f8b3c42409e5c8bb582b9ccb2066c796"}
Aug 04 10:37:56.511988 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:56.511952    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:37:56.512129 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:56.512073    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 10:37:56.512129 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:56.512083    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96759bd45-7gqgd: secret "image-registry-tls" not found
Aug 04 10:37:56.512129 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:56.512129    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls podName:e7224dab-0bfa-4972-aeac-9d4fa258488f nodeName:}" failed. No retries permitted until 2026-08-04 10:38:28.512117214 +0000 UTC m=+99.238187527 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls") pod "image-registry-96759bd45-7gqgd" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f") : secret "image-registry-tls" not found
Aug 04 10:37:56.612687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:37:56.612655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:37:56.613014 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:56.612777    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 10:37:56.613014 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:37:56.612834    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls podName:568a8a46-1a19-47c9-8070-c5de70047dad nodeName:}" failed. No retries permitted until 2026-08-04 10:38:28.612818127 +0000 UTC m=+99.338888443 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls") pod "dns-default-2c279" (UID: "568a8a46-1a19-47c9-8070-c5de70047dad") : secret "dns-default-metrics-tls" not found
Aug 04 10:38:02.088870 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:02.088794    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vg4bn" event={"ID":"362a23fd-e433-4252-9828-05cf8ad8c756","Type":"ContainerStarted","Data":"e153bfb607c24eac8bf052bb0fafb013193b8a878e7432272f054ac113d676a6"}
Aug 04 10:38:02.089270 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:02.088876    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:38:02.090321 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:02.090299    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtxjn" event={"ID":"790dd286-529d-47d2-a860-6f692d635f80","Type":"ContainerStarted","Data":"67eca6de2649597b030a2b21f7c898257d9519ccf76ddde37a2d22768bfa15cf"}
Aug 04 10:38:02.113240 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:02.113202    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vg4bn" podStartSLOduration=65.37812361 podStartE2EDuration="1m11.113190149s" totalImagesPullingTime="5.735066539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:38:02.111778064 +0000 UTC m=+72.837848392" watchObservedRunningTime="2026-08-04 10:38:02.113190149 +0000 UTC m=+72.839260483"
Aug 04 10:38:02.140096 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:02.140057    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mtxjn" podStartSLOduration=65.392552366 podStartE2EDuration="1m11.140044274s" totalImagesPullingTime="5.747491908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:38:02.139562161 +0000 UTC m=+72.865632495" watchObservedRunningTime="2026-08-04 10:38:02.140044274 +0000 UTC m=+72.866114608"
Aug 04 10:38:28.535904 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:28.535743    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:38:28.536484 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:28.535925    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 10:38:28.536484 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:28.535948    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96759bd45-7gqgd: secret "image-registry-tls" not found
Aug 04 10:38:28.536484 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:28.536026    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls podName:e7224dab-0bfa-4972-aeac-9d4fa258488f nodeName:}" failed. No retries permitted until 2026-08-04 10:39:32.536002493 +0000 UTC m=+163.262072823 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls") pod "image-registry-96759bd45-7gqgd" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f") : secret "image-registry-tls" not found
Aug 04 10:38:28.636625 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:28.636577    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:38:28.636801 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:28.636722    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 10:38:28.636801 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:28.636782    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls podName:568a8a46-1a19-47c9-8070-c5de70047dad nodeName:}" failed. No retries permitted until 2026-08-04 10:39:32.636768421 +0000 UTC m=+163.362838734 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls") pod "dns-default-2c279" (UID: "568a8a46-1a19-47c9-8070-c5de70047dad") : secret "dns-default-metrics-tls" not found
Aug 04 10:38:33.095901 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:33.095873    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vg4bn"
Aug 04 10:38:48.381461 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.381428    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lqdbv"]
Aug 04 10:38:48.383657 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.383627    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:48.386229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.386201    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 10:38:48.386510 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.386492    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 10:38:48.386600 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.386495    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 10:38:48.386929 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.386915    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 10:38:48.387016 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.386915    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v8c5x\""
Aug 04 10:38:48.395005 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.394985    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lqdbv"]
Aug 04 10:38:48.479345 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.479311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqkjh\" (UniqueName: \"kubernetes.io/projected/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-api-access-wqkjh\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:48.479523 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.479357    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b76b54f-db74-42fc-bbee-8e48683f9d91-crio-socket\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:48.479523 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.479446    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b76b54f-db74-42fc-bbee-8e48683f9d91-data-volume\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:48.479523 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.479486    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:48.479627 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.479534    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:48.580328 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.580286    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b76b54f-db74-42fc-bbee-8e48683f9d91-data-volume\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:48.580443 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.580345    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:48.580443 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.580410    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:48.580443 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.580438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqkjh\" (UniqueName: \"kubernetes.io/projected/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-api-access-wqkjh\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:48.580588 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.580476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b76b54f-db74-42fc-bbee-8e48683f9d91-crio-socket\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:48.580588 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:48.580522    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 10:38:48.580588 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:48.580530    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 10:38:48.580588 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.580547    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b76b54f-db74-42fc-bbee-8e48683f9d91-crio-socket\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:48.580588 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:48.580586    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls podName:5b76b54f-db74-42fc-bbee-8e48683f9d91 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:49.080570978 +0000 UTC m=+119.806641291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lqdbv" (UID: "5b76b54f-db74-42fc-bbee-8e48683f9d91") : secret "insights-runtime-extractor-tls" not found
Aug 04 10:38:48.580818 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:48.580661    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm podName:5b76b54f-db74-42fc-bbee-8e48683f9d91 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:49.080615737 +0000 UTC m=+119.806686082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lqdbv" (UID: "5b76b54f-db74-42fc-bbee-8e48683f9d91") : configmap "kube-rbac-proxy" not found
Aug 04 10:38:48.580818 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.580686    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b76b54f-db74-42fc-bbee-8e48683f9d91-data-volume\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:48.588904 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:48.588883    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqkjh\" (UniqueName: \"kubernetes.io/projected/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-api-access-wqkjh\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:49.085585 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:49.085531    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:49.085790 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:49.085603    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:49.085790 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:49.085686    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 10:38:49.085790 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:49.085709    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 10:38:49.085790 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:49.085760    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm podName:5b76b54f-db74-42fc-bbee-8e48683f9d91 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:50.085724862 +0000 UTC m=+120.811795174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lqdbv" (UID: "5b76b54f-db74-42fc-bbee-8e48683f9d91") : configmap "kube-rbac-proxy" not found
Aug 04 10:38:49.085790 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:49.085779    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls podName:5b76b54f-db74-42fc-bbee-8e48683f9d91 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:50.08576762 +0000 UTC m=+120.811837933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lqdbv" (UID: "5b76b54f-db74-42fc-bbee-8e48683f9d91") : secret "insights-runtime-extractor-tls" not found
Aug 04 10:38:50.093997 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:50.093943    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:50.094405 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:50.094027    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:50.094405 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:50.094105    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 10:38:50.094405 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:50.094127    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 10:38:50.094405 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:50.094181    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls podName:5b76b54f-db74-42fc-bbee-8e48683f9d91 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:52.09416494 +0000 UTC m=+122.820235253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lqdbv" (UID: "5b76b54f-db74-42fc-bbee-8e48683f9d91") : secret "insights-runtime-extractor-tls" not found
Aug 04 10:38:50.094405 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:50.094198    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm podName:5b76b54f-db74-42fc-bbee-8e48683f9d91 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:52.094191147 +0000 UTC m=+122.820261459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lqdbv" (UID: "5b76b54f-db74-42fc-bbee-8e48683f9d91") : configmap "kube-rbac-proxy" not found
Aug 04 10:38:50.310629 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:50.310601    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mg8tk_ddccaa00-a3b0-4696-9f37-7e86195ddf41/dns-node-resolver/0.log"
Aug 04 10:38:51.110074 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:51.110047    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nc4hz_781d93fa-f41a-4510-836a-deadf3c3be42/node-ca/0.log"
Aug 04 10:38:51.711313 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:51.711285    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qf66x_66434394-a392-41f9-b8ff-1d93cd551961/serve-healthcheck-canary/0.log"
Aug 04 10:38:52.110245 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:52.110214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:52.110598 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:52.110275    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:52.110598 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:52.110355    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 10:38:52.110598 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:52.110375    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 10:38:52.110598 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:52.110423    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm podName:5b76b54f-db74-42fc-bbee-8e48683f9d91 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:56.110408582 +0000 UTC m=+126.836478895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lqdbv" (UID: "5b76b54f-db74-42fc-bbee-8e48683f9d91") : configmap "kube-rbac-proxy" not found
Aug 04 10:38:52.110598 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:52.110436    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls podName:5b76b54f-db74-42fc-bbee-8e48683f9d91 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:56.11043016 +0000 UTC m=+126.836500472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lqdbv" (UID: "5b76b54f-db74-42fc-bbee-8e48683f9d91") : secret "insights-runtime-extractor-tls" not found
Aug 04 10:38:56.142551 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:56.142507    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:56.143015 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:56.142598    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:38:56.143015 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:56.142688    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 10:38:56.143015 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:56.142723    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 10:38:56.143015 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:56.142751    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls podName:5b76b54f-db74-42fc-bbee-8e48683f9d91 nodeName:}" failed. No retries permitted until 2026-08-04 10:39:04.142734758 +0000 UTC m=+134.868805071 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lqdbv" (UID: "5b76b54f-db74-42fc-bbee-8e48683f9d91") : secret "insights-runtime-extractor-tls" not found
Aug 04 10:38:56.143015 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:56.142777    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm podName:5b76b54f-db74-42fc-bbee-8e48683f9d91 nodeName:}" failed. No retries permitted until 2026-08-04 10:39:04.142763624 +0000 UTC m=+134.868833937 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lqdbv" (UID: "5b76b54f-db74-42fc-bbee-8e48683f9d91") : configmap "kube-rbac-proxy" not found
Aug 04 10:38:59.671296 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:38:59.671258    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs\") pod \"network-metrics-daemon-45gv2\" (UID: \"3797c942-ece8-4151-bfb3-5c0ed4a61cd9\") " pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:38:59.671722 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:59.671410    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 10:38:59.671722 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:38:59.671474    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs podName:3797c942-ece8-4151-bfb3-5c0ed4a61cd9 nodeName:}" failed. No retries permitted until 2026-08-04 10:41:01.671458763 +0000 UTC m=+252.397529076 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs") pod "network-metrics-daemon-45gv2" (UID: "3797c942-ece8-4151-bfb3-5c0ed4a61cd9") : secret "metrics-daemon-secret" not found
Aug 04 10:39:04.206731 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:04.206633    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:39:04.207233 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:04.206776    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:39:04.207233 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:39:04.206804    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 10:39:04.207233 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:39:04.206892    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls podName:5b76b54f-db74-42fc-bbee-8e48683f9d91 nodeName:}" failed. No retries permitted until 2026-08-04 10:39:20.206860343 +0000 UTC m=+150.932930675 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lqdbv" (UID: "5b76b54f-db74-42fc-bbee-8e48683f9d91") : secret "insights-runtime-extractor-tls" not found
Aug 04 10:39:04.207362 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:04.207343    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b76b54f-db74-42fc-bbee-8e48683f9d91-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:39:20.231413 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:20.231380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:39:20.233632 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:20.233614    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b76b54f-db74-42fc-bbee-8e48683f9d91-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqdbv\" (UID: \"5b76b54f-db74-42fc-bbee-8e48683f9d91\") " pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:39:20.494933 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:20.494854    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v8c5x\""
Aug 04 10:39:20.503716 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:20.503699    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lqdbv"
Aug 04 10:39:20.637101 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:20.637073    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lqdbv"]
Aug 04 10:39:20.639897 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:39:20.639855    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b76b54f_db74_42fc_bbee_8e48683f9d91.slice/crio-5b11d6974a027e7d14228c13ae357d012147881bb9dbea95d3412baa8054dd9d WatchSource:0}: Error finding container 5b11d6974a027e7d14228c13ae357d012147881bb9dbea95d3412baa8054dd9d: Status 404 returned error can't find the container with id 5b11d6974a027e7d14228c13ae357d012147881bb9dbea95d3412baa8054dd9d
Aug 04 10:39:21.311194 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:21.311156    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lqdbv" event={"ID":"5b76b54f-db74-42fc-bbee-8e48683f9d91","Type":"ContainerStarted","Data":"f59f5295a88b5e5fa1de40374068a202a0a7675189ef1ed9f4f92f2129077e42"}
Aug 04 10:39:21.311569 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:21.311214    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lqdbv" event={"ID":"5b76b54f-db74-42fc-bbee-8e48683f9d91","Type":"ContainerStarted","Data":"5b11d6974a027e7d14228c13ae357d012147881bb9dbea95d3412baa8054dd9d"}
Aug 04 10:39:24.320881 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:24.320845    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lqdbv" event={"ID":"5b76b54f-db74-42fc-bbee-8e48683f9d91","Type":"ContainerStarted","Data":"572aa866119f3103489e7de1004aa32d7b3c7eddef4f87995d506cc53bbeb73a"}
Aug 04 10:39:25.325498 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:25.325463    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lqdbv" event={"ID":"5b76b54f-db74-42fc-bbee-8e48683f9d91","Type":"ContainerStarted","Data":"4c212db8267a796addc63e418643cd2d9c3716eebb31b922a00fd1da3dc02220"}
Aug 04 10:39:25.346317 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:25.346268    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lqdbv" podStartSLOduration=33.583714425 podStartE2EDuration="37.346253629s" totalImagesPullingTime="3.762539204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:38:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:25.344839611 +0000 UTC m=+156.070909954" watchObservedRunningTime="2026-08-04 10:39:25.346253629 +0000 UTC m=+156.072323964"
Aug 04 10:39:26.796104 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.796076    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mbwbq"]
Aug 04 10:39:26.798244 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.798228    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.802114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.802080    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 10:39:26.802368 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.802263    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8vcbw\""
Aug 04 10:39:26.802831 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.802802    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 10:39:26.802950 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.802937    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 10:39:26.803674 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.803622    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 10:39:26.803789 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.803710    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 10:39:26.806708 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.806693    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 10:39:26.882087 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.882066    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7bddd16d-cfbc-4143-8402-bda919bcc9e6-root\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.882207 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.882100    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ckck\" (UniqueName: \"kubernetes.io/projected/7bddd16d-cfbc-4143-8402-bda919bcc9e6-kube-api-access-4ckck\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.882207 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.882129    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-tls\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.882207 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.882148    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.882207 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.882197    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bddd16d-cfbc-4143-8402-bda919bcc9e6-sys\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.882396 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.882245    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-textfile\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.882396 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.882264    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.882396 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.882281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bddd16d-cfbc-4143-8402-bda919bcc9e6-metrics-client-ca\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.882548 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.882406    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-wtmp\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.983616 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.983595    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-wtmp\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.983750 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.983628    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7bddd16d-cfbc-4143-8402-bda919bcc9e6-root\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.983750 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.983670    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ckck\" (UniqueName: \"kubernetes.io/projected/7bddd16d-cfbc-4143-8402-bda919bcc9e6-kube-api-access-4ckck\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.983750 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.983693    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-tls\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.983750 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.983719    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.983750 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.983739    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bddd16d-cfbc-4143-8402-bda919bcc9e6-sys\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.983997 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.983759    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-wtmp\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.983997 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.983777    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7bddd16d-cfbc-4143-8402-bda919bcc9e6-root\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.983997 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.983791    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bddd16d-cfbc-4143-8402-bda919bcc9e6-sys\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.983997 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.983800    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-textfile\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.983997 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.983848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.983997 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.983876    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bddd16d-cfbc-4143-8402-bda919bcc9e6-metrics-client-ca\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.983997 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:39:26.983916    2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Aug 04 10:39:26.983997 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:39:26.983969    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-tls podName:7bddd16d-cfbc-4143-8402-bda919bcc9e6 nodeName:}" failed. No retries permitted until 2026-08-04 10:39:27.483951759 +0000 UTC m=+158.210022075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-tls") pod "node-exporter-mbwbq" (UID: "7bddd16d-cfbc-4143-8402-bda919bcc9e6") : secret "node-exporter-tls" not found
Aug 04 10:39:26.984368 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.984174    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-textfile\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.984431 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.984373    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.984485 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.984467    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bddd16d-cfbc-4143-8402-bda919bcc9e6-metrics-client-ca\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.986118 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.986093    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:26.992349 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:26.992311    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ckck\" (UniqueName: \"kubernetes.io/projected/7bddd16d-cfbc-4143-8402-bda919bcc9e6-kube-api-access-4ckck\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:27.486563 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:27.486527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-tls\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:27.488930 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:27.488898    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7bddd16d-cfbc-4143-8402-bda919bcc9e6-node-exporter-tls\") pod \"node-exporter-mbwbq\" (UID: \"7bddd16d-cfbc-4143-8402-bda919bcc9e6\") " pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:27.679091 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:39:27.679057    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-96759bd45-7gqgd" podUID="e7224dab-0bfa-4972-aeac-9d4fa258488f"
Aug 04 10:39:27.706762 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:27.706725    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mbwbq"
Aug 04 10:39:27.716782 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:39:27.716759    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bddd16d_cfbc_4143_8402_bda919bcc9e6.slice/crio-c9b90350d5efec00e3b75ca098fa8604f5569d734b1d644616f437ea1621dccb WatchSource:0}: Error finding container c9b90350d5efec00e3b75ca098fa8604f5569d734b1d644616f437ea1621dccb: Status 404 returned error can't find the container with id c9b90350d5efec00e3b75ca098fa8604f5569d734b1d644616f437ea1621dccb
Aug 04 10:39:27.727988 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:39:27.727960    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2c279" podUID="568a8a46-1a19-47c9-8070-c5de70047dad"
Aug 04 10:39:28.335585 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:28.335546    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbwbq" event={"ID":"7bddd16d-cfbc-4143-8402-bda919bcc9e6","Type":"ContainerStarted","Data":"c9b90350d5efec00e3b75ca098fa8604f5569d734b1d644616f437ea1621dccb"}
Aug 04 10:39:28.335585 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:28.335579    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2c279"
Aug 04 10:39:28.336095 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:28.335588    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:39:28.789630 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:39:28.789600    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-45gv2" podUID="3797c942-ece8-4151-bfb3-5c0ed4a61cd9"
Aug 04 10:39:29.339903 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:29.339864    2559 generic.go:356] "Generic (PLEG): container finished" podID="7bddd16d-cfbc-4143-8402-bda919bcc9e6" containerID="6d853cb8eeb2002e431093402e249549d5f11b36192fe02b6a8b65925f7896c8" exitCode=0
Aug 04 10:39:29.340359 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:29.339937    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbwbq" event={"ID":"7bddd16d-cfbc-4143-8402-bda919bcc9e6","Type":"ContainerDied","Data":"6d853cb8eeb2002e431093402e249549d5f11b36192fe02b6a8b65925f7896c8"}
Aug 04 10:39:30.345810 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:30.345773    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbwbq" event={"ID":"7bddd16d-cfbc-4143-8402-bda919bcc9e6","Type":"ContainerStarted","Data":"82fd720ab978d642d56aecb5da8e9d4fdefa46091854cb44cd463080a5d3c4ef"}
Aug 04 10:39:30.346173 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:30.345836    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mbwbq" event={"ID":"7bddd16d-cfbc-4143-8402-bda919bcc9e6","Type":"ContainerStarted","Data":"f8b091636ea904441f121b0e2e29534ef74c4742f1e37492163c3fba079acc9f"}
Aug 04 10:39:30.370049 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:30.366907    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mbwbq" podStartSLOduration=3.4380476 podStartE2EDuration="4.366887229s" totalImagesPullingTime="859.200615ms" totalInitContainerRuntime="69.639014ms" isStatefulPod=true podCreationTimestamp="2026-08-04 10:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:30.364822691 +0000 UTC m=+161.090893025" watchObservedRunningTime="2026-08-04 10:39:30.366887229 +0000 UTC m=+161.092957565"
Aug 04 10:39:32.625289 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:32.625243    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:39:32.627718 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:32.627694    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls\") pod \"image-registry-96759bd45-7gqgd\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") " pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:39:32.725943 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:32.725900    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:39:32.728135 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:32.728118    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/568a8a46-1a19-47c9-8070-c5de70047dad-metrics-tls\") pod \"dns-default-2c279\" (UID: \"568a8a46-1a19-47c9-8070-c5de70047dad\") " pod="openshift-dns/dns-default-2c279"
Aug 04 10:39:32.839126 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:32.839098    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f4ggs\""
Aug 04 10:39:32.839227 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:32.839103    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xjf6f\""
Aug 04 10:39:32.847032 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:32.847011    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:39:32.847119 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:32.847106    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2c279"
Aug 04 10:39:32.988531 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:32.988501    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-96759bd45-7gqgd"]
Aug 04 10:39:32.992166 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:39:32.992141    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7224dab_0bfa_4972_aeac_9d4fa258488f.slice/crio-6744fc43c2cb6e971c25e3390daeaedc45920057f92bd707580a166052f5ea7a WatchSource:0}: Error finding container 6744fc43c2cb6e971c25e3390daeaedc45920057f92bd707580a166052f5ea7a: Status 404 returned error can't find the container with id 6744fc43c2cb6e971c25e3390daeaedc45920057f92bd707580a166052f5ea7a
Aug 04 10:39:33.002898 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:33.002833    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2c279"]
Aug 04 10:39:33.006718 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:39:33.006691    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod568a8a46_1a19_47c9_8070_c5de70047dad.slice/crio-a71ca1b29901c3acde768e5963832cb749f3d0604d1d51f14d610db6709b129b WatchSource:0}: Error finding container a71ca1b29901c3acde768e5963832cb749f3d0604d1d51f14d610db6709b129b: Status 404 returned error can't find the container with id a71ca1b29901c3acde768e5963832cb749f3d0604d1d51f14d610db6709b129b
Aug 04 10:39:33.355701 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:33.355662    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2c279" event={"ID":"568a8a46-1a19-47c9-8070-c5de70047dad","Type":"ContainerStarted","Data":"a71ca1b29901c3acde768e5963832cb749f3d0604d1d51f14d610db6709b129b"}
Aug 04 10:39:33.357098 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:33.357071    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96759bd45-7gqgd" event={"ID":"e7224dab-0bfa-4972-aeac-9d4fa258488f","Type":"ContainerStarted","Data":"1105dbbe7829ce533baa631c4a72d17269a22e5a3dc3e82e417e2559da1ac50c"}
Aug 04 10:39:33.357235 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:33.357112    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96759bd45-7gqgd" event={"ID":"e7224dab-0bfa-4972-aeac-9d4fa258488f","Type":"ContainerStarted","Data":"6744fc43c2cb6e971c25e3390daeaedc45920057f92bd707580a166052f5ea7a"}
Aug 04 10:39:33.357235 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:33.357208    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:39:33.378525 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:33.378481    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-96759bd45-7gqgd" podStartSLOduration=162.378466492 podStartE2EDuration="2m42.378466492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:36:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:33.377015485 +0000 UTC m=+164.103085832" watchObservedRunningTime="2026-08-04 10:39:33.378466492 +0000 UTC m=+164.104536844"
Aug 04 10:39:35.369822 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:35.369787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2c279" event={"ID":"568a8a46-1a19-47c9-8070-c5de70047dad","Type":"ContainerStarted","Data":"2475b249e67386f3a66df960c8cf5816df3c0882b49cb513df93de6590b810ca"}
Aug 04 10:39:35.370238 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:35.369873    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2c279" event={"ID":"568a8a46-1a19-47c9-8070-c5de70047dad","Type":"ContainerStarted","Data":"8dc2f8f5e4dbf216c4a4a982bcdd38459e564ea24979be95890c56bc0987a002"}
Aug 04 10:39:35.370238 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:35.369897    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2c279"
Aug 04 10:39:35.389489 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:35.389443    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2c279" podStartSLOduration=129.384654762 podStartE2EDuration="2m11.389430042s" totalImagesPullingTime="2.00477528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:37:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:35.388667599 +0000 UTC m=+166.114737934" watchObservedRunningTime="2026-08-04 10:39:35.389430042 +0000 UTC m=+166.115500377"
Aug 04 10:39:37.991781 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:37.991735    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-96759bd45-7gqgd"]
Aug 04 10:39:39.777343 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:39.777301    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:39:45.376265 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:45.376188    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2c279"
Aug 04 10:39:57.997339 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:39:57.997312    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:40:03.010859 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.010815    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-96759bd45-7gqgd" podUID="e7224dab-0bfa-4972-aeac-9d4fa258488f" containerName="registry" containerID="cri-o://1105dbbe7829ce533baa631c4a72d17269a22e5a3dc3e82e417e2559da1ac50c" gracePeriod=30
Aug 04 10:40:03.244069 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.244041    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:40:03.359956 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.359931    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7224dab-0bfa-4972-aeac-9d4fa258488f-image-registry-private-configuration\") pod \"e7224dab-0bfa-4972-aeac-9d4fa258488f\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") "
Aug 04 10:40:03.360195 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.359961    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-bound-sa-token\") pod \"e7224dab-0bfa-4972-aeac-9d4fa258488f\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") "
Aug 04 10:40:03.360195 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.359983    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8lj6\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-kube-api-access-f8lj6\") pod \"e7224dab-0bfa-4972-aeac-9d4fa258488f\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") "
Aug 04 10:40:03.360195 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.360005    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls\") pod \"e7224dab-0bfa-4972-aeac-9d4fa258488f\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") "
Aug 04 10:40:03.360195 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.360021    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7224dab-0bfa-4972-aeac-9d4fa258488f-installation-pull-secrets\") pod \"e7224dab-0bfa-4972-aeac-9d4fa258488f\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") "
Aug 04 10:40:03.360195 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.360097    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-certificates\") pod \"e7224dab-0bfa-4972-aeac-9d4fa258488f\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") "
Aug 04 10:40:03.360195 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.360185    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7224dab-0bfa-4972-aeac-9d4fa258488f-ca-trust-extracted\") pod \"e7224dab-0bfa-4972-aeac-9d4fa258488f\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") "
Aug 04 10:40:03.360511 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.360223    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7224dab-0bfa-4972-aeac-9d4fa258488f-trusted-ca\") pod \"e7224dab-0bfa-4972-aeac-9d4fa258488f\" (UID: \"e7224dab-0bfa-4972-aeac-9d4fa258488f\") "
Aug 04 10:40:03.360921 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.360682    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e7224dab-0bfa-4972-aeac-9d4fa258488f" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 10:40:03.361048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.360981    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7224dab-0bfa-4972-aeac-9d4fa258488f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e7224dab-0bfa-4972-aeac-9d4fa258488f" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 10:40:03.362578 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.362546    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e7224dab-0bfa-4972-aeac-9d4fa258488f" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:40:03.362717 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.362682    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7224dab-0bfa-4972-aeac-9d4fa258488f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e7224dab-0bfa-4972-aeac-9d4fa258488f" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:40:03.362788 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.362724    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e7224dab-0bfa-4972-aeac-9d4fa258488f" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:40:03.362881 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.362855    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-kube-api-access-f8lj6" (OuterVolumeSpecName: "kube-api-access-f8lj6") pod "e7224dab-0bfa-4972-aeac-9d4fa258488f" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f"). InnerVolumeSpecName "kube-api-access-f8lj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:40:03.363032 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.363015    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7224dab-0bfa-4972-aeac-9d4fa258488f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e7224dab-0bfa-4972-aeac-9d4fa258488f" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:40:03.369436 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.369410    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7224dab-0bfa-4972-aeac-9d4fa258488f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e7224dab-0bfa-4972-aeac-9d4fa258488f" (UID: "e7224dab-0bfa-4972-aeac-9d4fa258488f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:40:03.460721 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.460697    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7224dab-0bfa-4972-aeac-9d4fa258488f-ca-trust-extracted\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:40:03.460721 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.460720    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7224dab-0bfa-4972-aeac-9d4fa258488f-trusted-ca\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:40:03.460881 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.460735    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7224dab-0bfa-4972-aeac-9d4fa258488f-image-registry-private-configuration\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:40:03.460881 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.460747    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-bound-sa-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:40:03.460881 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.460759    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8lj6\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-kube-api-access-f8lj6\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:40:03.460881 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.460769    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-tls\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:40:03.460881 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.460781    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7224dab-0bfa-4972-aeac-9d4fa258488f-installation-pull-secrets\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:40:03.460881 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.460792    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7224dab-0bfa-4972-aeac-9d4fa258488f-registry-certificates\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:40:03.461064 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.460943    2559 generic.go:356] "Generic (PLEG): container finished" podID="e7224dab-0bfa-4972-aeac-9d4fa258488f" containerID="1105dbbe7829ce533baa631c4a72d17269a22e5a3dc3e82e417e2559da1ac50c" exitCode=0
Aug 04 10:40:03.461064 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.460992    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96759bd45-7gqgd"
Aug 04 10:40:03.461064 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.461005    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96759bd45-7gqgd" event={"ID":"e7224dab-0bfa-4972-aeac-9d4fa258488f","Type":"ContainerDied","Data":"1105dbbe7829ce533baa631c4a72d17269a22e5a3dc3e82e417e2559da1ac50c"}
Aug 04 10:40:03.461064 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.461052    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96759bd45-7gqgd" event={"ID":"e7224dab-0bfa-4972-aeac-9d4fa258488f","Type":"ContainerDied","Data":"6744fc43c2cb6e971c25e3390daeaedc45920057f92bd707580a166052f5ea7a"}
Aug 04 10:40:03.461176 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.461081    2559 scope.go:117] "RemoveContainer" containerID="1105dbbe7829ce533baa631c4a72d17269a22e5a3dc3e82e417e2559da1ac50c"
Aug 04 10:40:03.468974 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.468959    2559 scope.go:117] "RemoveContainer" containerID="1105dbbe7829ce533baa631c4a72d17269a22e5a3dc3e82e417e2559da1ac50c"
Aug 04 10:40:03.469234 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:40:03.469211    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1105dbbe7829ce533baa631c4a72d17269a22e5a3dc3e82e417e2559da1ac50c\": container with ID starting with 1105dbbe7829ce533baa631c4a72d17269a22e5a3dc3e82e417e2559da1ac50c not found: ID does not exist" containerID="1105dbbe7829ce533baa631c4a72d17269a22e5a3dc3e82e417e2559da1ac50c"
Aug 04 10:40:03.469310 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.469245    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1105dbbe7829ce533baa631c4a72d17269a22e5a3dc3e82e417e2559da1ac50c"} err="failed to get container status \"1105dbbe7829ce533baa631c4a72d17269a22e5a3dc3e82e417e2559da1ac50c\": rpc error: code = NotFound desc = could not find container \"1105dbbe7829ce533baa631c4a72d17269a22e5a3dc3e82e417e2559da1ac50c\": container with ID starting with 1105dbbe7829ce533baa631c4a72d17269a22e5a3dc3e82e417e2559da1ac50c not found: ID does not exist"
Aug 04 10:40:03.483569 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.483548    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-96759bd45-7gqgd"]
Aug 04 10:40:03.488149 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.488123    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-96759bd45-7gqgd"]
Aug 04 10:40:03.779262 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:03.779194    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7224dab-0bfa-4972-aeac-9d4fa258488f" path="/var/lib/kubelet/pods/e7224dab-0bfa-4972-aeac-9d4fa258488f/volumes"
Aug 04 10:40:25.016613 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:25.016571    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x" podUID="797dcad8-70f8-41af-a502-fdb6de3b00c5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 04 10:40:35.015780 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:35.015738    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x" podUID="797dcad8-70f8-41af-a502-fdb6de3b00c5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 04 10:40:45.016439 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:45.016401    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x" podUID="797dcad8-70f8-41af-a502-fdb6de3b00c5" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 04 10:40:45.016837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:45.016474    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x"
Aug 04 10:40:45.016974 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:45.016957    2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"a6baefb08a669963b7106e0b5c3ca67a8d08a9b18e27857f8a077067678e680e"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Aug 04 10:40:45.017012 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:45.016995    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x" podUID="797dcad8-70f8-41af-a502-fdb6de3b00c5" containerName="service-proxy" containerID="cri-o://a6baefb08a669963b7106e0b5c3ca67a8d08a9b18e27857f8a077067678e680e" gracePeriod=30
Aug 04 10:40:45.596452 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:45.596422    2559 generic.go:356] "Generic (PLEG): container finished" podID="797dcad8-70f8-41af-a502-fdb6de3b00c5" containerID="a6baefb08a669963b7106e0b5c3ca67a8d08a9b18e27857f8a077067678e680e" exitCode=2
Aug 04 10:40:45.596607 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:45.596479    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x" event={"ID":"797dcad8-70f8-41af-a502-fdb6de3b00c5","Type":"ContainerDied","Data":"a6baefb08a669963b7106e0b5c3ca67a8d08a9b18e27857f8a077067678e680e"}
Aug 04 10:40:45.596607 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:40:45.596522    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-75646df4bd-dg67x" event={"ID":"797dcad8-70f8-41af-a502-fdb6de3b00c5","Type":"ContainerStarted","Data":"d47e9837b906151591fe9afa0b07d8c34622f287b33ca48e721c6779b01e2b2d"}
Aug 04 10:41:01.739258 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:41:01.739214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs\") pod \"network-metrics-daemon-45gv2\" (UID: \"3797c942-ece8-4151-bfb3-5c0ed4a61cd9\") " pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:41:01.741578 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:41:01.741558    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3797c942-ece8-4151-bfb3-5c0ed4a61cd9-metrics-certs\") pod \"network-metrics-daemon-45gv2\" (UID: \"3797c942-ece8-4151-bfb3-5c0ed4a61cd9\") " pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:41:01.981036 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:41:01.981002    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7blv\""
Aug 04 10:41:01.988771 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:41:01.988749    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-45gv2"
Aug 04 10:41:02.116184 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:41:02.116154    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-45gv2"]
Aug 04 10:41:02.119089 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:41:02.119067    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3797c942_ece8_4151_bfb3_5c0ed4a61cd9.slice/crio-05ef462f706ca647f067ee29fa74b7cf5c6d16cf7a5faeaf19940bec990980e0 WatchSource:0}: Error finding container 05ef462f706ca647f067ee29fa74b7cf5c6d16cf7a5faeaf19940bec990980e0: Status 404 returned error can't find the container with id 05ef462f706ca647f067ee29fa74b7cf5c6d16cf7a5faeaf19940bec990980e0
Aug 04 10:41:02.651498 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:41:02.651460    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-45gv2" event={"ID":"3797c942-ece8-4151-bfb3-5c0ed4a61cd9","Type":"ContainerStarted","Data":"05ef462f706ca647f067ee29fa74b7cf5c6d16cf7a5faeaf19940bec990980e0"}
Aug 04 10:41:04.661663 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:41:04.661608    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-45gv2" event={"ID":"3797c942-ece8-4151-bfb3-5c0ed4a61cd9","Type":"ContainerStarted","Data":"f2f336d261d4d86a9727e302d07b5b166c802dd03aac98c9ad97f6fdc4a2cf9b"}
Aug 04 10:41:05.666809 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:41:05.666765    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-45gv2" event={"ID":"3797c942-ece8-4151-bfb3-5c0ed4a61cd9","Type":"ContainerStarted","Data":"050740ec4bd109d7b7bea139a096be562d0ee8642fcbbadd2125c36100e31465"}
Aug 04 10:41:05.682359 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:41:05.682308    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-45gv2" podStartSLOduration=252.269525594 podStartE2EDuration="4m14.682293835s" totalImagesPullingTime="2.412768241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:41:05.68206387 +0000 UTC m=+256.408134204" watchObservedRunningTime="2026-08-04 10:41:05.682293835 +0000 UTC m=+256.408364185"
Aug 04 10:41:49.687259 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:41:49.687234    2559 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 10:45:18.197770 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.197738    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6nm8s"]
Aug 04 10:45:18.198175 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.197945    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7224dab-0bfa-4972-aeac-9d4fa258488f" containerName="registry"
Aug 04 10:45:18.198175 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.197955    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7224dab-0bfa-4972-aeac-9d4fa258488f" containerName="registry"
Aug 04 10:45:18.198175 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.197999    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7224dab-0bfa-4972-aeac-9d4fa258488f" containerName="registry"
Aug 04 10:45:18.200506 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.200492    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6nm8s"
Aug 04 10:45:18.202822 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.202800    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-h27tg\""
Aug 04 10:45:18.202954 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.202843    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 04 10:45:18.202954 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.202843    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 04 10:45:18.208886 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.208867    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6nm8s"]
Aug 04 10:45:18.277807 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.277781    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b538bcd-366e-4ff4-82d1-fb1336e12b12-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6nm8s\" (UID: \"2b538bcd-366e-4ff4-82d1-fb1336e12b12\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6nm8s"
Aug 04 10:45:18.277920 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.277832    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts996\" (UniqueName: \"kubernetes.io/projected/2b538bcd-366e-4ff4-82d1-fb1336e12b12-kube-api-access-ts996\") pod \"cert-manager-cainjector-559cdd8c87-6nm8s\" (UID: \"2b538bcd-366e-4ff4-82d1-fb1336e12b12\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6nm8s"
Aug 04 10:45:18.379032 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.379008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b538bcd-366e-4ff4-82d1-fb1336e12b12-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6nm8s\" (UID: \"2b538bcd-366e-4ff4-82d1-fb1336e12b12\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6nm8s"
Aug 04 10:45:18.379136 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.379058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts996\" (UniqueName: \"kubernetes.io/projected/2b538bcd-366e-4ff4-82d1-fb1336e12b12-kube-api-access-ts996\") pod \"cert-manager-cainjector-559cdd8c87-6nm8s\" (UID: \"2b538bcd-366e-4ff4-82d1-fb1336e12b12\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6nm8s"
Aug 04 10:45:18.387545 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.387529    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b538bcd-366e-4ff4-82d1-fb1336e12b12-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6nm8s\" (UID: \"2b538bcd-366e-4ff4-82d1-fb1336e12b12\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6nm8s"
Aug 04 10:45:18.387776 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.387760    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts996\" (UniqueName: \"kubernetes.io/projected/2b538bcd-366e-4ff4-82d1-fb1336e12b12-kube-api-access-ts996\") pod \"cert-manager-cainjector-559cdd8c87-6nm8s\" (UID: \"2b538bcd-366e-4ff4-82d1-fb1336e12b12\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6nm8s"
Aug 04 10:45:18.509861 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.509810    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6nm8s"
Aug 04 10:45:18.631035 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.631007    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6nm8s"]
Aug 04 10:45:18.634198 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:45:18.634172    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b538bcd_366e_4ff4_82d1_fb1336e12b12.slice/crio-1d19905d3f235c78b4b9c850399fec5953f26819faf3bf45eb6f606bf638dbd1 WatchSource:0}: Error finding container 1d19905d3f235c78b4b9c850399fec5953f26819faf3bf45eb6f606bf638dbd1: Status 404 returned error can't find the container with id 1d19905d3f235c78b4b9c850399fec5953f26819faf3bf45eb6f606bf638dbd1
Aug 04 10:45:18.636353 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:18.636336    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 10:45:19.446106 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:19.446046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6nm8s" event={"ID":"2b538bcd-366e-4ff4-82d1-fb1336e12b12","Type":"ContainerStarted","Data":"1d19905d3f235c78b4b9c850399fec5953f26819faf3bf45eb6f606bf638dbd1"}
Aug 04 10:45:22.458920 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:22.458887    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6nm8s" event={"ID":"2b538bcd-366e-4ff4-82d1-fb1336e12b12","Type":"ContainerStarted","Data":"32927b0a521dae829a86baf1ff47f37a70171b844f70a1bc2f8bea1455c4845d"}
Aug 04 10:45:22.474850 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:22.474803    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6nm8s" podStartSLOduration=1.3713001949999999 podStartE2EDuration="4.474785326s" totalImagesPullingTime="3.103485131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:45:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:45:22.473619432 +0000 UTC m=+513.199689765" watchObservedRunningTime="2026-08-04 10:45:22.474785326 +0000 UTC m=+513.200855662"
Aug 04 10:45:46.912486 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:46.912412    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"]
Aug 04 10:45:46.915351 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:46.915329    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:46.920555 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:46.920535    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 10:45:46.921628 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:46.921610    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 10:45:46.923163 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:46.923149    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 10:45:46.924034 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:46.924018    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 10:45:46.924105 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:46.924088    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hzkt2\""
Aug 04 10:45:46.948720 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:46.948695    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"]
Aug 04 10:45:46.964729 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:46.964705    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ba9a250-c2b4-4854-9869-a746af25a20e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79895c7c95-84fs9\" (UID: \"4ba9a250-c2b4-4854-9869-a746af25a20e\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:46.964815 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:46.964744    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xct2n\" (UniqueName: \"kubernetes.io/projected/4ba9a250-c2b4-4854-9869-a746af25a20e-kube-api-access-xct2n\") pod \"opendatahub-operator-controller-manager-79895c7c95-84fs9\" (UID: \"4ba9a250-c2b4-4854-9869-a746af25a20e\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:46.964815 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:46.964766    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ba9a250-c2b4-4854-9869-a746af25a20e-manifests\") pod \"opendatahub-operator-controller-manager-79895c7c95-84fs9\" (UID: \"4ba9a250-c2b4-4854-9869-a746af25a20e\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:46.964882 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:46.964821    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ba9a250-c2b4-4854-9869-a746af25a20e-tmp\") pod \"opendatahub-operator-controller-manager-79895c7c95-84fs9\" (UID: \"4ba9a250-c2b4-4854-9869-a746af25a20e\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:46.964882 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:46.964839    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ba9a250-c2b4-4854-9869-a746af25a20e-webhook-cert\") pod \"opendatahub-operator-controller-manager-79895c7c95-84fs9\" (UID: \"4ba9a250-c2b4-4854-9869-a746af25a20e\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:47.065264 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:47.065242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xct2n\" (UniqueName: \"kubernetes.io/projected/4ba9a250-c2b4-4854-9869-a746af25a20e-kube-api-access-xct2n\") pod \"opendatahub-operator-controller-manager-79895c7c95-84fs9\" (UID: \"4ba9a250-c2b4-4854-9869-a746af25a20e\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:47.065361 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:47.065271    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ba9a250-c2b4-4854-9869-a746af25a20e-manifests\") pod \"opendatahub-operator-controller-manager-79895c7c95-84fs9\" (UID: \"4ba9a250-c2b4-4854-9869-a746af25a20e\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:47.065361 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:47.065296    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ba9a250-c2b4-4854-9869-a746af25a20e-tmp\") pod \"opendatahub-operator-controller-manager-79895c7c95-84fs9\" (UID: \"4ba9a250-c2b4-4854-9869-a746af25a20e\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:47.065361 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:47.065310    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ba9a250-c2b4-4854-9869-a746af25a20e-webhook-cert\") pod \"opendatahub-operator-controller-manager-79895c7c95-84fs9\" (UID: \"4ba9a250-c2b4-4854-9869-a746af25a20e\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:47.065361 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:47.065355    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ba9a250-c2b4-4854-9869-a746af25a20e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79895c7c95-84fs9\" (UID: \"4ba9a250-c2b4-4854-9869-a746af25a20e\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:47.065710 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:47.065688    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4ba9a250-c2b4-4854-9869-a746af25a20e-manifests\") pod \"opendatahub-operator-controller-manager-79895c7c95-84fs9\" (UID: \"4ba9a250-c2b4-4854-9869-a746af25a20e\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:47.067780 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:47.067757    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ba9a250-c2b4-4854-9869-a746af25a20e-tmp\") pod \"opendatahub-operator-controller-manager-79895c7c95-84fs9\" (UID: \"4ba9a250-c2b4-4854-9869-a746af25a20e\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:47.067858 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:47.067835    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ba9a250-c2b4-4854-9869-a746af25a20e-webhook-cert\") pod \"opendatahub-operator-controller-manager-79895c7c95-84fs9\" (UID: \"4ba9a250-c2b4-4854-9869-a746af25a20e\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:47.067972 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:47.067956    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4ba9a250-c2b4-4854-9869-a746af25a20e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79895c7c95-84fs9\" (UID: \"4ba9a250-c2b4-4854-9869-a746af25a20e\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:47.082069 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:47.082044    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xct2n\" (UniqueName: \"kubernetes.io/projected/4ba9a250-c2b4-4854-9869-a746af25a20e-kube-api-access-xct2n\") pod \"opendatahub-operator-controller-manager-79895c7c95-84fs9\" (UID: \"4ba9a250-c2b4-4854-9869-a746af25a20e\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:47.224383 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:47.224328    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:47.358345 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:47.358318    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"]
Aug 04 10:45:47.361546 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:45:47.361519    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba9a250_c2b4_4854_9869_a746af25a20e.slice/crio-4f2c6917b6a6dbfea0f46cb9a601a8358b94cb133c035fd4f9a840d750ce50dc WatchSource:0}: Error finding container 4f2c6917b6a6dbfea0f46cb9a601a8358b94cb133c035fd4f9a840d750ce50dc: Status 404 returned error can't find the container with id 4f2c6917b6a6dbfea0f46cb9a601a8358b94cb133c035fd4f9a840d750ce50dc
Aug 04 10:45:47.535049 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:47.534987    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9" event={"ID":"4ba9a250-c2b4-4854-9869-a746af25a20e","Type":"ContainerStarted","Data":"4f2c6917b6a6dbfea0f46cb9a601a8358b94cb133c035fd4f9a840d750ce50dc"}
Aug 04 10:45:51.550402 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:51.550368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9" event={"ID":"4ba9a250-c2b4-4854-9869-a746af25a20e","Type":"ContainerStarted","Data":"f34d246f1e939d31529a7f72741860e298bc07cb39086dfcaf986097680b0893"}
Aug 04 10:45:52.554913 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:52.554881    2559 generic.go:356] "Generic (PLEG): container finished" podID="4ba9a250-c2b4-4854-9869-a746af25a20e" containerID="f34d246f1e939d31529a7f72741860e298bc07cb39086dfcaf986097680b0893" exitCode=0
Aug 04 10:45:52.555262 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:52.554951    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9" event={"ID":"4ba9a250-c2b4-4854-9869-a746af25a20e","Type":"ContainerDied","Data":"f34d246f1e939d31529a7f72741860e298bc07cb39086dfcaf986097680b0893"}
Aug 04 10:45:53.561417 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:53.561381    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9" event={"ID":"4ba9a250-c2b4-4854-9869-a746af25a20e","Type":"ContainerStarted","Data":"05af8569d626f08f44e62f2e8c937b683ae747358a5d782d91d9f0a53abf3931"}
Aug 04 10:45:53.561878 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:53.561513    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:45:53.584439 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:45:53.584391    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9" podStartSLOduration=2.7711469380000002 podStartE2EDuration="7.584374696s" totalImagesPullingTime="3.880139105s" totalInitContainerRuntime="933.088653ms" isStatefulPod=false podCreationTimestamp="2026-08-04 10:45:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:45:53.582633066 +0000 UTC m=+544.308703400" watchObservedRunningTime="2026-08-04 10:45:53.584374696 +0000 UTC m=+544.310445029"
Aug 04 10:46:04.566553 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:04.566519    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-84fs9"
Aug 04 10:46:08.040013 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.039983    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw"]
Aug 04 10:46:08.048614 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.048590    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw"
Aug 04 10:46:08.050959 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.050932    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 04 10:46:08.051045 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.050996    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 10:46:08.051299 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.051281    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 10:46:08.052112 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.052092    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 04 10:46:08.052977 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.052955    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8s9wk\""
Aug 04 10:46:08.053295 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.053275    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw"]
Aug 04 10:46:08.104298 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.104271    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e0256a1-1ff1-460f-bd51-893049655ec4-tmp\") pod \"kube-auth-proxy-6bc4f665b9-m8crw\" (UID: \"7e0256a1-1ff1-460f-bd51-893049655ec4\") " pod="openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw"
Aug 04 10:46:08.104394 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.104307    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0256a1-1ff1-460f-bd51-893049655ec4-tls-certs\") pod \"kube-auth-proxy-6bc4f665b9-m8crw\" (UID: \"7e0256a1-1ff1-460f-bd51-893049655ec4\") " pod="openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw"
Aug 04 10:46:08.104394 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.104328    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nwqw\" (UniqueName: \"kubernetes.io/projected/7e0256a1-1ff1-460f-bd51-893049655ec4-kube-api-access-7nwqw\") pod \"kube-auth-proxy-6bc4f665b9-m8crw\" (UID: \"7e0256a1-1ff1-460f-bd51-893049655ec4\") " pod="openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw"
Aug 04 10:46:08.205130 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.205089    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nwqw\" (UniqueName: \"kubernetes.io/projected/7e0256a1-1ff1-460f-bd51-893049655ec4-kube-api-access-7nwqw\") pod \"kube-auth-proxy-6bc4f665b9-m8crw\" (UID: \"7e0256a1-1ff1-460f-bd51-893049655ec4\") " pod="openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw"
Aug 04 10:46:08.205270 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.205171    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e0256a1-1ff1-460f-bd51-893049655ec4-tmp\") pod \"kube-auth-proxy-6bc4f665b9-m8crw\" (UID: \"7e0256a1-1ff1-460f-bd51-893049655ec4\") " pod="openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw"
Aug 04 10:46:08.205270 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.205222    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0256a1-1ff1-460f-bd51-893049655ec4-tls-certs\") pod \"kube-auth-proxy-6bc4f665b9-m8crw\" (UID: \"7e0256a1-1ff1-460f-bd51-893049655ec4\") " pod="openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw"
Aug 04 10:46:08.205375 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:46:08.205332    2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Aug 04 10:46:08.205425 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:46:08.205405    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e0256a1-1ff1-460f-bd51-893049655ec4-tls-certs podName:7e0256a1-1ff1-460f-bd51-893049655ec4 nodeName:}" failed. No retries permitted until 2026-08-04 10:46:08.705383292 +0000 UTC m=+559.431453606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7e0256a1-1ff1-460f-bd51-893049655ec4-tls-certs") pod "kube-auth-proxy-6bc4f665b9-m8crw" (UID: "7e0256a1-1ff1-460f-bd51-893049655ec4") : secret "kube-auth-proxy-tls" not found
Aug 04 10:46:08.207781 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.207758    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e0256a1-1ff1-460f-bd51-893049655ec4-tmp\") pod \"kube-auth-proxy-6bc4f665b9-m8crw\" (UID: \"7e0256a1-1ff1-460f-bd51-893049655ec4\") " pod="openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw"
Aug 04 10:46:08.216556 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.216537    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nwqw\" (UniqueName: \"kubernetes.io/projected/7e0256a1-1ff1-460f-bd51-893049655ec4-kube-api-access-7nwqw\") pod \"kube-auth-proxy-6bc4f665b9-m8crw\" (UID: \"7e0256a1-1ff1-460f-bd51-893049655ec4\") " pod="openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw"
Aug 04 10:46:08.709654 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.709599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0256a1-1ff1-460f-bd51-893049655ec4-tls-certs\") pod \"kube-auth-proxy-6bc4f665b9-m8crw\" (UID: \"7e0256a1-1ff1-460f-bd51-893049655ec4\") " pod="openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw"
Aug 04 10:46:08.712549 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.712521    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0256a1-1ff1-460f-bd51-893049655ec4-tls-certs\") pod \"kube-auth-proxy-6bc4f665b9-m8crw\" (UID: \"7e0256a1-1ff1-460f-bd51-893049655ec4\") " pod="openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw"
Aug 04 10:46:08.959792 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:08.959715    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw"
Aug 04 10:46:09.092628 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.092600    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw"]
Aug 04 10:46:09.096055 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:46:09.096032    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0256a1_1ff1_460f_bd51_893049655ec4.slice/crio-4e44db9d90ad8a56e2e342e0c78a3d3ce26b1ba812d8209e195870c02b2fdf68 WatchSource:0}: Error finding container 4e44db9d90ad8a56e2e342e0c78a3d3ce26b1ba812d8209e195870c02b2fdf68: Status 404 returned error can't find the container with id 4e44db9d90ad8a56e2e342e0c78a3d3ce26b1ba812d8209e195870c02b2fdf68
Aug 04 10:46:09.227445 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.227380    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cpnxc"]
Aug 04 10:46:09.233009 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.232985    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cpnxc"
Aug 04 10:46:09.235509 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.235490    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-sq5xz\""
Aug 04 10:46:09.235763 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.235746    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Aug 04 10:46:09.248289 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.248270    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cpnxc"]
Aug 04 10:46:09.315066 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.315038    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zjf7\" (UniqueName: \"kubernetes.io/projected/041462fc-fd0f-4d96-b002-8a53f4ab4543-kube-api-access-6zjf7\") pod \"model-serving-api-54d89bd5fc-cpnxc\" (UID: \"041462fc-fd0f-4d96-b002-8a53f4ab4543\") " pod="opendatahub/model-serving-api-54d89bd5fc-cpnxc"
Aug 04 10:46:09.315178 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.315085    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/041462fc-fd0f-4d96-b002-8a53f4ab4543-tls-certs\") pod \"model-serving-api-54d89bd5fc-cpnxc\" (UID: \"041462fc-fd0f-4d96-b002-8a53f4ab4543\") " pod="opendatahub/model-serving-api-54d89bd5fc-cpnxc"
Aug 04 10:46:09.415774 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.415746    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/041462fc-fd0f-4d96-b002-8a53f4ab4543-tls-certs\") pod \"model-serving-api-54d89bd5fc-cpnxc\" (UID: \"041462fc-fd0f-4d96-b002-8a53f4ab4543\") " pod="opendatahub/model-serving-api-54d89bd5fc-cpnxc"
Aug 04 10:46:09.415931 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.415790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zjf7\" (UniqueName: \"kubernetes.io/projected/041462fc-fd0f-4d96-b002-8a53f4ab4543-kube-api-access-6zjf7\") pod \"model-serving-api-54d89bd5fc-cpnxc\" (UID: \"041462fc-fd0f-4d96-b002-8a53f4ab4543\") " pod="opendatahub/model-serving-api-54d89bd5fc-cpnxc"
Aug 04 10:46:09.415931 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:46:09.415897    2559 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Aug 04 10:46:09.416090 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:46:09.415968    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/041462fc-fd0f-4d96-b002-8a53f4ab4543-tls-certs podName:041462fc-fd0f-4d96-b002-8a53f4ab4543 nodeName:}" failed. No retries permitted until 2026-08-04 10:46:09.915944992 +0000 UTC m=+560.642015307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/041462fc-fd0f-4d96-b002-8a53f4ab4543-tls-certs") pod "model-serving-api-54d89bd5fc-cpnxc" (UID: "041462fc-fd0f-4d96-b002-8a53f4ab4543") : secret "model-serving-api-tls" not found
Aug 04 10:46:09.430343 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.430318    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zjf7\" (UniqueName: \"kubernetes.io/projected/041462fc-fd0f-4d96-b002-8a53f4ab4543-kube-api-access-6zjf7\") pod \"model-serving-api-54d89bd5fc-cpnxc\" (UID: \"041462fc-fd0f-4d96-b002-8a53f4ab4543\") " pod="opendatahub/model-serving-api-54d89bd5fc-cpnxc"
Aug 04 10:46:09.465943 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.465918    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"]
Aug 04 10:46:09.469048 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.469034    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.473061 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.473045    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 04 10:46:09.473319 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.473307    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nlh6b\""
Aug 04 10:46:09.473540 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.473527    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 04 10:46:09.473672 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.473653    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 04 10:46:09.475514 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.475437    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 10:46:09.502245 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.502181    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"]
Aug 04 10:46:09.516401 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.516381    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/012041ef-b00f-4198-83c9-f319866bf39d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.516496 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.516417    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm4vn\" (UniqueName: \"kubernetes.io/projected/012041ef-b00f-4198-83c9-f319866bf39d-kube-api-access-vm4vn\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.516543 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.516491    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/012041ef-b00f-4198-83c9-f319866bf39d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.516581 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.516543    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/012041ef-b00f-4198-83c9-f319866bf39d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.516633 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.516612    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.516705 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.516673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.516754 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.516705    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.612328 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.612290    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw" event={"ID":"7e0256a1-1ff1-460f-bd51-893049655ec4","Type":"ContainerStarted","Data":"4e44db9d90ad8a56e2e342e0c78a3d3ce26b1ba812d8209e195870c02b2fdf68"}
Aug 04 10:46:09.617963 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.617935    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/012041ef-b00f-4198-83c9-f319866bf39d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.618110 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.617976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm4vn\" (UniqueName: \"kubernetes.io/projected/012041ef-b00f-4198-83c9-f319866bf39d-kube-api-access-vm4vn\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.618110 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.618022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/012041ef-b00f-4198-83c9-f319866bf39d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.618110 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.618066    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/012041ef-b00f-4198-83c9-f319866bf39d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.618317 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.618113    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.618317 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.618139    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.618317 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.618167    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.619087 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.619042    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/012041ef-b00f-4198-83c9-f319866bf39d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.621938 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.621492    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.621938 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.621824    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.622197 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.622178    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/012041ef-b00f-4198-83c9-f319866bf39d-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.622263 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.622205    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.635177 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.635147    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm4vn\" (UniqueName: \"kubernetes.io/projected/012041ef-b00f-4198-83c9-f319866bf39d-kube-api-access-vm4vn\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.635343 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.635323    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/012041ef-b00f-4198-83c9-f319866bf39d-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-26n45\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.778727 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.778652    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:09.920532 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.920499    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/041462fc-fd0f-4d96-b002-8a53f4ab4543-tls-certs\") pod \"model-serving-api-54d89bd5fc-cpnxc\" (UID: \"041462fc-fd0f-4d96-b002-8a53f4ab4543\") " pod="opendatahub/model-serving-api-54d89bd5fc-cpnxc"
Aug 04 10:46:09.923441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.923413    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/041462fc-fd0f-4d96-b002-8a53f4ab4543-tls-certs\") pod \"model-serving-api-54d89bd5fc-cpnxc\" (UID: \"041462fc-fd0f-4d96-b002-8a53f4ab4543\") " pod="opendatahub/model-serving-api-54d89bd5fc-cpnxc"
Aug 04 10:46:09.937263 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:09.937236    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"]
Aug 04 10:46:09.940514 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:46:09.940482    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012041ef_b00f_4198_83c9_f319866bf39d.slice/crio-ca12b2b81fddd6de54c5c2dbdd844892ec9bc176fff0f8bec2b36ce4ede1eace WatchSource:0}: Error finding container ca12b2b81fddd6de54c5c2dbdd844892ec9bc176fff0f8bec2b36ce4ede1eace: Status 404 returned error can't find the container with id ca12b2b81fddd6de54c5c2dbdd844892ec9bc176fff0f8bec2b36ce4ede1eace
Aug 04 10:46:10.142704 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:10.142674    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cpnxc"
Aug 04 10:46:10.336942 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:10.336914    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cpnxc"]
Aug 04 10:46:10.618446 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:10.618405    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45" event={"ID":"012041ef-b00f-4198-83c9-f319866bf39d","Type":"ContainerStarted","Data":"ca12b2b81fddd6de54c5c2dbdd844892ec9bc176fff0f8bec2b36ce4ede1eace"}
Aug 04 10:46:11.005496 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:46:11.005427    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041462fc_fd0f_4d96_b002_8a53f4ab4543.slice/crio-a83eea6d7822170945de80b82012e33af926b91e8c3009051a2f434d964f79f0 WatchSource:0}: Error finding container a83eea6d7822170945de80b82012e33af926b91e8c3009051a2f434d964f79f0: Status 404 returned error can't find the container with id a83eea6d7822170945de80b82012e33af926b91e8c3009051a2f434d964f79f0
Aug 04 10:46:11.628199 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:11.628154    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cpnxc" event={"ID":"041462fc-fd0f-4d96-b002-8a53f4ab4543","Type":"ContainerStarted","Data":"a83eea6d7822170945de80b82012e33af926b91e8c3009051a2f434d964f79f0"}
Aug 04 10:46:12.634126 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:12.634083    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw" event={"ID":"7e0256a1-1ff1-460f-bd51-893049655ec4","Type":"ContainerStarted","Data":"fe6b0d63df90ad4ec02b3e1829ac2fc685d8fca6a50c064b30fe1d940a5ca9aa"}
Aug 04 10:46:12.650681 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:12.650608    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6bc4f665b9-m8crw" podStartSLOduration=2.025747879 podStartE2EDuration="4.650590915s" totalImagesPullingTime="2.624843036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:46:12.650234287 +0000 UTC m=+563.376304620" watchObservedRunningTime="2026-08-04 10:46:12.650590915 +0000 UTC m=+563.376661250"
Aug 04 10:46:13.640442 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:13.640405    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cpnxc" event={"ID":"041462fc-fd0f-4d96-b002-8a53f4ab4543","Type":"ContainerStarted","Data":"920aeb3d7d65373bc7283d58843a264c2aea71e95c328d8b07b576e1bbc1111e"}
Aug 04 10:46:13.640901 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:13.640583    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-cpnxc"
Aug 04 10:46:13.659749 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:13.659698    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-cpnxc" podStartSLOduration=2.831283833 podStartE2EDuration="4.659683906s" totalImagesPullingTime="1.828400073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:46:13.657859328 +0000 UTC m=+564.383929663" watchObservedRunningTime="2026-08-04 10:46:13.659683906 +0000 UTC m=+564.385754239"
Aug 04 10:46:15.207129 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:15.207089    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 10:46:15.207418 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:15.207162    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 10:46:15.650197 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:15.650166    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45" event={"ID":"012041ef-b00f-4198-83c9-f319866bf39d","Type":"ContainerStarted","Data":"5d2cd29a4221a260581bc3980ba4a217a981473827f2e80eb1f37caef8a0ef74"}
Aug 04 10:46:15.650356 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:15.650267    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:15.676058 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:15.676017    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45" podStartSLOduration=1.412320016 podStartE2EDuration="6.676003421s" totalImagesPullingTime="5.263683405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:46:15.674570485 +0000 UTC m=+566.400640812" watchObservedRunningTime="2026-08-04 10:46:15.676003421 +0000 UTC m=+566.402073754"
Aug 04 10:46:16.655719 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.655684    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-26n45 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 10:46:16.656133 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.655742    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45" podUID="012041ef-b00f-4198-83c9-f319866bf39d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 10:46:16.717543 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.717508    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"]
Aug 04 10:46:16.720683 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.720665    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.726169 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.726148    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gtsc5\""
Aug 04 10:46:16.760775 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.760750    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"]
Aug 04 10:46:16.777600 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.777581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.777714 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.777607    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8kxx\" (UniqueName: \"kubernetes.io/projected/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-kube-api-access-k8kxx\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.777714 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.777662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.777822 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.777712    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.777822 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.777746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.777822 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.777783    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.777949 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.777935    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.778002 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.777988    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.778058 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.778023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.879245 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.879211    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.879362 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.879260    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.879362 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.879285    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.879362 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.879321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.879511 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.879431    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8kxx\" (UniqueName: \"kubernetes.io/projected/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-kube-api-access-k8kxx\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.879511 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.879468    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.879511 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.879491    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.879670 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.879518    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.879670 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.879567    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.879774 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.879732    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.879965 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.879939    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.880081 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.880061    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.880136 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.880095    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.880230 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.880214    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.882180 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.882160    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.882322 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.882304    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.901100 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.901074    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8kxx\" (UniqueName: \"kubernetes.io/projected/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-kube-api-access-k8kxx\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:16.901207 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:16.901169    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e26b8e41-0ff1-4de7-adc6-ad7c5d00c864-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799chpnsm\" (UID: \"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:17.029865 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:17.029810    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:17.164628 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:17.164546    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"]
Aug 04 10:46:17.166499 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:46:17.166473    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode26b8e41_0ff1_4de7_adc6_ad7c5d00c864.slice/crio-ba6306a2ef43d2786c974767e647e904cf4e0c75c4fcc16a00a0d5c212392b0d WatchSource:0}: Error finding container ba6306a2ef43d2786c974767e647e904cf4e0c75c4fcc16a00a0d5c212392b0d: Status 404 returned error can't find the container with id ba6306a2ef43d2786c974767e647e904cf4e0c75c4fcc16a00a0d5c212392b0d
Aug 04 10:46:17.657763 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:17.657729    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm" event={"ID":"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864","Type":"ContainerStarted","Data":"ba6306a2ef43d2786c974767e647e904cf4e0c75c4fcc16a00a0d5c212392b0d"}
Aug 04 10:46:19.228689 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.228656    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-f59h8"]
Aug 04 10:46:19.233827 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.233789    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f59h8"
Aug 04 10:46:19.239781 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.239574    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7qn79\""
Aug 04 10:46:19.240721 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.240697    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d"]
Aug 04 10:46:19.243416 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.243251    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Aug 04 10:46:19.246431 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.246413    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-f59h8"]
Aug 04 10:46:19.246534 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.246514    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d"
Aug 04 10:46:19.250244 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.250225    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Aug 04 10:46:19.250349 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.250282    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-bbb5n\""
Aug 04 10:46:19.263494 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.263469    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d"]
Aug 04 10:46:19.298467 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.298445    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/583fa4ff-d003-4d57-8455-7a43b4b438de-cert\") pod \"kserve-controller-manager-d6f4b65b8-f59h8\" (UID: \"583fa4ff-d003-4d57-8455-7a43b4b438de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f59h8"
Aug 04 10:46:19.298598 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.298476    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf7jf\" (UniqueName: \"kubernetes.io/projected/583fa4ff-d003-4d57-8455-7a43b4b438de-kube-api-access-vf7jf\") pod \"kserve-controller-manager-d6f4b65b8-f59h8\" (UID: \"583fa4ff-d003-4d57-8455-7a43b4b438de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f59h8"
Aug 04 10:46:19.298598 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.298561    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db00b9e4-c36b-4320-919f-34445e05559a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5f49d\" (UID: \"db00b9e4-c36b-4320-919f-34445e05559a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d"
Aug 04 10:46:19.298730 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.298605    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2trh\" (UniqueName: \"kubernetes.io/projected/db00b9e4-c36b-4320-919f-34445e05559a-kube-api-access-j2trh\") pod \"llmisvc-controller-manager-777c6bd7d5-5f49d\" (UID: \"db00b9e4-c36b-4320-919f-34445e05559a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d"
Aug 04 10:46:19.399342 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.399311    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/583fa4ff-d003-4d57-8455-7a43b4b438de-cert\") pod \"kserve-controller-manager-d6f4b65b8-f59h8\" (UID: \"583fa4ff-d003-4d57-8455-7a43b4b438de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f59h8"
Aug 04 10:46:19.399517 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.399352    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf7jf\" (UniqueName: \"kubernetes.io/projected/583fa4ff-d003-4d57-8455-7a43b4b438de-kube-api-access-vf7jf\") pod \"kserve-controller-manager-d6f4b65b8-f59h8\" (UID: \"583fa4ff-d003-4d57-8455-7a43b4b438de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f59h8"
Aug 04 10:46:19.399517 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:46:19.399491    2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Aug 04 10:46:19.399517 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.399502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db00b9e4-c36b-4320-919f-34445e05559a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5f49d\" (UID: \"db00b9e4-c36b-4320-919f-34445e05559a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d"
Aug 04 10:46:19.399837 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:46:19.399556    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/583fa4ff-d003-4d57-8455-7a43b4b438de-cert podName:583fa4ff-d003-4d57-8455-7a43b4b438de nodeName:}" failed. No retries permitted until 2026-08-04 10:46:19.899536042 +0000 UTC m=+570.625606354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/583fa4ff-d003-4d57-8455-7a43b4b438de-cert") pod "kserve-controller-manager-d6f4b65b8-f59h8" (UID: "583fa4ff-d003-4d57-8455-7a43b4b438de") : secret "kserve-webhook-server-cert" not found
Aug 04 10:46:19.399837 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.399574    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2trh\" (UniqueName: \"kubernetes.io/projected/db00b9e4-c36b-4320-919f-34445e05559a-kube-api-access-j2trh\") pod \"llmisvc-controller-manager-777c6bd7d5-5f49d\" (UID: \"db00b9e4-c36b-4320-919f-34445e05559a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d"
Aug 04 10:46:19.399837 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:46:19.399595    2559 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Aug 04 10:46:19.399837 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:46:19.399628    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db00b9e4-c36b-4320-919f-34445e05559a-cert podName:db00b9e4-c36b-4320-919f-34445e05559a nodeName:}" failed. No retries permitted until 2026-08-04 10:46:19.899617756 +0000 UTC m=+570.625688068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/db00b9e4-c36b-4320-919f-34445e05559a-cert") pod "llmisvc-controller-manager-777c6bd7d5-5f49d" (UID: "db00b9e4-c36b-4320-919f-34445e05559a") : secret "llmisvc-webhook-server-cert" not found
Aug 04 10:46:19.411452 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.411431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf7jf\" (UniqueName: \"kubernetes.io/projected/583fa4ff-d003-4d57-8455-7a43b4b438de-kube-api-access-vf7jf\") pod \"kserve-controller-manager-d6f4b65b8-f59h8\" (UID: \"583fa4ff-d003-4d57-8455-7a43b4b438de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f59h8"
Aug 04 10:46:19.412457 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.412432    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2trh\" (UniqueName: \"kubernetes.io/projected/db00b9e4-c36b-4320-919f-34445e05559a-kube-api-access-j2trh\") pod \"llmisvc-controller-manager-777c6bd7d5-5f49d\" (UID: \"db00b9e4-c36b-4320-919f-34445e05559a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d"
Aug 04 10:46:19.654506 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.654474    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:19.904576 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.904498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/583fa4ff-d003-4d57-8455-7a43b4b438de-cert\") pod \"kserve-controller-manager-d6f4b65b8-f59h8\" (UID: \"583fa4ff-d003-4d57-8455-7a43b4b438de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f59h8"
Aug 04 10:46:19.904768 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.904576    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db00b9e4-c36b-4320-919f-34445e05559a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5f49d\" (UID: \"db00b9e4-c36b-4320-919f-34445e05559a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d"
Aug 04 10:46:19.907441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.907414    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db00b9e4-c36b-4320-919f-34445e05559a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5f49d\" (UID: \"db00b9e4-c36b-4320-919f-34445e05559a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d"
Aug 04 10:46:19.907587 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:19.907441    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/583fa4ff-d003-4d57-8455-7a43b4b438de-cert\") pod \"kserve-controller-manager-d6f4b65b8-f59h8\" (UID: \"583fa4ff-d003-4d57-8455-7a43b4b438de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f59h8"
Aug 04 10:46:20.147732 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.147701    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f59h8"
Aug 04 10:46:20.157177 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.157124    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d"
Aug 04 10:46:20.196727 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.196202    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"]
Aug 04 10:46:20.196727 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.196421    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45" podUID="012041ef-b00f-4198-83c9-f319866bf39d" containerName="discovery" containerID="cri-o://5d2cd29a4221a260581bc3980ba4a217a981473827f2e80eb1f37caef8a0ef74" gracePeriod=30
Aug 04 10:46:20.231170 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.231123    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 10:46:20.231517 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.231218    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 10:46:20.231517 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.231263    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 10:46:20.334751 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.334623    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d"]
Aug 04 10:46:20.337881 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:46:20.337853    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddb00b9e4_c36b_4320_919f_34445e05559a.slice/crio-fb1d17c86b636bf57af8dc888692969ae91460c0b30a7a6cd916ac4edbfd1218 WatchSource:0}: Error finding container fb1d17c86b636bf57af8dc888692969ae91460c0b30a7a6cd916ac4edbfd1218: Status 404 returned error can't find the container with id fb1d17c86b636bf57af8dc888692969ae91460c0b30a7a6cd916ac4edbfd1218
Aug 04 10:46:20.376913 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.376858    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-f59h8"]
Aug 04 10:46:20.387953 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:46:20.387930    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod583fa4ff_d003_4d57_8455_7a43b4b438de.slice/crio-a5ff84919ee271ead293d976e87b88b1aeaa3f8586e698e27022a00b3ba1b0f7 WatchSource:0}: Error finding container a5ff84919ee271ead293d976e87b88b1aeaa3f8586e698e27022a00b3ba1b0f7: Status 404 returned error can't find the container with id a5ff84919ee271ead293d976e87b88b1aeaa3f8586e698e27022a00b3ba1b0f7
Aug 04 10:46:20.449432 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.449408    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:20.509347 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.509315    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm4vn\" (UniqueName: \"kubernetes.io/projected/012041ef-b00f-4198-83c9-f319866bf39d-kube-api-access-vm4vn\") pod \"012041ef-b00f-4198-83c9-f319866bf39d\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") "
Aug 04 10:46:20.509347 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.509346    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-istio-kubeconfig\") pod \"012041ef-b00f-4198-83c9-f319866bf39d\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") "
Aug 04 10:46:20.510239 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.509390    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/012041ef-b00f-4198-83c9-f319866bf39d-istio-token\") pod \"012041ef-b00f-4198-83c9-f319866bf39d\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") "
Aug 04 10:46:20.510239 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.509418    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/012041ef-b00f-4198-83c9-f319866bf39d-istio-csr-ca-configmap\") pod \"012041ef-b00f-4198-83c9-f319866bf39d\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") "
Aug 04 10:46:20.510239 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.509444    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/012041ef-b00f-4198-83c9-f319866bf39d-local-certs\") pod \"012041ef-b00f-4198-83c9-f319866bf39d\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") "
Aug 04 10:46:20.510239 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.509475    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-istio-csr-dns-cert\") pod \"012041ef-b00f-4198-83c9-f319866bf39d\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") "
Aug 04 10:46:20.510239 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.509500    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-cacerts\") pod \"012041ef-b00f-4198-83c9-f319866bf39d\" (UID: \"012041ef-b00f-4198-83c9-f319866bf39d\") "
Aug 04 10:46:20.510239 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.509906    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/012041ef-b00f-4198-83c9-f319866bf39d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "012041ef-b00f-4198-83c9-f319866bf39d" (UID: "012041ef-b00f-4198-83c9-f319866bf39d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 10:46:20.512358 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.512331    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/012041ef-b00f-4198-83c9-f319866bf39d-istio-token" (OuterVolumeSpecName: "istio-token") pod "012041ef-b00f-4198-83c9-f319866bf39d" (UID: "012041ef-b00f-4198-83c9-f319866bf39d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:46:20.512517 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.512494    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "012041ef-b00f-4198-83c9-f319866bf39d" (UID: "012041ef-b00f-4198-83c9-f319866bf39d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:46:20.513036 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.513009    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-cacerts" (OuterVolumeSpecName: "cacerts") pod "012041ef-b00f-4198-83c9-f319866bf39d" (UID: "012041ef-b00f-4198-83c9-f319866bf39d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:46:20.513143 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.513103    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/012041ef-b00f-4198-83c9-f319866bf39d-kube-api-access-vm4vn" (OuterVolumeSpecName: "kube-api-access-vm4vn") pod "012041ef-b00f-4198-83c9-f319866bf39d" (UID: "012041ef-b00f-4198-83c9-f319866bf39d"). InnerVolumeSpecName "kube-api-access-vm4vn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:46:20.513588 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.513556    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "012041ef-b00f-4198-83c9-f319866bf39d" (UID: "012041ef-b00f-4198-83c9-f319866bf39d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:46:20.513588 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.513556    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/012041ef-b00f-4198-83c9-f319866bf39d-local-certs" (OuterVolumeSpecName: "local-certs") pod "012041ef-b00f-4198-83c9-f319866bf39d" (UID: "012041ef-b00f-4198-83c9-f319866bf39d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:46:20.610164 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.610131    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/012041ef-b00f-4198-83c9-f319866bf39d-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:46:20.610164 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.610164    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/012041ef-b00f-4198-83c9-f319866bf39d-istio-csr-ca-configmap\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:46:20.610331 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.610180    2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/012041ef-b00f-4198-83c9-f319866bf39d-local-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:46:20.610331 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.610192    2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-istio-csr-dns-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:46:20.610331 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.610206    2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-cacerts\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:46:20.610331 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.610219    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm4vn\" (UniqueName: \"kubernetes.io/projected/012041ef-b00f-4198-83c9-f319866bf39d-kube-api-access-vm4vn\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:46:20.610331 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.610233    2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/012041ef-b00f-4198-83c9-f319866bf39d-istio-kubeconfig\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:46:20.677076 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.676993    2559 generic.go:356] "Generic (PLEG): container finished" podID="012041ef-b00f-4198-83c9-f319866bf39d" containerID="5d2cd29a4221a260581bc3980ba4a217a981473827f2e80eb1f37caef8a0ef74" exitCode=0
Aug 04 10:46:20.677076 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.677037    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"
Aug 04 10:46:20.677279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.677077    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45" event={"ID":"012041ef-b00f-4198-83c9-f319866bf39d","Type":"ContainerDied","Data":"5d2cd29a4221a260581bc3980ba4a217a981473827f2e80eb1f37caef8a0ef74"}
Aug 04 10:46:20.677279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.677128    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45" event={"ID":"012041ef-b00f-4198-83c9-f319866bf39d","Type":"ContainerDied","Data":"ca12b2b81fddd6de54c5c2dbdd844892ec9bc176fff0f8bec2b36ce4ede1eace"}
Aug 04 10:46:20.677279 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.677154    2559 scope.go:117] "RemoveContainer" containerID="5d2cd29a4221a260581bc3980ba4a217a981473827f2e80eb1f37caef8a0ef74"
Aug 04 10:46:20.679217 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.679182    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm" event={"ID":"e26b8e41-0ff1-4de7-adc6-ad7c5d00c864","Type":"ContainerStarted","Data":"3a254075e416780715ccd3c15ebd4e5a5ca9317c22ec732a30530c59b7ae26dc"}
Aug 04 10:46:20.680552 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.680514    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f59h8" event={"ID":"583fa4ff-d003-4d57-8455-7a43b4b438de","Type":"ContainerStarted","Data":"a5ff84919ee271ead293d976e87b88b1aeaa3f8586e698e27022a00b3ba1b0f7"}
Aug 04 10:46:20.681952 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.681927    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d" event={"ID":"db00b9e4-c36b-4320-919f-34445e05559a","Type":"ContainerStarted","Data":"fb1d17c86b636bf57af8dc888692969ae91460c0b30a7a6cd916ac4edbfd1218"}
Aug 04 10:46:20.687604 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.687587    2559 scope.go:117] "RemoveContainer" containerID="5d2cd29a4221a260581bc3980ba4a217a981473827f2e80eb1f37caef8a0ef74"
Aug 04 10:46:20.687865 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:46:20.687843    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d2cd29a4221a260581bc3980ba4a217a981473827f2e80eb1f37caef8a0ef74\": container with ID starting with 5d2cd29a4221a260581bc3980ba4a217a981473827f2e80eb1f37caef8a0ef74 not found: ID does not exist" containerID="5d2cd29a4221a260581bc3980ba4a217a981473827f2e80eb1f37caef8a0ef74"
Aug 04 10:46:20.687948 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.687881    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d2cd29a4221a260581bc3980ba4a217a981473827f2e80eb1f37caef8a0ef74"} err="failed to get container status \"5d2cd29a4221a260581bc3980ba4a217a981473827f2e80eb1f37caef8a0ef74\": rpc error: code = NotFound desc = could not find container \"5d2cd29a4221a260581bc3980ba4a217a981473827f2e80eb1f37caef8a0ef74\": container with ID starting with 5d2cd29a4221a260581bc3980ba4a217a981473827f2e80eb1f37caef8a0ef74 not found: ID does not exist"
Aug 04 10:46:20.711883 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.711839    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm" podStartSLOduration=1.649667456 podStartE2EDuration="4.711825842s" totalImagesPullingTime="3.062158386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:46:20.710910805 +0000 UTC m=+571.436981141" watchObservedRunningTime="2026-08-04 10:46:20.711825842 +0000 UTC m=+571.437896174"
Aug 04 10:46:20.730135 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.730114    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"]
Aug 04 10:46:20.737865 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:20.737846    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-26n45"]
Aug 04 10:46:21.030902 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:21.030837    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:21.032064 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:21.032040    2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused" start-of-body=
Aug 04 10:46:21.032168 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:21.032098    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm" podUID="e26b8e41-0ff1-4de7-adc6-ad7c5d00c864" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.18:15021/healthz/ready\": dial tcp 10.132.0.18:15021: connect: connection refused"
Aug 04 10:46:21.783384 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:21.783313    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="012041ef-b00f-4198-83c9-f319866bf39d" path="/var/lib/kubelet/pods/012041ef-b00f-4198-83c9-f319866bf39d/volumes"
Aug 04 10:46:22.034387 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:22.034320    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:22.699830 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:22.699795    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f59h8" event={"ID":"583fa4ff-d003-4d57-8455-7a43b4b438de","Type":"ContainerStarted","Data":"9b5ce28dc9c922bf7efd690dfbffbebea7a502f13d4716d4f37130a76f763b19"}
Aug 04 10:46:22.700094 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:22.700073    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:22.700165 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:22.700119    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f59h8"
Aug 04 10:46:22.701115 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:22.701093    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799chpnsm"
Aug 04 10:46:22.718938 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:22.718885    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f59h8" podStartSLOduration=1.488210009 podStartE2EDuration="3.718866184s" totalImagesPullingTime="2.230656175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:46:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:46:22.716666809 +0000 UTC m=+573.442737140" watchObservedRunningTime="2026-08-04 10:46:22.718866184 +0000 UTC m=+573.444936522"
Aug 04 10:46:23.704670 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:23.704623    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d" event={"ID":"db00b9e4-c36b-4320-919f-34445e05559a","Type":"ContainerStarted","Data":"9d67fb065803c2c285cc756d65951966e9f30f41e61a3c7273823b09012ec966"}
Aug 04 10:46:23.705091 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:23.704784    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d"
Aug 04 10:46:23.722022 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:23.721967    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d" podStartSLOduration=1.756590027 podStartE2EDuration="4.721954381s" totalImagesPullingTime="2.965364354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:46:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:46:23.721001892 +0000 UTC m=+574.447072226" watchObservedRunningTime="2026-08-04 10:46:23.721954381 +0000 UTC m=+574.448024714"
Aug 04 10:46:24.648848 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:24.648818    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-cpnxc"
Aug 04 10:46:53.710621 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:53.710585    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f59h8"
Aug 04 10:46:54.722323 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:46:54.722286    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5f49d"
Aug 04 10:47:23.948908 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:23.948873    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"]
Aug 04 10:47:23.949386 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:23.949290    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="012041ef-b00f-4198-83c9-f319866bf39d" containerName="discovery"
Aug 04 10:47:23.949386 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:23.949308    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="012041ef-b00f-4198-83c9-f319866bf39d" containerName="discovery"
Aug 04 10:47:23.949386 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:23.949358    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="012041ef-b00f-4198-83c9-f319866bf39d" containerName="discovery"
Aug 04 10:47:23.951070 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:23.951055    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"
Aug 04 10:47:23.953507 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:23.953486    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jqnl8\""
Aug 04 10:47:23.953507 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:23.953498    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 10:47:23.954220 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:23.954205    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 10:47:23.965702 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:23.965677    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjhxc\" (UniqueName: \"kubernetes.io/projected/5cb3475f-8585-44db-918b-66d48610e159-kube-api-access-hjhxc\") pod \"limitador-operator-controller-manager-6c549b6d85-d5bpp\" (UID: \"5cb3475f-8585-44db-918b-66d48610e159\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"
Aug 04 10:47:23.967605 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:23.967583    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"]
Aug 04 10:47:24.066342 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:24.066303    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjhxc\" (UniqueName: \"kubernetes.io/projected/5cb3475f-8585-44db-918b-66d48610e159-kube-api-access-hjhxc\") pod \"limitador-operator-controller-manager-6c549b6d85-d5bpp\" (UID: \"5cb3475f-8585-44db-918b-66d48610e159\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"
Aug 04 10:47:24.082201 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:24.082177    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjhxc\" (UniqueName: \"kubernetes.io/projected/5cb3475f-8585-44db-918b-66d48610e159-kube-api-access-hjhxc\") pod \"limitador-operator-controller-manager-6c549b6d85-d5bpp\" (UID: \"5cb3475f-8585-44db-918b-66d48610e159\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"
Aug 04 10:47:24.261089 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:24.260997    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"
Aug 04 10:47:24.424184 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:24.424040    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"]
Aug 04 10:47:24.427754 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:47:24.427711    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb3475f_8585_44db_918b_66d48610e159.slice/crio-aa43a80c9f55b8d55c1214ed0b4c7753dac7c2c68bc785cbc3bfeb4a992ec241 WatchSource:0}: Error finding container aa43a80c9f55b8d55c1214ed0b4c7753dac7c2c68bc785cbc3bfeb4a992ec241: Status 404 returned error can't find the container with id aa43a80c9f55b8d55c1214ed0b4c7753dac7c2c68bc785cbc3bfeb4a992ec241
Aug 04 10:47:24.932451 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:24.932408    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp" event={"ID":"5cb3475f-8585-44db-918b-66d48610e159","Type":"ContainerStarted","Data":"aa43a80c9f55b8d55c1214ed0b4c7753dac7c2c68bc785cbc3bfeb4a992ec241"}
Aug 04 10:47:27.949147 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:27.949111    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp" event={"ID":"5cb3475f-8585-44db-918b-66d48610e159","Type":"ContainerStarted","Data":"5594c1f0c4caafc807a3e4ef4ca00a2e0c54b29dd6a84ad86dcd2e12764355e3"}
Aug 04 10:47:27.949546 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:27.949247    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"
Aug 04 10:47:27.989225 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:27.989171    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp" podStartSLOduration=2.411911571 podStartE2EDuration="4.989151701s" totalImagesPullingTime="2.57724013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:47:27.987312733 +0000 UTC m=+638.713383068" watchObservedRunningTime="2026-08-04 10:47:27.989151701 +0000 UTC m=+638.715222035"
Aug 04 10:47:28.241099 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:28.241028    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"]
Aug 04 10:47:28.244208 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:28.244193    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:28.247102 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:28.247080    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8gnsq\""
Aug 04 10:47:28.264138 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:28.264111    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"]
Aug 04 10:47:28.296974 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:28.296943    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7xhp\" (UniqueName: \"kubernetes.io/projected/6a749fcb-6fcf-4453-8f50-2a3d58629823-kube-api-access-w7xhp\") pod \"kuadrant-operator-controller-manager-58fc56757c-vtcq9\" (UID: \"6a749fcb-6fcf-4453-8f50-2a3d58629823\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:28.297149 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:28.296991    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a749fcb-6fcf-4453-8f50-2a3d58629823-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vtcq9\" (UID: \"6a749fcb-6fcf-4453-8f50-2a3d58629823\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:28.397491 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:28.397455    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7xhp\" (UniqueName: \"kubernetes.io/projected/6a749fcb-6fcf-4453-8f50-2a3d58629823-kube-api-access-w7xhp\") pod \"kuadrant-operator-controller-manager-58fc56757c-vtcq9\" (UID: \"6a749fcb-6fcf-4453-8f50-2a3d58629823\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:28.397676 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:28.397503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a749fcb-6fcf-4453-8f50-2a3d58629823-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vtcq9\" (UID: \"6a749fcb-6fcf-4453-8f50-2a3d58629823\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:28.397929 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:28.397911    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a749fcb-6fcf-4453-8f50-2a3d58629823-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vtcq9\" (UID: \"6a749fcb-6fcf-4453-8f50-2a3d58629823\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:28.407876 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:28.407844    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7xhp\" (UniqueName: \"kubernetes.io/projected/6a749fcb-6fcf-4453-8f50-2a3d58629823-kube-api-access-w7xhp\") pod \"kuadrant-operator-controller-manager-58fc56757c-vtcq9\" (UID: \"6a749fcb-6fcf-4453-8f50-2a3d58629823\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:28.554401 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:28.554317    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:28.710018 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:28.709991    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"]
Aug 04 10:47:28.712792 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:47:28.712766    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a749fcb_6fcf_4453_8f50_2a3d58629823.slice/crio-a2b2c571b7512d8aedbddd4449bcc26ee5fc42a3216c0fa084d630c17d504479 WatchSource:0}: Error finding container a2b2c571b7512d8aedbddd4449bcc26ee5fc42a3216c0fa084d630c17d504479: Status 404 returned error can't find the container with id a2b2c571b7512d8aedbddd4449bcc26ee5fc42a3216c0fa084d630c17d504479
Aug 04 10:47:28.954441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:28.954404    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9" event={"ID":"6a749fcb-6fcf-4453-8f50-2a3d58629823","Type":"ContainerStarted","Data":"a2b2c571b7512d8aedbddd4449bcc26ee5fc42a3216c0fa084d630c17d504479"}
Aug 04 10:47:30.706929 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:30.706898    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-2cngp"]
Aug 04 10:47:30.710299 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:30.710280    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-2cngp"
Aug 04 10:47:30.713522 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:30.713492    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gbrqw\""
Aug 04 10:47:30.715253 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:30.715213    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtnr5\" (UniqueName: \"kubernetes.io/projected/5f78925b-9a46-44c6-bb27-ab49bba636a9-kube-api-access-jtnr5\") pod \"authorino-operator-68d88948d8-2cngp\" (UID: \"5f78925b-9a46-44c6-bb27-ab49bba636a9\") " pod="kuadrant-system/authorino-operator-68d88948d8-2cngp"
Aug 04 10:47:30.730319 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:30.730295    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-2cngp"]
Aug 04 10:47:30.816267 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:30.816226    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtnr5\" (UniqueName: \"kubernetes.io/projected/5f78925b-9a46-44c6-bb27-ab49bba636a9-kube-api-access-jtnr5\") pod \"authorino-operator-68d88948d8-2cngp\" (UID: \"5f78925b-9a46-44c6-bb27-ab49bba636a9\") " pod="kuadrant-system/authorino-operator-68d88948d8-2cngp"
Aug 04 10:47:30.828943 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:30.828916    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtnr5\" (UniqueName: \"kubernetes.io/projected/5f78925b-9a46-44c6-bb27-ab49bba636a9-kube-api-access-jtnr5\") pod \"authorino-operator-68d88948d8-2cngp\" (UID: \"5f78925b-9a46-44c6-bb27-ab49bba636a9\") " pod="kuadrant-system/authorino-operator-68d88948d8-2cngp"
Aug 04 10:47:31.022627 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:31.022544    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-2cngp"
Aug 04 10:47:31.179529 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:31.179502    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-2cngp"]
Aug 04 10:47:31.182251 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:47:31.182218    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f78925b_9a46_44c6_bb27_ab49bba636a9.slice/crio-7a2063a6b3e64f3f0f6d617808eb6d1a2f3a94901790b5e2a1395f5c176f63d9 WatchSource:0}: Error finding container 7a2063a6b3e64f3f0f6d617808eb6d1a2f3a94901790b5e2a1395f5c176f63d9: Status 404 returned error can't find the container with id 7a2063a6b3e64f3f0f6d617808eb6d1a2f3a94901790b5e2a1395f5c176f63d9
Aug 04 10:47:31.973144 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:31.973097    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-2cngp" event={"ID":"5f78925b-9a46-44c6-bb27-ab49bba636a9","Type":"ContainerStarted","Data":"7a2063a6b3e64f3f0f6d617808eb6d1a2f3a94901790b5e2a1395f5c176f63d9"}
Aug 04 10:47:33.984688 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:33.984583    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9" event={"ID":"6a749fcb-6fcf-4453-8f50-2a3d58629823","Type":"ContainerStarted","Data":"3213fc627b11a78eb8e8350477e13b8ac5609c5be6c5d6734675967a61f3876f"}
Aug 04 10:47:33.985093 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:33.984746    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:33.986296 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:33.986272    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-2cngp" event={"ID":"5f78925b-9a46-44c6-bb27-ab49bba636a9","Type":"ContainerStarted","Data":"3cef9a9c2ebb69d8970e8378fa39783b3d16fddfe2036874f62536d977b22431"}
Aug 04 10:47:33.986443 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:33.986392    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-2cngp"
Aug 04 10:47:34.011357 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:34.011311    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9" podStartSLOduration=1.02309104 podStartE2EDuration="6.011297267s" totalImagesPullingTime="4.988206227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:47:34.009057479 +0000 UTC m=+644.735127835" watchObservedRunningTime="2026-08-04 10:47:34.011297267 +0000 UTC m=+644.737367608"
Aug 04 10:47:34.041467 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:34.041423    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-2cngp" podStartSLOduration=1.532626636 podStartE2EDuration="4.041410399s" totalImagesPullingTime="2.508783763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:47:34.040797416 +0000 UTC m=+644.766867751" watchObservedRunningTime="2026-08-04 10:47:34.041410399 +0000 UTC m=+644.767480733"
Aug 04 10:47:36.569996 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.569963    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m"]
Aug 04 10:47:36.573263 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.573240    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m"
Aug 04 10:47:36.575894 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.575871    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Aug 04 10:47:36.576004 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.575926    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-56r9c\""
Aug 04 10:47:36.576118 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.576105    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Aug 04 10:47:36.590229 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.590207    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m"]
Aug 04 10:47:36.658043 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.658004    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dec9e228-29b2-4655-93dd-795cd63dacd4-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-8bb7m\" (UID: \"dec9e228-29b2-4655-93dd-795cd63dacd4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m"
Aug 04 10:47:36.658185 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.658073    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dec9e228-29b2-4655-93dd-795cd63dacd4-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-8bb7m\" (UID: \"dec9e228-29b2-4655-93dd-795cd63dacd4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m"
Aug 04 10:47:36.658185 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.658163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvskt\" (UniqueName: \"kubernetes.io/projected/dec9e228-29b2-4655-93dd-795cd63dacd4-kube-api-access-qvskt\") pod \"kuadrant-console-plugin-598f86468b-8bb7m\" (UID: \"dec9e228-29b2-4655-93dd-795cd63dacd4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m"
Aug 04 10:47:36.759335 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.759307    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dec9e228-29b2-4655-93dd-795cd63dacd4-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-8bb7m\" (UID: \"dec9e228-29b2-4655-93dd-795cd63dacd4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m"
Aug 04 10:47:36.759452 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.759365    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvskt\" (UniqueName: \"kubernetes.io/projected/dec9e228-29b2-4655-93dd-795cd63dacd4-kube-api-access-qvskt\") pod \"kuadrant-console-plugin-598f86468b-8bb7m\" (UID: \"dec9e228-29b2-4655-93dd-795cd63dacd4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m"
Aug 04 10:47:36.759452 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.759389    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dec9e228-29b2-4655-93dd-795cd63dacd4-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-8bb7m\" (UID: \"dec9e228-29b2-4655-93dd-795cd63dacd4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m"
Aug 04 10:47:36.760033 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.760017    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dec9e228-29b2-4655-93dd-795cd63dacd4-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-8bb7m\" (UID: \"dec9e228-29b2-4655-93dd-795cd63dacd4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m"
Aug 04 10:47:36.762045 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.762015    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dec9e228-29b2-4655-93dd-795cd63dacd4-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-8bb7m\" (UID: \"dec9e228-29b2-4655-93dd-795cd63dacd4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m"
Aug 04 10:47:36.768397 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.768374    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvskt\" (UniqueName: \"kubernetes.io/projected/dec9e228-29b2-4655-93dd-795cd63dacd4-kube-api-access-qvskt\") pod \"kuadrant-console-plugin-598f86468b-8bb7m\" (UID: \"dec9e228-29b2-4655-93dd-795cd63dacd4\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m"
Aug 04 10:47:36.882349 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:36.882328    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m"
Aug 04 10:47:37.015423 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:37.015395    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m"]
Aug 04 10:47:37.018239 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:47:37.018208    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddec9e228_29b2_4655_93dd_795cd63dacd4.slice/crio-ac980f74ba886e320f135dd55e176c1763c82424f0a36b32a54f31b719bf82ab WatchSource:0}: Error finding container ac980f74ba886e320f135dd55e176c1763c82424f0a36b32a54f31b719bf82ab: Status 404 returned error can't find the container with id ac980f74ba886e320f135dd55e176c1763c82424f0a36b32a54f31b719bf82ab
Aug 04 10:47:38.008875 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:38.008603    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m" event={"ID":"dec9e228-29b2-4655-93dd-795cd63dacd4","Type":"ContainerStarted","Data":"ac980f74ba886e320f135dd55e176c1763c82424f0a36b32a54f31b719bf82ab"}
Aug 04 10:47:38.957345 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:38.957315    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"
Aug 04 10:47:42.028764 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:42.028684    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m" event={"ID":"dec9e228-29b2-4655-93dd-795cd63dacd4","Type":"ContainerStarted","Data":"2de11c9919a850d2378844daf0d02bdfcbf6984038455922b5b040361a1bedc9"}
Aug 04 10:47:42.045001 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:42.044957    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-8bb7m" podStartSLOduration=1.387438247 podStartE2EDuration="6.044942976s" totalImagesPullingTime="4.657504729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:47:42.043716669 +0000 UTC m=+652.769787024" watchObservedRunningTime="2026-08-04 10:47:42.044942976 +0000 UTC m=+652.771013312"
Aug 04 10:47:44.992511 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:44.992481    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:44.992954 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:44.992563    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-2cngp"
Aug 04 10:47:46.835487 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.835456    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"]
Aug 04 10:47:46.835906 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.835694    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9" podUID="6a749fcb-6fcf-4453-8f50-2a3d58629823" containerName="manager" containerID="cri-o://3213fc627b11a78eb8e8350477e13b8ac5609c5be6c5d6734675967a61f3876f" gracePeriod=2
Aug 04 10:47:46.843245 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.843212    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"]
Aug 04 10:47:46.854672 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:47:46.854626    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6a749fcb-6fcf-4453-8f50-2a3d58629823\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-vtcq9\": pods \"kuadrant-operator-controller-manager-58fc56757c-vtcq9\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:46.863577 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.863556    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"]
Aug 04 10:47:46.863838 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.863807    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp" podUID="5cb3475f-8585-44db-918b-66d48610e159" containerName="manager" containerID="cri-o://5594c1f0c4caafc807a3e4ef4ca00a2e0c54b29dd6a84ad86dcd2e12764355e3" gracePeriod=2
Aug 04 10:47:46.867468 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.867441    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"]
Aug 04 10:47:46.867914 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.867894    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a749fcb-6fcf-4453-8f50-2a3d58629823" containerName="manager"
Aug 04 10:47:46.868010 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.867915    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a749fcb-6fcf-4453-8f50-2a3d58629823" containerName="manager"
Aug 04 10:47:46.868010 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.867992    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a749fcb-6fcf-4453-8f50-2a3d58629823" containerName="manager"
Aug 04 10:47:46.871001 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.870983    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"
Aug 04 10:47:46.880384 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.880359    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"]
Aug 04 10:47:46.892497 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.892475    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"]
Aug 04 10:47:46.902515 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.902494    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-mzstt"]
Aug 04 10:47:46.902789 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.902776    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cb3475f-8585-44db-918b-66d48610e159" containerName="manager"
Aug 04 10:47:46.902846 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.902790    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cb3475f-8585-44db-918b-66d48610e159" containerName="manager"
Aug 04 10:47:46.902881 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.902857    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cb3475f-8585-44db-918b-66d48610e159" containerName="manager"
Aug 04 10:47:46.903302 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:47:46.903271    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5cb3475f-8585-44db-918b-66d48610e159\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-6c549b6d85-d5bpp\": pods \"limitador-operator-controller-manager-6c549b6d85-d5bpp\" not found" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"
Aug 04 10:47:46.905549 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.905533    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-mzstt"
Aug 04 10:47:46.905684 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:47:46.905658    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vtcq9\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="6a749fcb-6fcf-4453-8f50-2a3d58629823" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:46.907704 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:47:46.907684    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vtcq9\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="6a749fcb-6fcf-4453-8f50-2a3d58629823" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:46.909495 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:47:46.909476    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-d5bpp\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="5cb3475f-8585-44db-918b-66d48610e159" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"
Aug 04 10:47:46.921727 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.921707    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-mzstt"]
Aug 04 10:47:46.940613 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.940585    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5smd\" (UniqueName: \"kubernetes.io/projected/f3717580-3e30-4716-b602-a66312bdc228-kube-api-access-l5smd\") pod \"kuadrant-operator-controller-manager-58fc56757c-rrrqd\" (UID: \"f3717580-3e30-4716-b602-a66312bdc228\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"
Aug 04 10:47:46.940749 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.940682    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncsxj\" (UniqueName: \"kubernetes.io/projected/f7fd55c8-1d96-4d99-8f16-3067b796e243-kube-api-access-ncsxj\") pod \"limitador-operator-controller-manager-6c549b6d85-mzstt\" (UID: \"f7fd55c8-1d96-4d99-8f16-3067b796e243\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-mzstt"
Aug 04 10:47:46.940816 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:46.940748    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3717580-3e30-4716-b602-a66312bdc228-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-rrrqd\" (UID: \"f3717580-3e30-4716-b602-a66312bdc228\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"
Aug 04 10:47:47.042115 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.042086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3717580-3e30-4716-b602-a66312bdc228-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-rrrqd\" (UID: \"f3717580-3e30-4716-b602-a66312bdc228\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"
Aug 04 10:47:47.042232 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.042161    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5smd\" (UniqueName: \"kubernetes.io/projected/f3717580-3e30-4716-b602-a66312bdc228-kube-api-access-l5smd\") pod \"kuadrant-operator-controller-manager-58fc56757c-rrrqd\" (UID: \"f3717580-3e30-4716-b602-a66312bdc228\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"
Aug 04 10:47:47.042232 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.042203    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncsxj\" (UniqueName: \"kubernetes.io/projected/f7fd55c8-1d96-4d99-8f16-3067b796e243-kube-api-access-ncsxj\") pod \"limitador-operator-controller-manager-6c549b6d85-mzstt\" (UID: \"f7fd55c8-1d96-4d99-8f16-3067b796e243\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-mzstt"
Aug 04 10:47:47.042823 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.042779    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3717580-3e30-4716-b602-a66312bdc228-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-rrrqd\" (UID: \"f3717580-3e30-4716-b602-a66312bdc228\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"
Aug 04 10:47:47.051743 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.051717    2559 generic.go:356] "Generic (PLEG): container finished" podID="5cb3475f-8585-44db-918b-66d48610e159" containerID="5594c1f0c4caafc807a3e4ef4ca00a2e0c54b29dd6a84ad86dcd2e12764355e3" exitCode=0
Aug 04 10:47:47.053798 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.053778    2559 generic.go:356] "Generic (PLEG): container finished" podID="6a749fcb-6fcf-4453-8f50-2a3d58629823" containerID="3213fc627b11a78eb8e8350477e13b8ac5609c5be6c5d6734675967a61f3876f" exitCode=0
Aug 04 10:47:47.057910 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.057886    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncsxj\" (UniqueName: \"kubernetes.io/projected/f7fd55c8-1d96-4d99-8f16-3067b796e243-kube-api-access-ncsxj\") pod \"limitador-operator-controller-manager-6c549b6d85-mzstt\" (UID: \"f7fd55c8-1d96-4d99-8f16-3067b796e243\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-mzstt"
Aug 04 10:47:47.058286 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.058265    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5smd\" (UniqueName: \"kubernetes.io/projected/f3717580-3e30-4716-b602-a66312bdc228-kube-api-access-l5smd\") pod \"kuadrant-operator-controller-manager-58fc56757c-rrrqd\" (UID: \"f3717580-3e30-4716-b602-a66312bdc228\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"
Aug 04 10:47:47.103720 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.103699    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:47.105794 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.105779    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"
Aug 04 10:47:47.106922 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:47:47.106903    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vtcq9\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="6a749fcb-6fcf-4453-8f50-2a3d58629823" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:47.112103 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:47:47.112082    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-d5bpp\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="5cb3475f-8585-44db-918b-66d48610e159" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"
Aug 04 10:47:47.114144 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:47:47.114128    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vtcq9\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="6a749fcb-6fcf-4453-8f50-2a3d58629823" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:47.116699 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:47:47.116679    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-d5bpp\" is forbidden: User \"system:node:ip-10-0-136-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-162.ec2.internal' and this object" podUID="5cb3475f-8585-44db-918b-66d48610e159" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"
Aug 04 10:47:47.143139 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.143120    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7xhp\" (UniqueName: \"kubernetes.io/projected/6a749fcb-6fcf-4453-8f50-2a3d58629823-kube-api-access-w7xhp\") pod \"6a749fcb-6fcf-4453-8f50-2a3d58629823\" (UID: \"6a749fcb-6fcf-4453-8f50-2a3d58629823\") "
Aug 04 10:47:47.143230 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.143161    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a749fcb-6fcf-4453-8f50-2a3d58629823-extensions-socket-volume\") pod \"6a749fcb-6fcf-4453-8f50-2a3d58629823\" (UID: \"6a749fcb-6fcf-4453-8f50-2a3d58629823\") "
Aug 04 10:47:47.143230 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.143196    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjhxc\" (UniqueName: \"kubernetes.io/projected/5cb3475f-8585-44db-918b-66d48610e159-kube-api-access-hjhxc\") pod \"5cb3475f-8585-44db-918b-66d48610e159\" (UID: \"5cb3475f-8585-44db-918b-66d48610e159\") "
Aug 04 10:47:47.143579 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.143557    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a749fcb-6fcf-4453-8f50-2a3d58629823-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6a749fcb-6fcf-4453-8f50-2a3d58629823" (UID: "6a749fcb-6fcf-4453-8f50-2a3d58629823"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:47:47.145441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.145420    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cb3475f-8585-44db-918b-66d48610e159-kube-api-access-hjhxc" (OuterVolumeSpecName: "kube-api-access-hjhxc") pod "5cb3475f-8585-44db-918b-66d48610e159" (UID: "5cb3475f-8585-44db-918b-66d48610e159"). InnerVolumeSpecName "kube-api-access-hjhxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:47:47.145510 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.145452    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a749fcb-6fcf-4453-8f50-2a3d58629823-kube-api-access-w7xhp" (OuterVolumeSpecName: "kube-api-access-w7xhp") pod "6a749fcb-6fcf-4453-8f50-2a3d58629823" (UID: "6a749fcb-6fcf-4453-8f50-2a3d58629823"). InnerVolumeSpecName "kube-api-access-w7xhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:47:47.244356 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.244334    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7xhp\" (UniqueName: \"kubernetes.io/projected/6a749fcb-6fcf-4453-8f50-2a3d58629823-kube-api-access-w7xhp\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:47:47.244356 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.244353    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a749fcb-6fcf-4453-8f50-2a3d58629823-extensions-socket-volume\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:47:47.244502 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.244363    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjhxc\" (UniqueName: \"kubernetes.io/projected/5cb3475f-8585-44db-918b-66d48610e159-kube-api-access-hjhxc\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:47:47.282315 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.282291    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"
Aug 04 10:47:47.289337 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.289319    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-mzstt"
Aug 04 10:47:47.433867 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.433838    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"]
Aug 04 10:47:47.437422 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:47:47.437397    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3717580_3e30_4716_b602_a66312bdc228.slice/crio-6a412b544616b57f3d5a0083f92d97954868cefab5e0b2af18e1c8d7bb15d450 WatchSource:0}: Error finding container 6a412b544616b57f3d5a0083f92d97954868cefab5e0b2af18e1c8d7bb15d450: Status 404 returned error can't find the container with id 6a412b544616b57f3d5a0083f92d97954868cefab5e0b2af18e1c8d7bb15d450
Aug 04 10:47:47.449800 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.449778    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-mzstt"]
Aug 04 10:47:47.453494 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:47:47.453466    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7fd55c8_1d96_4d99_8f16_3067b796e243.slice/crio-0bedffeadd8110f9280ae889200c4eef0a2f4d2ff38abd08e2df384093dfa51c WatchSource:0}: Error finding container 0bedffeadd8110f9280ae889200c4eef0a2f4d2ff38abd08e2df384093dfa51c: Status 404 returned error can't find the container with id 0bedffeadd8110f9280ae889200c4eef0a2f4d2ff38abd08e2df384093dfa51c
Aug 04 10:47:47.780484 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.780408    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cb3475f-8585-44db-918b-66d48610e159" path="/var/lib/kubelet/pods/5cb3475f-8585-44db-918b-66d48610e159/volumes"
Aug 04 10:47:47.780773 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:47.780759    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a749fcb-6fcf-4453-8f50-2a3d58629823" path="/var/lib/kubelet/pods/6a749fcb-6fcf-4453-8f50-2a3d58629823/volumes"
Aug 04 10:47:48.059594 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:48.059508    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-mzstt" event={"ID":"f7fd55c8-1d96-4d99-8f16-3067b796e243","Type":"ContainerStarted","Data":"3e50c573245df66adf5ca462ca4dda5e5f5d01f6fa1d013b16f1dd42cad04743"}
Aug 04 10:47:48.060007 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:48.059671    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-mzstt"
Aug 04 10:47:48.060007 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:48.059707    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-mzstt" event={"ID":"f7fd55c8-1d96-4d99-8f16-3067b796e243","Type":"ContainerStarted","Data":"0bedffeadd8110f9280ae889200c4eef0a2f4d2ff38abd08e2df384093dfa51c"}
Aug 04 10:47:48.061187 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:48.061163    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd" event={"ID":"f3717580-3e30-4716-b602-a66312bdc228","Type":"ContainerStarted","Data":"d9d6a3f9d35965383a5dec76044e176dfa7129b55acbc193303ec7fb7aef1772"}
Aug 04 10:47:48.061315 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:48.061205    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd" event={"ID":"f3717580-3e30-4716-b602-a66312bdc228","Type":"ContainerStarted","Data":"6a412b544616b57f3d5a0083f92d97954868cefab5e0b2af18e1c8d7bb15d450"}
Aug 04 10:47:48.061315 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:48.061227    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"
Aug 04 10:47:48.062559 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:48.062541    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vtcq9"
Aug 04 10:47:48.062688 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:48.062598    2559 scope.go:117] "RemoveContainer" containerID="3213fc627b11a78eb8e8350477e13b8ac5609c5be6c5d6734675967a61f3876f"
Aug 04 10:47:48.064110 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:48.064090    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-d5bpp"
Aug 04 10:47:48.070966 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:48.070951    2559 scope.go:117] "RemoveContainer" containerID="5594c1f0c4caafc807a3e4ef4ca00a2e0c54b29dd6a84ad86dcd2e12764355e3"
Aug 04 10:47:48.083035 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:48.082998    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-mzstt" podStartSLOduration=2.082985284 podStartE2EDuration="2.082985284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:47:48.082255162 +0000 UTC m=+658.808325496" watchObservedRunningTime="2026-08-04 10:47:48.082985284 +0000 UTC m=+658.809055670"
Aug 04 10:47:48.124577 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:48.124538    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd" podStartSLOduration=2.124525014 podStartE2EDuration="2.124525014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:47:48.12347515 +0000 UTC m=+658.849545486" watchObservedRunningTime="2026-08-04 10:47:48.124525014 +0000 UTC m=+658.850595348"
Aug 04 10:47:59.072057 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:59.072025    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"
Aug 04 10:47:59.072530 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:47:59.072106    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-mzstt"
Aug 04 10:48:04.596166 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:04.596125    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"]
Aug 04 10:48:04.596683 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:04.596379    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd" podUID="f3717580-3e30-4716-b602-a66312bdc228" containerName="manager" containerID="cri-o://d9d6a3f9d35965383a5dec76044e176dfa7129b55acbc193303ec7fb7aef1772" gracePeriod=10
Aug 04 10:48:04.839781 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:04.839758    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"
Aug 04 10:48:04.970896 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:04.970815    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3717580-3e30-4716-b602-a66312bdc228-extensions-socket-volume\") pod \"f3717580-3e30-4716-b602-a66312bdc228\" (UID: \"f3717580-3e30-4716-b602-a66312bdc228\") "
Aug 04 10:48:04.971043 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:04.970913    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5smd\" (UniqueName: \"kubernetes.io/projected/f3717580-3e30-4716-b602-a66312bdc228-kube-api-access-l5smd\") pod \"f3717580-3e30-4716-b602-a66312bdc228\" (UID: \"f3717580-3e30-4716-b602-a66312bdc228\") "
Aug 04 10:48:04.971169 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:04.971150    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3717580-3e30-4716-b602-a66312bdc228-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f3717580-3e30-4716-b602-a66312bdc228" (UID: "f3717580-3e30-4716-b602-a66312bdc228"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 10:48:04.973121 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:04.973093    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3717580-3e30-4716-b602-a66312bdc228-kube-api-access-l5smd" (OuterVolumeSpecName: "kube-api-access-l5smd") pod "f3717580-3e30-4716-b602-a66312bdc228" (UID: "f3717580-3e30-4716-b602-a66312bdc228"). InnerVolumeSpecName "kube-api-access-l5smd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:48:05.071986 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:05.071956    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5smd\" (UniqueName: \"kubernetes.io/projected/f3717580-3e30-4716-b602-a66312bdc228-kube-api-access-l5smd\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:48:05.071986 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:05.071981    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3717580-3e30-4716-b602-a66312bdc228-extensions-socket-volume\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:48:05.140185 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:05.140157    2559 generic.go:356] "Generic (PLEG): container finished" podID="f3717580-3e30-4716-b602-a66312bdc228" containerID="d9d6a3f9d35965383a5dec76044e176dfa7129b55acbc193303ec7fb7aef1772" exitCode=0
Aug 04 10:48:05.140326 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:05.140197    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd" event={"ID":"f3717580-3e30-4716-b602-a66312bdc228","Type":"ContainerDied","Data":"d9d6a3f9d35965383a5dec76044e176dfa7129b55acbc193303ec7fb7aef1772"}
Aug 04 10:48:05.140326 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:05.140247    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd" event={"ID":"f3717580-3e30-4716-b602-a66312bdc228","Type":"ContainerDied","Data":"6a412b544616b57f3d5a0083f92d97954868cefab5e0b2af18e1c8d7bb15d450"}
Aug 04 10:48:05.140326 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:05.140202    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"
Aug 04 10:48:05.140326 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:05.140278    2559 scope.go:117] "RemoveContainer" containerID="d9d6a3f9d35965383a5dec76044e176dfa7129b55acbc193303ec7fb7aef1772"
Aug 04 10:48:05.148695 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:05.148660    2559 scope.go:117] "RemoveContainer" containerID="d9d6a3f9d35965383a5dec76044e176dfa7129b55acbc193303ec7fb7aef1772"
Aug 04 10:48:05.148940 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:48:05.148921    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9d6a3f9d35965383a5dec76044e176dfa7129b55acbc193303ec7fb7aef1772\": container with ID starting with d9d6a3f9d35965383a5dec76044e176dfa7129b55acbc193303ec7fb7aef1772 not found: ID does not exist" containerID="d9d6a3f9d35965383a5dec76044e176dfa7129b55acbc193303ec7fb7aef1772"
Aug 04 10:48:05.149004 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:05.148951    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9d6a3f9d35965383a5dec76044e176dfa7129b55acbc193303ec7fb7aef1772"} err="failed to get container status \"d9d6a3f9d35965383a5dec76044e176dfa7129b55acbc193303ec7fb7aef1772\": rpc error: code = NotFound desc = could not find container \"d9d6a3f9d35965383a5dec76044e176dfa7129b55acbc193303ec7fb7aef1772\": container with ID starting with d9d6a3f9d35965383a5dec76044e176dfa7129b55acbc193303ec7fb7aef1772 not found: ID does not exist"
Aug 04 10:48:05.173816 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:05.173794    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"]
Aug 04 10:48:05.180401 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:05.180382    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-rrrqd"]
Aug 04 10:48:05.780514 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:05.780480    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3717580-3e30-4716-b602-a66312bdc228" path="/var/lib/kubelet/pods/f3717580-3e30-4716-b602-a66312bdc228/volumes"
Aug 04 10:48:20.891156 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.891123    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"]
Aug 04 10:48:20.891606 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.891393    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3717580-3e30-4716-b602-a66312bdc228" containerName="manager"
Aug 04 10:48:20.891606 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.891403    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3717580-3e30-4716-b602-a66312bdc228" containerName="manager"
Aug 04 10:48:20.891606 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.891468    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3717580-3e30-4716-b602-a66312bdc228" containerName="manager"
Aug 04 10:48:20.914404 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.914375    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"]
Aug 04 10:48:20.914539 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.914472    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:20.917432 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.917403    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sqwrw\""
Aug 04 10:48:20.991707 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.991679    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17dc7398-b910-4116-baaa-376652f9e50c-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:20.991840 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.991732    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9gcp\" (UniqueName: \"kubernetes.io/projected/17dc7398-b910-4116-baaa-376652f9e50c-kube-api-access-m9gcp\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:20.991840 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.991765    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17dc7398-b910-4116-baaa-376652f9e50c-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:20.991925 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.991889    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17dc7398-b910-4116-baaa-376652f9e50c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:20.991966 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.991933    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17dc7398-b910-4116-baaa-376652f9e50c-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:20.992009 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.991963    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17dc7398-b910-4116-baaa-376652f9e50c-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:20.992042 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.992010    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17dc7398-b910-4116-baaa-376652f9e50c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:20.992082 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.992038    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17dc7398-b910-4116-baaa-376652f9e50c-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:20.992082 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:20.992069    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17dc7398-b910-4116-baaa-376652f9e50c-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.092528 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.092496    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17dc7398-b910-4116-baaa-376652f9e50c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.092672 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.092534    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17dc7398-b910-4116-baaa-376652f9e50c-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.092672 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.092557    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17dc7398-b910-4116-baaa-376652f9e50c-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.092672 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.092592    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17dc7398-b910-4116-baaa-376652f9e50c-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.092672 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.092626    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9gcp\" (UniqueName: \"kubernetes.io/projected/17dc7398-b910-4116-baaa-376652f9e50c-kube-api-access-m9gcp\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.092883 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.092680    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17dc7398-b910-4116-baaa-376652f9e50c-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.092883 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.092714    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17dc7398-b910-4116-baaa-376652f9e50c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.092883 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.092743    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17dc7398-b910-4116-baaa-376652f9e50c-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.092883 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.092769    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17dc7398-b910-4116-baaa-376652f9e50c-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.093066 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.092941    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17dc7398-b910-4116-baaa-376652f9e50c-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.093066 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.093047    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17dc7398-b910-4116-baaa-376652f9e50c-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.093168 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.093077    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17dc7398-b910-4116-baaa-376652f9e50c-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.093313 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.093283    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17dc7398-b910-4116-baaa-376652f9e50c-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.093374 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.093309    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17dc7398-b910-4116-baaa-376652f9e50c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.095144 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.095119    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17dc7398-b910-4116-baaa-376652f9e50c-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.095256 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.095237    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17dc7398-b910-4116-baaa-376652f9e50c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.100579 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.100556    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9gcp\" (UniqueName: \"kubernetes.io/projected/17dc7398-b910-4116-baaa-376652f9e50c-kube-api-access-m9gcp\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.100677 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.100595    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17dc7398-b910-4116-baaa-376652f9e50c-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-dd9rb\" (UID: \"17dc7398-b910-4116-baaa-376652f9e50c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.224205 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.224126    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:21.367962 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.367925    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"]
Aug 04 10:48:21.370746 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:48:21.370713    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17dc7398_b910_4116_baaa_376652f9e50c.slice/crio-5f194fd4c373dd8075f2cfc172e19348c49f109aa380089966ad07908cbf92d1 WatchSource:0}: Error finding container 5f194fd4c373dd8075f2cfc172e19348c49f109aa380089966ad07908cbf92d1: Status 404 returned error can't find the container with id 5f194fd4c373dd8075f2cfc172e19348c49f109aa380089966ad07908cbf92d1
Aug 04 10:48:21.372791 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.372757    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 10:48:21.372887 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.372824    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 10:48:21.372887 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:21.372850    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 10:48:22.214511 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:22.214476    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb" event={"ID":"17dc7398-b910-4116-baaa-376652f9e50c","Type":"ContainerStarted","Data":"7663f402ed2e19da48bdef58e3010954aa27a0964254db556eaabe9de872fbbe"}
Aug 04 10:48:22.214905 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:22.214533    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb" event={"ID":"17dc7398-b910-4116-baaa-376652f9e50c","Type":"ContainerStarted","Data":"5f194fd4c373dd8075f2cfc172e19348c49f109aa380089966ad07908cbf92d1"}
Aug 04 10:48:22.225158 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:22.225140    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:22.230144 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:22.230122    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:22.234316 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:22.234273    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb" podStartSLOduration=2.234258335 podStartE2EDuration="2.234258335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:48:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:48:22.233241435 +0000 UTC m=+692.959311783" watchObservedRunningTime="2026-08-04 10:48:22.234258335 +0000 UTC m=+692.960328672"
Aug 04 10:48:23.219323 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:23.219294    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:23.220172 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:23.220155    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:48:23.235192 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:23.235166    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"]
Aug 04 10:48:23.238613 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:23.238599    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"
Aug 04 10:48:23.240687 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:23.240666    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 04 10:48:23.247993 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:23.247969    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"]
Aug 04 10:48:23.311383 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:23.311346    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c98044a8-df9b-46ca-9df1-03604da04198-config-file\") pod \"limitador-limitador-859c4d96d6-fm9zk\" (UID: \"c98044a8-df9b-46ca-9df1-03604da04198\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"
Aug 04 10:48:23.311599 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:23.311578    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbsfq\" (UniqueName: \"kubernetes.io/projected/c98044a8-df9b-46ca-9df1-03604da04198-kube-api-access-bbsfq\") pod \"limitador-limitador-859c4d96d6-fm9zk\" (UID: \"c98044a8-df9b-46ca-9df1-03604da04198\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"
Aug 04 10:48:23.326738 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:23.326712    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"]
Aug 04 10:48:23.412568 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:23.412536    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbsfq\" (UniqueName: \"kubernetes.io/projected/c98044a8-df9b-46ca-9df1-03604da04198-kube-api-access-bbsfq\") pod \"limitador-limitador-859c4d96d6-fm9zk\" (UID: \"c98044a8-df9b-46ca-9df1-03604da04198\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"
Aug 04 10:48:23.412737 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:23.412654    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c98044a8-df9b-46ca-9df1-03604da04198-config-file\") pod \"limitador-limitador-859c4d96d6-fm9zk\" (UID: \"c98044a8-df9b-46ca-9df1-03604da04198\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"
Aug 04 10:48:23.413164 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:23.413146    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c98044a8-df9b-46ca-9df1-03604da04198-config-file\") pod \"limitador-limitador-859c4d96d6-fm9zk\" (UID: \"c98044a8-df9b-46ca-9df1-03604da04198\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"
Aug 04 10:48:23.428964 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:23.428933    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbsfq\" (UniqueName: \"kubernetes.io/projected/c98044a8-df9b-46ca-9df1-03604da04198-kube-api-access-bbsfq\") pod \"limitador-limitador-859c4d96d6-fm9zk\" (UID: \"c98044a8-df9b-46ca-9df1-03604da04198\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"
Aug 04 10:48:23.549966 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:23.549892    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"
Aug 04 10:48:23.703388 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:23.703336    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"]
Aug 04 10:48:23.705960 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:48:23.705921    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc98044a8_df9b_46ca_9df1_03604da04198.slice/crio-1f4f3330add2ae61f2889d04f1b4bd8325edf98d1d66da9f6a53aa213a67c75b WatchSource:0}: Error finding container 1f4f3330add2ae61f2889d04f1b4bd8325edf98d1d66da9f6a53aa213a67c75b: Status 404 returned error can't find the container with id 1f4f3330add2ae61f2889d04f1b4bd8325edf98d1d66da9f6a53aa213a67c75b
Aug 04 10:48:24.098956 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:24.098928    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-sz68f"]
Aug 04 10:48:24.103614 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:24.103593    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-sz68f"
Aug 04 10:48:24.105876 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:24.105859    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ddqb6\""
Aug 04 10:48:24.110334 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:24.110314    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-sz68f"]
Aug 04 10:48:24.221659 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:24.221611    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gljnx\" (UniqueName: \"kubernetes.io/projected/d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d-kube-api-access-gljnx\") pod \"authorino-b54df94b4-sz68f\" (UID: \"d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d\") " pod="kuadrant-system/authorino-b54df94b4-sz68f"
Aug 04 10:48:24.224579 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:24.224550    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk" event={"ID":"c98044a8-df9b-46ca-9df1-03604da04198","Type":"ContainerStarted","Data":"1f4f3330add2ae61f2889d04f1b4bd8325edf98d1d66da9f6a53aa213a67c75b"}
Aug 04 10:48:24.322980 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:24.322948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gljnx\" (UniqueName: \"kubernetes.io/projected/d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d-kube-api-access-gljnx\") pod \"authorino-b54df94b4-sz68f\" (UID: \"d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d\") " pod="kuadrant-system/authorino-b54df94b4-sz68f"
Aug 04 10:48:24.331560 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:24.331536    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gljnx\" (UniqueName: \"kubernetes.io/projected/d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d-kube-api-access-gljnx\") pod \"authorino-b54df94b4-sz68f\" (UID: \"d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d\") " pod="kuadrant-system/authorino-b54df94b4-sz68f"
Aug 04 10:48:24.414137 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:24.414074    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-sz68f"
Aug 04 10:48:24.543278 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:24.543250    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-sz68f"]
Aug 04 10:48:24.545751 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:48:24.545726    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9c6daeb_a2b2_4193_bc0c_da0149dc0a8d.slice/crio-b5c7ca8b90271422f85ee1687665ff8d6bcb324b088c12ff2ee1dd666ef56f85 WatchSource:0}: Error finding container b5c7ca8b90271422f85ee1687665ff8d6bcb324b088c12ff2ee1dd666ef56f85: Status 404 returned error can't find the container with id b5c7ca8b90271422f85ee1687665ff8d6bcb324b088c12ff2ee1dd666ef56f85
Aug 04 10:48:25.231263 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:25.231223    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-sz68f" event={"ID":"d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d","Type":"ContainerStarted","Data":"b5c7ca8b90271422f85ee1687665ff8d6bcb324b088c12ff2ee1dd666ef56f85"}
Aug 04 10:48:26.239548 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:26.239477    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk" event={"ID":"c98044a8-df9b-46ca-9df1-03604da04198","Type":"ContainerStarted","Data":"096af6ee359928ce7335e01d9207776dcb301d25e131b459e6e98ad85e646e30"}
Aug 04 10:48:26.240114 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:26.239626    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"
Aug 04 10:48:26.257093 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:26.257041    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk" podStartSLOduration=1.551397053 podStartE2EDuration="3.257021661s" totalImagesPullingTime="1.705624608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:48:26.256573543 +0000 UTC m=+696.982643904" watchObservedRunningTime="2026-08-04 10:48:26.257021661 +0000 UTC m=+696.983091997"
Aug 04 10:48:27.647965 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:27.647928    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-sz68f"]
Aug 04 10:48:28.250346 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:28.250309    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-sz68f" event={"ID":"d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d","Type":"ContainerStarted","Data":"4b02dc59ad9dfa7af2908ab3ed576ba2f949dd15e47fd3c6c114314832982861"}
Aug 04 10:48:28.269563 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:28.269513    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-sz68f" podStartSLOduration=1.569408331 podStartE2EDuration="4.269496081s" totalImagesPullingTime="2.70008775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:48:28.269287865 +0000 UTC m=+698.995358201" watchObservedRunningTime="2026-08-04 10:48:28.269496081 +0000 UTC m=+698.995566416"
Aug 04 10:48:29.254453 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:29.254409    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-sz68f" podUID="d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d" containerName="authorino" containerID="cri-o://4b02dc59ad9dfa7af2908ab3ed576ba2f949dd15e47fd3c6c114314832982861" gracePeriod=30
Aug 04 10:48:29.490785 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:29.490762    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-sz68f"
Aug 04 10:48:29.665261 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:29.665234    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gljnx\" (UniqueName: \"kubernetes.io/projected/d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d-kube-api-access-gljnx\") pod \"d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d\" (UID: \"d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d\") "
Aug 04 10:48:29.667339 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:29.667310    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d-kube-api-access-gljnx" (OuterVolumeSpecName: "kube-api-access-gljnx") pod "d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d" (UID: "d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d"). InnerVolumeSpecName "kube-api-access-gljnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:48:29.766561 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:29.766527    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gljnx\" (UniqueName: \"kubernetes.io/projected/d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d-kube-api-access-gljnx\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:48:30.259342 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:30.259303    2559 generic.go:356] "Generic (PLEG): container finished" podID="d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d" containerID="4b02dc59ad9dfa7af2908ab3ed576ba2f949dd15e47fd3c6c114314832982861" exitCode=0
Aug 04 10:48:30.259342 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:30.259341    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-sz68f"
Aug 04 10:48:30.259823 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:30.259374    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-sz68f" event={"ID":"d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d","Type":"ContainerDied","Data":"4b02dc59ad9dfa7af2908ab3ed576ba2f949dd15e47fd3c6c114314832982861"}
Aug 04 10:48:30.259823 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:30.259412    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-sz68f" event={"ID":"d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d","Type":"ContainerDied","Data":"b5c7ca8b90271422f85ee1687665ff8d6bcb324b088c12ff2ee1dd666ef56f85"}
Aug 04 10:48:30.259823 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:30.259433    2559 scope.go:117] "RemoveContainer" containerID="4b02dc59ad9dfa7af2908ab3ed576ba2f949dd15e47fd3c6c114314832982861"
Aug 04 10:48:30.267597 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:30.267577    2559 scope.go:117] "RemoveContainer" containerID="4b02dc59ad9dfa7af2908ab3ed576ba2f949dd15e47fd3c6c114314832982861"
Aug 04 10:48:30.267895 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:48:30.267876    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b02dc59ad9dfa7af2908ab3ed576ba2f949dd15e47fd3c6c114314832982861\": container with ID starting with 4b02dc59ad9dfa7af2908ab3ed576ba2f949dd15e47fd3c6c114314832982861 not found: ID does not exist" containerID="4b02dc59ad9dfa7af2908ab3ed576ba2f949dd15e47fd3c6c114314832982861"
Aug 04 10:48:30.267965 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:30.267904    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b02dc59ad9dfa7af2908ab3ed576ba2f949dd15e47fd3c6c114314832982861"} err="failed to get container status \"4b02dc59ad9dfa7af2908ab3ed576ba2f949dd15e47fd3c6c114314832982861\": rpc error: code = NotFound desc = could not find container \"4b02dc59ad9dfa7af2908ab3ed576ba2f949dd15e47fd3c6c114314832982861\": container with ID starting with 4b02dc59ad9dfa7af2908ab3ed576ba2f949dd15e47fd3c6c114314832982861 not found: ID does not exist"
Aug 04 10:48:30.282274 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:30.282251    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-sz68f"]
Aug 04 10:48:30.284838 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:30.284818    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-sz68f"]
Aug 04 10:48:31.781699 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:31.781664    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d" path="/var/lib/kubelet/pods/d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d/volumes"
Aug 04 10:48:36.640912 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:36.640875    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"]
Aug 04 10:48:36.641320 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:36.641055    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk" podUID="c98044a8-df9b-46ca-9df1-03604da04198" containerName="limitador" containerID="cri-o://096af6ee359928ce7335e01d9207776dcb301d25e131b459e6e98ad85e646e30" gracePeriod=30
Aug 04 10:48:36.641935 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:36.641913    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"
Aug 04 10:48:37.201683 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.201603    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"
Aug 04 10:48:37.299945 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.299910    2559 generic.go:356] "Generic (PLEG): container finished" podID="c98044a8-df9b-46ca-9df1-03604da04198" containerID="096af6ee359928ce7335e01d9207776dcb301d25e131b459e6e98ad85e646e30" exitCode=0
Aug 04 10:48:37.300129 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.299961    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"
Aug 04 10:48:37.300129 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.300006    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk" event={"ID":"c98044a8-df9b-46ca-9df1-03604da04198","Type":"ContainerDied","Data":"096af6ee359928ce7335e01d9207776dcb301d25e131b459e6e98ad85e646e30"}
Aug 04 10:48:37.300129 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.300098    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-fm9zk" event={"ID":"c98044a8-df9b-46ca-9df1-03604da04198","Type":"ContainerDied","Data":"1f4f3330add2ae61f2889d04f1b4bd8325edf98d1d66da9f6a53aa213a67c75b"}
Aug 04 10:48:37.300129 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.300128    2559 scope.go:117] "RemoveContainer" containerID="096af6ee359928ce7335e01d9207776dcb301d25e131b459e6e98ad85e646e30"
Aug 04 10:48:37.307940 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.307926    2559 scope.go:117] "RemoveContainer" containerID="096af6ee359928ce7335e01d9207776dcb301d25e131b459e6e98ad85e646e30"
Aug 04 10:48:37.308181 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:48:37.308163    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"096af6ee359928ce7335e01d9207776dcb301d25e131b459e6e98ad85e646e30\": container with ID starting with 096af6ee359928ce7335e01d9207776dcb301d25e131b459e6e98ad85e646e30 not found: ID does not exist" containerID="096af6ee359928ce7335e01d9207776dcb301d25e131b459e6e98ad85e646e30"
Aug 04 10:48:37.308239 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.308189    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"096af6ee359928ce7335e01d9207776dcb301d25e131b459e6e98ad85e646e30"} err="failed to get container status \"096af6ee359928ce7335e01d9207776dcb301d25e131b459e6e98ad85e646e30\": rpc error: code = NotFound desc = could not find container \"096af6ee359928ce7335e01d9207776dcb301d25e131b459e6e98ad85e646e30\": container with ID starting with 096af6ee359928ce7335e01d9207776dcb301d25e131b459e6e98ad85e646e30 not found: ID does not exist"
Aug 04 10:48:37.324383 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.324365    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbsfq\" (UniqueName: \"kubernetes.io/projected/c98044a8-df9b-46ca-9df1-03604da04198-kube-api-access-bbsfq\") pod \"c98044a8-df9b-46ca-9df1-03604da04198\" (UID: \"c98044a8-df9b-46ca-9df1-03604da04198\") "
Aug 04 10:48:37.324481 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.324468    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c98044a8-df9b-46ca-9df1-03604da04198-config-file\") pod \"c98044a8-df9b-46ca-9df1-03604da04198\" (UID: \"c98044a8-df9b-46ca-9df1-03604da04198\") "
Aug 04 10:48:37.324807 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.324789    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c98044a8-df9b-46ca-9df1-03604da04198-config-file" (OuterVolumeSpecName: "config-file") pod "c98044a8-df9b-46ca-9df1-03604da04198" (UID: "c98044a8-df9b-46ca-9df1-03604da04198"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 10:48:37.326414 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.326390    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c98044a8-df9b-46ca-9df1-03604da04198-kube-api-access-bbsfq" (OuterVolumeSpecName: "kube-api-access-bbsfq") pod "c98044a8-df9b-46ca-9df1-03604da04198" (UID: "c98044a8-df9b-46ca-9df1-03604da04198"). InnerVolumeSpecName "kube-api-access-bbsfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:48:37.425325 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.425290    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbsfq\" (UniqueName: \"kubernetes.io/projected/c98044a8-df9b-46ca-9df1-03604da04198-kube-api-access-bbsfq\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:48:37.425325 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.425322    2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c98044a8-df9b-46ca-9df1-03604da04198-config-file\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:48:37.620793 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.620768    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"]
Aug 04 10:48:37.624942 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.624918    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-fm9zk"]
Aug 04 10:48:37.780724 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:37.780698    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c98044a8-df9b-46ca-9df1-03604da04198" path="/var/lib/kubelet/pods/c98044a8-df9b-46ca-9df1-03604da04198/volumes"
Aug 04 10:48:39.751164 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:39.751130    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-st8cq"]
Aug 04 10:48:39.751604 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:39.751415    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d" containerName="authorino"
Aug 04 10:48:39.751604 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:39.751425    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d" containerName="authorino"
Aug 04 10:48:39.751604 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:39.751441    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c98044a8-df9b-46ca-9df1-03604da04198" containerName="limitador"
Aug 04 10:48:39.751604 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:39.751446    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98044a8-df9b-46ca-9df1-03604da04198" containerName="limitador"
Aug 04 10:48:39.751604 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:39.751503    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c98044a8-df9b-46ca-9df1-03604da04198" containerName="limitador"
Aug 04 10:48:39.751604 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:39.751510    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9c6daeb-a2b2-4193-bc0c-da0149dc0a8d" containerName="authorino"
Aug 04 10:48:39.755629 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:39.755610    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-st8cq"
Aug 04 10:48:39.758109 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:39.758086    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Aug 04 10:48:39.758275 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:39.758260    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-chjm6\""
Aug 04 10:48:39.758356 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:39.758322    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 10:48:39.758860 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:39.758845    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 10:48:39.767358 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:39.767332    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-st8cq"]
Aug 04 10:48:39.944112 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:39.944084    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7518d4c5-ca18-4e4e-928d-a9fafaaee3ec-data\") pod \"postgres-69fb4594cf-st8cq\" (UID: \"7518d4c5-ca18-4e4e-928d-a9fafaaee3ec\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-st8cq"
Aug 04 10:48:39.944269 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:39.944131    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjws6\" (UniqueName: \"kubernetes.io/projected/7518d4c5-ca18-4e4e-928d-a9fafaaee3ec-kube-api-access-mjws6\") pod \"postgres-69fb4594cf-st8cq\" (UID: \"7518d4c5-ca18-4e4e-928d-a9fafaaee3ec\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-st8cq"
Aug 04 10:48:40.044611 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:40.044538    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjws6\" (UniqueName: \"kubernetes.io/projected/7518d4c5-ca18-4e4e-928d-a9fafaaee3ec-kube-api-access-mjws6\") pod \"postgres-69fb4594cf-st8cq\" (UID: \"7518d4c5-ca18-4e4e-928d-a9fafaaee3ec\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-st8cq"
Aug 04 10:48:40.044611 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:40.044610    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7518d4c5-ca18-4e4e-928d-a9fafaaee3ec-data\") pod \"postgres-69fb4594cf-st8cq\" (UID: \"7518d4c5-ca18-4e4e-928d-a9fafaaee3ec\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-st8cq"
Aug 04 10:48:40.044963 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:40.044947    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7518d4c5-ca18-4e4e-928d-a9fafaaee3ec-data\") pod \"postgres-69fb4594cf-st8cq\" (UID: \"7518d4c5-ca18-4e4e-928d-a9fafaaee3ec\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-st8cq"
Aug 04 10:48:40.053449 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:40.053428    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjws6\" (UniqueName: \"kubernetes.io/projected/7518d4c5-ca18-4e4e-928d-a9fafaaee3ec-kube-api-access-mjws6\") pod \"postgres-69fb4594cf-st8cq\" (UID: \"7518d4c5-ca18-4e4e-928d-a9fafaaee3ec\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-st8cq"
Aug 04 10:48:40.065341 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:40.065320    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-st8cq"
Aug 04 10:48:40.198945 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:40.198910    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-st8cq"]
Aug 04 10:48:40.202837 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:48:40.202808    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7518d4c5_ca18_4e4e_928d_a9fafaaee3ec.slice/crio-514b4532800a3464fb0291fd1162bda0a76316aff043b430182454e30a9be1e6 WatchSource:0}: Error finding container 514b4532800a3464fb0291fd1162bda0a76316aff043b430182454e30a9be1e6: Status 404 returned error can't find the container with id 514b4532800a3464fb0291fd1162bda0a76316aff043b430182454e30a9be1e6
Aug 04 10:48:40.314671 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:40.314587    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-st8cq" event={"ID":"7518d4c5-ca18-4e4e-928d-a9fafaaee3ec","Type":"ContainerStarted","Data":"514b4532800a3464fb0291fd1162bda0a76316aff043b430182454e30a9be1e6"}
Aug 04 10:48:45.342240 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:45.342207    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-st8cq" event={"ID":"7518d4c5-ca18-4e4e-928d-a9fafaaee3ec","Type":"ContainerStarted","Data":"5615f3f94a7ab35961677156d4966f0791223dc89bba5e00ed08faced53c43b5"}
Aug 04 10:48:45.342583 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:45.342276    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-st8cq"
Aug 04 10:48:45.359847 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:45.359800    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-st8cq" podStartSLOduration=1.319988803 podStartE2EDuration="6.359785668s" totalImagesPullingTime="5.039796865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:48:45.357814917 +0000 UTC m=+716.083885253" watchObservedRunningTime="2026-08-04 10:48:45.359785668 +0000 UTC m=+716.085856003"
Aug 04 10:48:51.374602 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:51.374573    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-st8cq"
Aug 04 10:48:51.899898 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:51.899868    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-675pf"]
Aug 04 10:48:51.905167 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:51.905149    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-675pf"
Aug 04 10:48:51.907371 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:51.907352    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ddqb6\""
Aug 04 10:48:51.911294 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:51.911272    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-675pf"]
Aug 04 10:48:51.937827 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:51.937800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98tnv\" (UniqueName: \"kubernetes.io/projected/92af320e-9b1a-4c83-8934-89081762a946-kube-api-access-98tnv\") pod \"authorino-5dc7ccb5f-675pf\" (UID: \"92af320e-9b1a-4c83-8934-89081762a946\") " pod="kuadrant-system/authorino-5dc7ccb5f-675pf"
Aug 04 10:48:52.001545 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.001514    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-675pf"]
Aug 04 10:48:52.001788 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:48:52.001767    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-98tnv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-675pf" podUID="92af320e-9b1a-4c83-8934-89081762a946"
Aug 04 10:48:52.030945 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.030919    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-sz98j"]
Aug 04 10:48:52.034224 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.034206    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-sz98j"
Aug 04 10:48:52.036678 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.036657    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 04 10:48:52.038148 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.038129    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98tnv\" (UniqueName: \"kubernetes.io/projected/92af320e-9b1a-4c83-8934-89081762a946-kube-api-access-98tnv\") pod \"authorino-5dc7ccb5f-675pf\" (UID: \"92af320e-9b1a-4c83-8934-89081762a946\") " pod="kuadrant-system/authorino-5dc7ccb5f-675pf"
Aug 04 10:48:52.045280 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.045262    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-sz98j"]
Aug 04 10:48:52.054260 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.054237    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98tnv\" (UniqueName: \"kubernetes.io/projected/92af320e-9b1a-4c83-8934-89081762a946-kube-api-access-98tnv\") pod \"authorino-5dc7ccb5f-675pf\" (UID: \"92af320e-9b1a-4c83-8934-89081762a946\") " pod="kuadrant-system/authorino-5dc7ccb5f-675pf"
Aug 04 10:48:52.135526 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.135500    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-sz98j"]
Aug 04 10:48:52.135747 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:48:52.135728    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bmgdg tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-sz98j" podUID="60e31a88-c954-4702-93db-d3db774ac444"
Aug 04 10:48:52.139281 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.139258    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmgdg\" (UniqueName: \"kubernetes.io/projected/60e31a88-c954-4702-93db-d3db774ac444-kube-api-access-bmgdg\") pod \"authorino-687bd45585-sz98j\" (UID: \"60e31a88-c954-4702-93db-d3db774ac444\") " pod="kuadrant-system/authorino-687bd45585-sz98j"
Aug 04 10:48:52.139347 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.139302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60e31a88-c954-4702-93db-d3db774ac444-tls-cert\") pod \"authorino-687bd45585-sz98j\" (UID: \"60e31a88-c954-4702-93db-d3db774ac444\") " pod="kuadrant-system/authorino-687bd45585-sz98j"
Aug 04 10:48:52.240110 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.240047    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmgdg\" (UniqueName: \"kubernetes.io/projected/60e31a88-c954-4702-93db-d3db774ac444-kube-api-access-bmgdg\") pod \"authorino-687bd45585-sz98j\" (UID: \"60e31a88-c954-4702-93db-d3db774ac444\") " pod="kuadrant-system/authorino-687bd45585-sz98j"
Aug 04 10:48:52.240110 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.240091    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60e31a88-c954-4702-93db-d3db774ac444-tls-cert\") pod \"authorino-687bd45585-sz98j\" (UID: \"60e31a88-c954-4702-93db-d3db774ac444\") " pod="kuadrant-system/authorino-687bd45585-sz98j"
Aug 04 10:48:52.242631 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.242605    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60e31a88-c954-4702-93db-d3db774ac444-tls-cert\") pod \"authorino-687bd45585-sz98j\" (UID: \"60e31a88-c954-4702-93db-d3db774ac444\") " pod="kuadrant-system/authorino-687bd45585-sz98j"
Aug 04 10:48:52.256380 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.256360    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmgdg\" (UniqueName: \"kubernetes.io/projected/60e31a88-c954-4702-93db-d3db774ac444-kube-api-access-bmgdg\") pod \"authorino-687bd45585-sz98j\" (UID: \"60e31a88-c954-4702-93db-d3db774ac444\") " pod="kuadrant-system/authorino-687bd45585-sz98j"
Aug 04 10:48:52.371987 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.371960    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-sz98j"
Aug 04 10:48:52.372108 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.371960    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-675pf"
Aug 04 10:48:52.379269 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.379250    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-sz98j"
Aug 04 10:48:52.381868 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.381853    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-675pf"
Aug 04 10:48:52.440915 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.440890    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98tnv\" (UniqueName: \"kubernetes.io/projected/92af320e-9b1a-4c83-8934-89081762a946-kube-api-access-98tnv\") pod \"92af320e-9b1a-4c83-8934-89081762a946\" (UID: \"92af320e-9b1a-4c83-8934-89081762a946\") "
Aug 04 10:48:52.441005 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.440933    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmgdg\" (UniqueName: \"kubernetes.io/projected/60e31a88-c954-4702-93db-d3db774ac444-kube-api-access-bmgdg\") pod \"60e31a88-c954-4702-93db-d3db774ac444\" (UID: \"60e31a88-c954-4702-93db-d3db774ac444\") "
Aug 04 10:48:52.441005 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.440971    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60e31a88-c954-4702-93db-d3db774ac444-tls-cert\") pod \"60e31a88-c954-4702-93db-d3db774ac444\" (UID: \"60e31a88-c954-4702-93db-d3db774ac444\") "
Aug 04 10:48:52.443175 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.443143    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60e31a88-c954-4702-93db-d3db774ac444-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "60e31a88-c954-4702-93db-d3db774ac444" (UID: "60e31a88-c954-4702-93db-d3db774ac444"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:48:52.443277 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.443205    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60e31a88-c954-4702-93db-d3db774ac444-kube-api-access-bmgdg" (OuterVolumeSpecName: "kube-api-access-bmgdg") pod "60e31a88-c954-4702-93db-d3db774ac444" (UID: "60e31a88-c954-4702-93db-d3db774ac444"). InnerVolumeSpecName "kube-api-access-bmgdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:48:52.443277 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.443223    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92af320e-9b1a-4c83-8934-89081762a946-kube-api-access-98tnv" (OuterVolumeSpecName: "kube-api-access-98tnv") pod "92af320e-9b1a-4c83-8934-89081762a946" (UID: "92af320e-9b1a-4c83-8934-89081762a946"). InnerVolumeSpecName "kube-api-access-98tnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:48:52.541771 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.541708    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98tnv\" (UniqueName: \"kubernetes.io/projected/92af320e-9b1a-4c83-8934-89081762a946-kube-api-access-98tnv\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:48:52.541771 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.541733    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmgdg\" (UniqueName: \"kubernetes.io/projected/60e31a88-c954-4702-93db-d3db774ac444-kube-api-access-bmgdg\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:48:52.541771 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:52.541746    2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/60e31a88-c954-4702-93db-d3db774ac444-tls-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:48:53.375787 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:53.375754    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-675pf"
Aug 04 10:48:53.375961 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:53.375754    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-sz98j"
Aug 04 10:48:53.410884 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:53.410855    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-675pf"]
Aug 04 10:48:53.414007 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:53.413983    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-675pf"]
Aug 04 10:48:53.436652 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:53.436619    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-sz98j"]
Aug 04 10:48:53.440581 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:53.440561    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-sz98j"]
Aug 04 10:48:53.780400 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:53.780311    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60e31a88-c954-4702-93db-d3db774ac444" path="/var/lib/kubelet/pods/60e31a88-c954-4702-93db-d3db774ac444/volumes"
Aug 04 10:48:53.780607 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:53.780589    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92af320e-9b1a-4c83-8934-89081762a946" path="/var/lib/kubelet/pods/92af320e-9b1a-4c83-8934-89081762a946/volumes"
Aug 04 10:48:58.771388 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:58.771358    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-98b8dc8db-4ff7t"]
Aug 04 10:48:58.975893 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:58.975859    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-98b8dc8db-4ff7t"]
Aug 04 10:48:58.976076 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:58.975905    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f96587765-2hx4x"]
Aug 04 10:48:58.976076 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:58.975970    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-98b8dc8db-4ff7t"
Aug 04 10:48:58.978893 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:58.978871    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 10:48:58.979407 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:58.979392    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6vljx\""
Aug 04 10:48:58.979493 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:58.979404    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 10:48:58.989947 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:58.989929    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f96587765-2hx4x"]
Aug 04 10:48:58.990053 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:58.990009    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f96587765-2hx4x"
Aug 04 10:48:58.995063 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:58.995043    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kjqf\" (UniqueName: \"kubernetes.io/projected/13b6797c-442b-437a-be2f-4bd8c0e65b2c-kube-api-access-7kjqf\") pod \"maas-controller-98b8dc8db-4ff7t\" (UID: \"13b6797c-442b-437a-be2f-4bd8c0e65b2c\") " pod="opendatahub/maas-controller-98b8dc8db-4ff7t"
Aug 04 10:48:58.995165 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:58.995122    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13b6797c-442b-437a-be2f-4bd8c0e65b2c-webhook-cert\") pod \"maas-controller-98b8dc8db-4ff7t\" (UID: \"13b6797c-442b-437a-be2f-4bd8c0e65b2c\") " pod="opendatahub/maas-controller-98b8dc8db-4ff7t"
Aug 04 10:48:59.096209 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:59.096186    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kjqf\" (UniqueName: \"kubernetes.io/projected/13b6797c-442b-437a-be2f-4bd8c0e65b2c-kube-api-access-7kjqf\") pod \"maas-controller-98b8dc8db-4ff7t\" (UID: \"13b6797c-442b-437a-be2f-4bd8c0e65b2c\") " pod="opendatahub/maas-controller-98b8dc8db-4ff7t"
Aug 04 10:48:59.096332 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:59.096220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5670e001-05e8-4d55-aa6f-da2740ad5f98-webhook-cert\") pod \"maas-controller-f96587765-2hx4x\" (UID: \"5670e001-05e8-4d55-aa6f-da2740ad5f98\") " pod="opendatahub/maas-controller-f96587765-2hx4x"
Aug 04 10:48:59.096332 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:59.096241    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13b6797c-442b-437a-be2f-4bd8c0e65b2c-webhook-cert\") pod \"maas-controller-98b8dc8db-4ff7t\" (UID: \"13b6797c-442b-437a-be2f-4bd8c0e65b2c\") " pod="opendatahub/maas-controller-98b8dc8db-4ff7t"
Aug 04 10:48:59.096332 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:59.096260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgzkx\" (UniqueName: \"kubernetes.io/projected/5670e001-05e8-4d55-aa6f-da2740ad5f98-kube-api-access-qgzkx\") pod \"maas-controller-f96587765-2hx4x\" (UID: \"5670e001-05e8-4d55-aa6f-da2740ad5f98\") " pod="opendatahub/maas-controller-f96587765-2hx4x"
Aug 04 10:48:59.098657 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:59.098625    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13b6797c-442b-437a-be2f-4bd8c0e65b2c-webhook-cert\") pod \"maas-controller-98b8dc8db-4ff7t\" (UID: \"13b6797c-442b-437a-be2f-4bd8c0e65b2c\") " pod="opendatahub/maas-controller-98b8dc8db-4ff7t"
Aug 04 10:48:59.104261 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:59.104242    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kjqf\" (UniqueName: \"kubernetes.io/projected/13b6797c-442b-437a-be2f-4bd8c0e65b2c-kube-api-access-7kjqf\") pod \"maas-controller-98b8dc8db-4ff7t\" (UID: \"13b6797c-442b-437a-be2f-4bd8c0e65b2c\") " pod="opendatahub/maas-controller-98b8dc8db-4ff7t"
Aug 04 10:48:59.197313 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:59.197284    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5670e001-05e8-4d55-aa6f-da2740ad5f98-webhook-cert\") pod \"maas-controller-f96587765-2hx4x\" (UID: \"5670e001-05e8-4d55-aa6f-da2740ad5f98\") " pod="opendatahub/maas-controller-f96587765-2hx4x"
Aug 04 10:48:59.197421 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:59.197333    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgzkx\" (UniqueName: \"kubernetes.io/projected/5670e001-05e8-4d55-aa6f-da2740ad5f98-kube-api-access-qgzkx\") pod \"maas-controller-f96587765-2hx4x\" (UID: \"5670e001-05e8-4d55-aa6f-da2740ad5f98\") " pod="opendatahub/maas-controller-f96587765-2hx4x"
Aug 04 10:48:59.199438 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:59.199421    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5670e001-05e8-4d55-aa6f-da2740ad5f98-webhook-cert\") pod \"maas-controller-f96587765-2hx4x\" (UID: \"5670e001-05e8-4d55-aa6f-da2740ad5f98\") " pod="opendatahub/maas-controller-f96587765-2hx4x"
Aug 04 10:48:59.209169 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:59.209152    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgzkx\" (UniqueName: \"kubernetes.io/projected/5670e001-05e8-4d55-aa6f-da2740ad5f98-kube-api-access-qgzkx\") pod \"maas-controller-f96587765-2hx4x\" (UID: \"5670e001-05e8-4d55-aa6f-da2740ad5f98\") " pod="opendatahub/maas-controller-f96587765-2hx4x"
Aug 04 10:48:59.286474 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:59.286453    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-98b8dc8db-4ff7t"
Aug 04 10:48:59.299397 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:59.299376    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f96587765-2hx4x"
Aug 04 10:48:59.429629 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:59.429604    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-98b8dc8db-4ff7t"]
Aug 04 10:48:59.432600 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:48:59.432569    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b6797c_442b_437a_be2f_4bd8c0e65b2c.slice/crio-976958326b7d4ee419424c5c25ce562a53117649c923cae9dce68a7d140a5aa9 WatchSource:0}: Error finding container 976958326b7d4ee419424c5c25ce562a53117649c923cae9dce68a7d140a5aa9: Status 404 returned error can't find the container with id 976958326b7d4ee419424c5c25ce562a53117649c923cae9dce68a7d140a5aa9
Aug 04 10:48:59.452295 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:48:59.452182    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f96587765-2hx4x"]
Aug 04 10:48:59.454269 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:48:59.454245    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5670e001_05e8_4d55_aa6f_da2740ad5f98.slice/crio-3c7c7c5617dd0f181c4fe60ace491549fd05a5819a1f6dc9cc87e23fe6137efc WatchSource:0}: Error finding container 3c7c7c5617dd0f181c4fe60ace491549fd05a5819a1f6dc9cc87e23fe6137efc: Status 404 returned error can't find the container with id 3c7c7c5617dd0f181c4fe60ace491549fd05a5819a1f6dc9cc87e23fe6137efc
Aug 04 10:49:00.410480 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:00.410440    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-98b8dc8db-4ff7t" event={"ID":"13b6797c-442b-437a-be2f-4bd8c0e65b2c","Type":"ContainerStarted","Data":"976958326b7d4ee419424c5c25ce562a53117649c923cae9dce68a7d140a5aa9"}
Aug 04 10:49:00.413930 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:00.413894    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f96587765-2hx4x" event={"ID":"5670e001-05e8-4d55-aa6f-da2740ad5f98","Type":"ContainerStarted","Data":"3c7c7c5617dd0f181c4fe60ace491549fd05a5819a1f6dc9cc87e23fe6137efc"}
Aug 04 10:49:02.427692 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:02.427652    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f96587765-2hx4x" event={"ID":"5670e001-05e8-4d55-aa6f-da2740ad5f98","Type":"ContainerStarted","Data":"c0c5bfdf1afab75af7beab68b8a659abe939938cbbd785bfa8f652dc4ae71bbf"}
Aug 04 10:49:02.428134 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:02.427750    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f96587765-2hx4x"
Aug 04 10:49:02.429121 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:02.429099    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-98b8dc8db-4ff7t" event={"ID":"13b6797c-442b-437a-be2f-4bd8c0e65b2c","Type":"ContainerStarted","Data":"c427b3aa688fcfe9f85e66f1f2c88d38068566ea1f4d28522708426b425cc1eb"}
Aug 04 10:49:02.429228 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:02.429218    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-98b8dc8db-4ff7t"
Aug 04 10:49:02.447859 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:02.447813    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f96587765-2hx4x" podStartSLOduration=1.920022628 podStartE2EDuration="4.447793762s" totalImagesPullingTime="2.527771134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:49:02.445899444 +0000 UTC m=+733.171969779" watchObservedRunningTime="2026-08-04 10:49:02.447793762 +0000 UTC m=+733.173864093"
Aug 04 10:49:02.465811 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:02.465768    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-98b8dc8db-4ff7t" podStartSLOduration=1.907537605 podStartE2EDuration="4.4657562s" totalImagesPullingTime="2.558218595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:49:02.464263626 +0000 UTC m=+733.190333966" watchObservedRunningTime="2026-08-04 10:49:02.4657562 +0000 UTC m=+733.191826534"
Aug 04 10:49:13.437750 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:13.437717    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f96587765-2hx4x"
Aug 04 10:49:13.438159 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:13.437802    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-98b8dc8db-4ff7t"
Aug 04 10:49:13.506612 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:13.506573    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-98b8dc8db-4ff7t"]
Aug 04 10:49:13.506876 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:13.506853    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-98b8dc8db-4ff7t" podUID="13b6797c-442b-437a-be2f-4bd8c0e65b2c" containerName="manager" containerID="cri-o://c427b3aa688fcfe9f85e66f1f2c88d38068566ea1f4d28522708426b425cc1eb" gracePeriod=30
Aug 04 10:49:13.752683 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:13.752655    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-98b8dc8db-4ff7t"
Aug 04 10:49:13.812845 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:13.812808    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kjqf\" (UniqueName: \"kubernetes.io/projected/13b6797c-442b-437a-be2f-4bd8c0e65b2c-kube-api-access-7kjqf\") pod \"13b6797c-442b-437a-be2f-4bd8c0e65b2c\" (UID: \"13b6797c-442b-437a-be2f-4bd8c0e65b2c\") "
Aug 04 10:49:13.813041 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:13.812873    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13b6797c-442b-437a-be2f-4bd8c0e65b2c-webhook-cert\") pod \"13b6797c-442b-437a-be2f-4bd8c0e65b2c\" (UID: \"13b6797c-442b-437a-be2f-4bd8c0e65b2c\") "
Aug 04 10:49:13.815236 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:13.815210    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13b6797c-442b-437a-be2f-4bd8c0e65b2c-kube-api-access-7kjqf" (OuterVolumeSpecName: "kube-api-access-7kjqf") pod "13b6797c-442b-437a-be2f-4bd8c0e65b2c" (UID: "13b6797c-442b-437a-be2f-4bd8c0e65b2c"). InnerVolumeSpecName "kube-api-access-7kjqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:49:13.815236 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:13.815212    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13b6797c-442b-437a-be2f-4bd8c0e65b2c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "13b6797c-442b-437a-be2f-4bd8c0e65b2c" (UID: "13b6797c-442b-437a-be2f-4bd8c0e65b2c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:49:13.913906 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:13.913865    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/13b6797c-442b-437a-be2f-4bd8c0e65b2c-webhook-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:49:13.913906 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:13.913897    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kjqf\" (UniqueName: \"kubernetes.io/projected/13b6797c-442b-437a-be2f-4bd8c0e65b2c-kube-api-access-7kjqf\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:49:14.482841 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:14.482801    2559 generic.go:356] "Generic (PLEG): container finished" podID="13b6797c-442b-437a-be2f-4bd8c0e65b2c" containerID="c427b3aa688fcfe9f85e66f1f2c88d38068566ea1f4d28522708426b425cc1eb" exitCode=0
Aug 04 10:49:14.483297 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:14.482859    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-98b8dc8db-4ff7t"
Aug 04 10:49:14.483297 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:14.482861    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-98b8dc8db-4ff7t" event={"ID":"13b6797c-442b-437a-be2f-4bd8c0e65b2c","Type":"ContainerDied","Data":"c427b3aa688fcfe9f85e66f1f2c88d38068566ea1f4d28522708426b425cc1eb"}
Aug 04 10:49:14.483297 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:14.482949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-98b8dc8db-4ff7t" event={"ID":"13b6797c-442b-437a-be2f-4bd8c0e65b2c","Type":"ContainerDied","Data":"976958326b7d4ee419424c5c25ce562a53117649c923cae9dce68a7d140a5aa9"}
Aug 04 10:49:14.483297 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:14.482983    2559 scope.go:117] "RemoveContainer" containerID="c427b3aa688fcfe9f85e66f1f2c88d38068566ea1f4d28522708426b425cc1eb"
Aug 04 10:49:14.491947 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:14.491928    2559 scope.go:117] "RemoveContainer" containerID="c427b3aa688fcfe9f85e66f1f2c88d38068566ea1f4d28522708426b425cc1eb"
Aug 04 10:49:14.492242 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:49:14.492224    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c427b3aa688fcfe9f85e66f1f2c88d38068566ea1f4d28522708426b425cc1eb\": container with ID starting with c427b3aa688fcfe9f85e66f1f2c88d38068566ea1f4d28522708426b425cc1eb not found: ID does not exist" containerID="c427b3aa688fcfe9f85e66f1f2c88d38068566ea1f4d28522708426b425cc1eb"
Aug 04 10:49:14.492314 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:14.492251    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c427b3aa688fcfe9f85e66f1f2c88d38068566ea1f4d28522708426b425cc1eb"} err="failed to get container status \"c427b3aa688fcfe9f85e66f1f2c88d38068566ea1f4d28522708426b425cc1eb\": rpc error: code = NotFound desc = could not find container \"c427b3aa688fcfe9f85e66f1f2c88d38068566ea1f4d28522708426b425cc1eb\": container with ID starting with c427b3aa688fcfe9f85e66f1f2c88d38068566ea1f4d28522708426b425cc1eb not found: ID does not exist"
Aug 04 10:49:14.503967 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:14.503938    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-98b8dc8db-4ff7t"]
Aug 04 10:49:14.506389 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:14.506363    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-98b8dc8db-4ff7t"]
Aug 04 10:49:15.780907 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:15.780874    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13b6797c-442b-437a-be2f-4bd8c0e65b2c" path="/var/lib/kubelet/pods/13b6797c-442b-437a-be2f-4bd8c0e65b2c/volumes"
Aug 04 10:49:35.445283 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.445242    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"]
Aug 04 10:49:35.445887 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.445721    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13b6797c-442b-437a-be2f-4bd8c0e65b2c" containerName="manager"
Aug 04 10:49:35.445887 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.445741    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="13b6797c-442b-437a-be2f-4bd8c0e65b2c" containerName="manager"
Aug 04 10:49:35.445887 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.445827    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="13b6797c-442b-437a-be2f-4bd8c0e65b2c" containerName="manager"
Aug 04 10:49:35.453046 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.453022    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"
Aug 04 10:49:35.455660 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.455625    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vmlb4\""
Aug 04 10:49:35.456367 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.456353    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Aug 04 10:49:35.469309 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.469282    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"]
Aug 04 10:49:35.601088 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.601055    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d7a362d-fdc6-4940-86a5-1aa8e54645d7-openshift-service-ca\") pod \"maas-api-7fb57cb99-ctdfr\" (UID: \"9d7a362d-fdc6-4940-86a5-1aa8e54645d7\") " pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"
Aug 04 10:49:35.601088 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.601092    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7rrf\" (UniqueName: \"kubernetes.io/projected/9d7a362d-fdc6-4940-86a5-1aa8e54645d7-kube-api-access-t7rrf\") pod \"maas-api-7fb57cb99-ctdfr\" (UID: \"9d7a362d-fdc6-4940-86a5-1aa8e54645d7\") " pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"
Aug 04 10:49:35.601342 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.601217    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d7a362d-fdc6-4940-86a5-1aa8e54645d7-maas-api-tls\") pod \"maas-api-7fb57cb99-ctdfr\" (UID: \"9d7a362d-fdc6-4940-86a5-1aa8e54645d7\") " pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"
Aug 04 10:49:35.702736 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.702618    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d7a362d-fdc6-4940-86a5-1aa8e54645d7-maas-api-tls\") pod \"maas-api-7fb57cb99-ctdfr\" (UID: \"9d7a362d-fdc6-4940-86a5-1aa8e54645d7\") " pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"
Aug 04 10:49:35.702736 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.702704    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d7a362d-fdc6-4940-86a5-1aa8e54645d7-openshift-service-ca\") pod \"maas-api-7fb57cb99-ctdfr\" (UID: \"9d7a362d-fdc6-4940-86a5-1aa8e54645d7\") " pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"
Aug 04 10:49:35.702736 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.702731    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7rrf\" (UniqueName: \"kubernetes.io/projected/9d7a362d-fdc6-4940-86a5-1aa8e54645d7-kube-api-access-t7rrf\") pod \"maas-api-7fb57cb99-ctdfr\" (UID: \"9d7a362d-fdc6-4940-86a5-1aa8e54645d7\") " pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"
Aug 04 10:49:35.703390 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.703368    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d7a362d-fdc6-4940-86a5-1aa8e54645d7-openshift-service-ca\") pod \"maas-api-7fb57cb99-ctdfr\" (UID: \"9d7a362d-fdc6-4940-86a5-1aa8e54645d7\") " pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"
Aug 04 10:49:35.705228 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.705203    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d7a362d-fdc6-4940-86a5-1aa8e54645d7-maas-api-tls\") pod \"maas-api-7fb57cb99-ctdfr\" (UID: \"9d7a362d-fdc6-4940-86a5-1aa8e54645d7\") " pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"
Aug 04 10:49:35.711543 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.711518    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7rrf\" (UniqueName: \"kubernetes.io/projected/9d7a362d-fdc6-4940-86a5-1aa8e54645d7-kube-api-access-t7rrf\") pod \"maas-api-7fb57cb99-ctdfr\" (UID: \"9d7a362d-fdc6-4940-86a5-1aa8e54645d7\") " pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"
Aug 04 10:49:35.763441 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.763406    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"
Aug 04 10:49:35.917378 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:35.917353    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"]
Aug 04 10:49:35.919737 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:49:35.919709    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d7a362d_fdc6_4940_86a5_1aa8e54645d7.slice/crio-991d0954adcadf12b6eee480ca2eebd2275f1c867eee34593ebc35bad16370c6 WatchSource:0}: Error finding container 991d0954adcadf12b6eee480ca2eebd2275f1c867eee34593ebc35bad16370c6: Status 404 returned error can't find the container with id 991d0954adcadf12b6eee480ca2eebd2275f1c867eee34593ebc35bad16370c6
Aug 04 10:49:36.588326 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:36.588288    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr" event={"ID":"9d7a362d-fdc6-4940-86a5-1aa8e54645d7","Type":"ContainerStarted","Data":"991d0954adcadf12b6eee480ca2eebd2275f1c867eee34593ebc35bad16370c6"}
Aug 04 10:49:38.597945 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:38.597909    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr" event={"ID":"9d7a362d-fdc6-4940-86a5-1aa8e54645d7","Type":"ContainerStarted","Data":"48435cbb1f48888c45a3de1680e1e2493176a6668a5c843c8edcd620e3a6addd"}
Aug 04 10:49:38.598427 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:38.598037    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"
Aug 04 10:49:38.625275 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:38.625206    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr" podStartSLOduration=1.699586446 podStartE2EDuration="3.625181384s" totalImagesPullingTime="1.925594938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:49:38.621718339 +0000 UTC m=+769.347788674" watchObservedRunningTime="2026-08-04 10:49:38.625181384 +0000 UTC m=+769.351251720"
Aug 04 10:49:44.607288 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:44.607254    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7fb57cb99-ctdfr"
Aug 04 10:49:45.631435 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:45.631402    2559 generic.go:356] "Generic (PLEG): container finished" podID="17dc7398-b910-4116-baaa-376652f9e50c" containerID="7663f402ed2e19da48bdef58e3010954aa27a0964254db556eaabe9de872fbbe" exitCode=0
Aug 04 10:49:45.631883 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:45.631477    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb" event={"ID":"17dc7398-b910-4116-baaa-376652f9e50c","Type":"ContainerDied","Data":"7663f402ed2e19da48bdef58e3010954aa27a0964254db556eaabe9de872fbbe"}
Aug 04 10:49:45.631931 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:45.631897    2559 scope.go:117] "RemoveContainer" containerID="7663f402ed2e19da48bdef58e3010954aa27a0964254db556eaabe9de872fbbe"
Aug 04 10:49:45.633033 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:45.633005    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 10:49:45.633115 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:45.633089    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 10:49:45.633168 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:45.633154    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 10:49:46.638176 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:46.638140    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb" event={"ID":"17dc7398-b910-4116-baaa-376652f9e50c","Type":"ContainerStarted","Data":"ad0a61335ea5a778c9ce37f3fd5b65e45c206cb0f22dd1292b4813002c144d07"}
Aug 04 10:49:47.225017 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:47.224971    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:49:47.225235 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:47.225107    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-dd9rb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Aug 04 10:49:47.225235 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:47.225155    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb" podUID="17dc7398-b910-4116-baaa-376652f9e50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Aug 04 10:49:48.225482 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:48.225434    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-dd9rb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Aug 04 10:49:48.226010 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:48.225520    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb" podUID="17dc7398-b910-4116-baaa-376652f9e50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Aug 04 10:49:49.224864 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:49.224823    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-dd9rb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Aug 04 10:49:49.225156 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:49.225125    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb" podUID="17dc7398-b910-4116-baaa-376652f9e50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Aug 04 10:49:50.225625 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:50.225570    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-dd9rb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Aug 04 10:49:50.226190 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:50.225685    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb" podUID="17dc7398-b910-4116-baaa-376652f9e50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Aug 04 10:49:51.225179 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:51.225140    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-dd9rb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused" start-of-body=
Aug 04 10:49:51.225478 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:51.225450    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb" podUID="17dc7398-b910-4116-baaa-376652f9e50c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.27:15021/healthz/ready\": dial tcp 10.132.0.27:15021: connect: connection refused"
Aug 04 10:49:52.229514 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.229485    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:49:52.229919 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.229846    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:49:52.230733 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.230717    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-dd9rb"
Aug 04 10:49:52.576767 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.576675    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"]
Aug 04 10:49:52.580020 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.579999    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.582376 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.582344    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 04 10:49:52.582376 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.582354    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w2zlt\""
Aug 04 10:49:52.582539 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.582425    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Aug 04 10:49:52.582924 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.582909    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 04 10:49:52.590473 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.590452    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"]
Aug 04 10:49:52.669145 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.669116    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3494acf8-232e-42d7-8cc8-26b62e27b733-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.669145 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.669148    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3494acf8-232e-42d7-8cc8-26b62e27b733-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.669343 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.669172    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmbtj\" (UniqueName: \"kubernetes.io/projected/3494acf8-232e-42d7-8cc8-26b62e27b733-kube-api-access-zmbtj\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.669343 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.669192    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3494acf8-232e-42d7-8cc8-26b62e27b733-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.669343 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.669208    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3494acf8-232e-42d7-8cc8-26b62e27b733-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.669343 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.669248    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3494acf8-232e-42d7-8cc8-26b62e27b733-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.770349 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.770317    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3494acf8-232e-42d7-8cc8-26b62e27b733-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.770349 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.770348    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3494acf8-232e-42d7-8cc8-26b62e27b733-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.770600 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.770385    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmbtj\" (UniqueName: \"kubernetes.io/projected/3494acf8-232e-42d7-8cc8-26b62e27b733-kube-api-access-zmbtj\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.770600 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.770430    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3494acf8-232e-42d7-8cc8-26b62e27b733-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.770600 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.770452    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3494acf8-232e-42d7-8cc8-26b62e27b733-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.770600 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.770485    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3494acf8-232e-42d7-8cc8-26b62e27b733-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.770890 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.770872    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3494acf8-232e-42d7-8cc8-26b62e27b733-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.771018 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.770988    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3494acf8-232e-42d7-8cc8-26b62e27b733-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.771321 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.771064    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3494acf8-232e-42d7-8cc8-26b62e27b733-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.772796 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.772776    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3494acf8-232e-42d7-8cc8-26b62e27b733-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.773112 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.773094    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3494acf8-232e-42d7-8cc8-26b62e27b733-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.779447 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.779425    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmbtj\" (UniqueName: \"kubernetes.io/projected/3494acf8-232e-42d7-8cc8-26b62e27b733-kube-api-access-zmbtj\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76\" (UID: \"3494acf8-232e-42d7-8cc8-26b62e27b733\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:52.891109 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:52.891071    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:49:53.030046 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:53.030007    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"]
Aug 04 10:49:53.032104 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:49:53.032078    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3494acf8_232e_42d7_8cc8_26b62e27b733.slice/crio-69880c0ab50dafa07a211855ef964d3f447e47d74caf19a6f5003cf97a4efe74 WatchSource:0}: Error finding container 69880c0ab50dafa07a211855ef964d3f447e47d74caf19a6f5003cf97a4efe74: Status 404 returned error can't find the container with id 69880c0ab50dafa07a211855ef964d3f447e47d74caf19a6f5003cf97a4efe74
Aug 04 10:49:53.668811 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:53.668770    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76" event={"ID":"3494acf8-232e-42d7-8cc8-26b62e27b733","Type":"ContainerStarted","Data":"69880c0ab50dafa07a211855ef964d3f447e47d74caf19a6f5003cf97a4efe74"}
Aug 04 10:49:54.680038 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:54.680003    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76" event={"ID":"3494acf8-232e-42d7-8cc8-26b62e27b733","Type":"ContainerStarted","Data":"d4a0c4d1f822a05bd36079a98737e64d26fd58ae6069e4f646b650d26c6129f6"}
Aug 04 10:49:54.698719 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:49:54.698668    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76" podStartSLOduration=1.5871660589999999 podStartE2EDuration="2.698651424s" totalImagesPullingTime="1.111485365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:49:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:49:54.697377787 +0000 UTC m=+785.423448142" watchObservedRunningTime="2026-08-04 10:49:54.698651424 +0000 UTC m=+785.424721750"
Aug 04 10:50:02.892143 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:02.892105    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:50:02.892501 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:02.892209    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:50:02.904813 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:02.904777    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:50:03.729523 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:03.729493    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76"
Aug 04 10:50:17.874590 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:17.874513    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"]
Aug 04 10:50:17.877886 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:17.877868    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:17.880175 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:17.880156    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Aug 04 10:50:17.887186 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:17.887160    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"]
Aug 04 10:50:17.994265 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:17.994235    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93aee302-6eec-4276-97b1-752aa7880e57-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:17.994265 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:17.994269    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93aee302-6eec-4276-97b1-752aa7880e57-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:17.994496 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:17.994287    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93aee302-6eec-4276-97b1-752aa7880e57-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:17.994496 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:17.994320    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93aee302-6eec-4276-97b1-752aa7880e57-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:17.994496 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:17.994382    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93aee302-6eec-4276-97b1-752aa7880e57-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:17.994496 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:17.994462    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq8cq\" (UniqueName: \"kubernetes.io/projected/93aee302-6eec-4276-97b1-752aa7880e57-kube-api-access-vq8cq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:18.095611 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.095573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq8cq\" (UniqueName: \"kubernetes.io/projected/93aee302-6eec-4276-97b1-752aa7880e57-kube-api-access-vq8cq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:18.095826 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.095629    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93aee302-6eec-4276-97b1-752aa7880e57-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:18.095826 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.095679    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93aee302-6eec-4276-97b1-752aa7880e57-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:18.095826 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.095701    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93aee302-6eec-4276-97b1-752aa7880e57-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:18.095826 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.095734    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93aee302-6eec-4276-97b1-752aa7880e57-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:18.095826 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.095756    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93aee302-6eec-4276-97b1-752aa7880e57-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:18.096154 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.096130    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93aee302-6eec-4276-97b1-752aa7880e57-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:18.096215 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.096160    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93aee302-6eec-4276-97b1-752aa7880e57-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:18.096215 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.096195    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93aee302-6eec-4276-97b1-752aa7880e57-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:18.098323 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.098297    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93aee302-6eec-4276-97b1-752aa7880e57-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:18.098420 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.098401    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93aee302-6eec-4276-97b1-752aa7880e57-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:18.104135 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.104114    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq8cq\" (UniqueName: \"kubernetes.io/projected/93aee302-6eec-4276-97b1-752aa7880e57-kube-api-access-vq8cq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-whghz\" (UID: \"93aee302-6eec-4276-97b1-752aa7880e57\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:18.188827 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.188744    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:18.329197 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.329160    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"]
Aug 04 10:50:18.331621 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:50:18.331591    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93aee302_6eec_4276_97b1_752aa7880e57.slice/crio-194258f8f7f1a2ea8cf8afbdcf0f3ea33e116585d4c1f1720e120a19fc0e5d62 WatchSource:0}: Error finding container 194258f8f7f1a2ea8cf8afbdcf0f3ea33e116585d4c1f1720e120a19fc0e5d62: Status 404 returned error can't find the container with id 194258f8f7f1a2ea8cf8afbdcf0f3ea33e116585d4c1f1720e120a19fc0e5d62
Aug 04 10:50:18.785717 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.785605    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz" event={"ID":"93aee302-6eec-4276-97b1-752aa7880e57","Type":"ContainerStarted","Data":"7595a308e8ef33c819f7fe39fb1abf4d29204b1261b5528cc072a8d15ff873c7"}
Aug 04 10:50:18.785717 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.785692    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz" event={"ID":"93aee302-6eec-4276-97b1-752aa7880e57","Type":"ContainerStarted","Data":"194258f8f7f1a2ea8cf8afbdcf0f3ea33e116585d4c1f1720e120a19fc0e5d62"}
Aug 04 10:50:18.804839 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:18.804779    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz" podStartSLOduration=1.6365215709999998 podStartE2EDuration="1.804762528s" totalImagesPullingTime="168.240957ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:50:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:50:18.802586442 +0000 UTC m=+809.528656777" watchObservedRunningTime="2026-08-04 10:50:18.804762528 +0000 UTC m=+809.530832863"
Aug 04 10:50:28.189317 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:28.189283    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:28.189740 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:28.189391    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:28.201355 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:28.201333    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:28.837422 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:28.837390    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-whghz"
Aug 04 10:50:52.168137 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.168103    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"]
Aug 04 10:50:52.171024 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.171004    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.174164 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.174145    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Aug 04 10:50:52.184607 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.184585    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"]
Aug 04 10:50:52.252692 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.252662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd2bf965-6927-4566-947c-4675e7f49004-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.252854 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.252728    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd2bf965-6927-4566-947c-4675e7f49004-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.252854 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.252763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd2bf965-6927-4566-947c-4675e7f49004-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.252854 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.252784    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk2vk\" (UniqueName: \"kubernetes.io/projected/bd2bf965-6927-4566-947c-4675e7f49004-kube-api-access-gk2vk\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.252854 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.252844    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd2bf965-6927-4566-947c-4675e7f49004-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.253011 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.252890    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd2bf965-6927-4566-947c-4675e7f49004-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.353780 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.353737    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd2bf965-6927-4566-947c-4675e7f49004-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.353942 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.353796    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd2bf965-6927-4566-947c-4675e7f49004-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.353942 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.353834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd2bf965-6927-4566-947c-4675e7f49004-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.353942 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.353858    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk2vk\" (UniqueName: \"kubernetes.io/projected/bd2bf965-6927-4566-947c-4675e7f49004-kube-api-access-gk2vk\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.353942 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.353901    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd2bf965-6927-4566-947c-4675e7f49004-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.354120 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.353949    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd2bf965-6927-4566-947c-4675e7f49004-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.354344 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.354313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd2bf965-6927-4566-947c-4675e7f49004-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.354344 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.354336    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd2bf965-6927-4566-947c-4675e7f49004-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.354496 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.354347    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd2bf965-6927-4566-947c-4675e7f49004-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.356828 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.356802    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd2bf965-6927-4566-947c-4675e7f49004-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.357058 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.357041    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd2bf965-6927-4566-947c-4675e7f49004-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.364252 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.364226    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk2vk\" (UniqueName: \"kubernetes.io/projected/bd2bf965-6927-4566-947c-4675e7f49004-kube-api-access-gk2vk\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-djhm8\" (UID: \"bd2bf965-6927-4566-947c-4675e7f49004\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.479681 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.479576    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:50:52.617591 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.617568    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"]
Aug 04 10:50:52.620060 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:50:52.620029    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd2bf965_6927_4566_947c_4675e7f49004.slice/crio-8d927f8ad36d5d2695c4e14c593f8d63c8831d67a042d9d595ae0bfc49bc8032 WatchSource:0}: Error finding container 8d927f8ad36d5d2695c4e14c593f8d63c8831d67a042d9d595ae0bfc49bc8032: Status 404 returned error can't find the container with id 8d927f8ad36d5d2695c4e14c593f8d63c8831d67a042d9d595ae0bfc49bc8032
Aug 04 10:50:52.621583 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.621563    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 10:50:52.931921 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.931885    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8" event={"ID":"bd2bf965-6927-4566-947c-4675e7f49004","Type":"ContainerStarted","Data":"ade70b2468cc8df888a0c42a6371dfb61b5bcc14ca53bba84baa1ff394fd05bc"}
Aug 04 10:50:52.931921 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:50:52.931935    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8" event={"ID":"bd2bf965-6927-4566-947c-4675e7f49004","Type":"ContainerStarted","Data":"8d927f8ad36d5d2695c4e14c593f8d63c8831d67a042d9d595ae0bfc49bc8032"}
Aug 04 10:51:02.480196 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:51:02.480156    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:51:02.480578 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:51:02.480217    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:51:02.492424 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:51:02.492400    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:51:02.512366 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:51:02.512309    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8" podStartSLOduration=10.333777177 podStartE2EDuration="10.512294015s" totalImagesPullingTime="178.516838ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:50:52.948794774 +0000 UTC m=+843.674865113" watchObservedRunningTime="2026-08-04 10:51:02.512294015 +0000 UTC m=+853.238364379"
Aug 04 10:51:02.986175 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:51:02.986147    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-djhm8"
Aug 04 10:53:04.860807 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:04.860774    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f96587765-2hx4x"]
Aug 04 10:53:04.861321 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:04.860998    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-f96587765-2hx4x" podUID="5670e001-05e8-4d55-aa6f-da2740ad5f98" containerName="manager" containerID="cri-o://c0c5bfdf1afab75af7beab68b8a659abe939938cbbd785bfa8f652dc4ae71bbf" gracePeriod=30
Aug 04 10:53:05.111694 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.111608    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f96587765-2hx4x"
Aug 04 10:53:05.215461 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.215432    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5670e001-05e8-4d55-aa6f-da2740ad5f98-webhook-cert\") pod \"5670e001-05e8-4d55-aa6f-da2740ad5f98\" (UID: \"5670e001-05e8-4d55-aa6f-da2740ad5f98\") "
Aug 04 10:53:05.215669 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.215476    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgzkx\" (UniqueName: \"kubernetes.io/projected/5670e001-05e8-4d55-aa6f-da2740ad5f98-kube-api-access-qgzkx\") pod \"5670e001-05e8-4d55-aa6f-da2740ad5f98\" (UID: \"5670e001-05e8-4d55-aa6f-da2740ad5f98\") "
Aug 04 10:53:05.217653 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.217607    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5670e001-05e8-4d55-aa6f-da2740ad5f98-kube-api-access-qgzkx" (OuterVolumeSpecName: "kube-api-access-qgzkx") pod "5670e001-05e8-4d55-aa6f-da2740ad5f98" (UID: "5670e001-05e8-4d55-aa6f-da2740ad5f98"). InnerVolumeSpecName "kube-api-access-qgzkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:53:05.217760 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.217703    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5670e001-05e8-4d55-aa6f-da2740ad5f98-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5670e001-05e8-4d55-aa6f-da2740ad5f98" (UID: "5670e001-05e8-4d55-aa6f-da2740ad5f98"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:53:05.316591 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.316555    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5670e001-05e8-4d55-aa6f-da2740ad5f98-webhook-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:53:05.316591 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.316587    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgzkx\" (UniqueName: \"kubernetes.io/projected/5670e001-05e8-4d55-aa6f-da2740ad5f98-kube-api-access-qgzkx\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:53:05.515367 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.515274    2559 generic.go:356] "Generic (PLEG): container finished" podID="5670e001-05e8-4d55-aa6f-da2740ad5f98" containerID="c0c5bfdf1afab75af7beab68b8a659abe939938cbbd785bfa8f652dc4ae71bbf" exitCode=0
Aug 04 10:53:05.515367 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.515320    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f96587765-2hx4x"
Aug 04 10:53:05.515543 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.515368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f96587765-2hx4x" event={"ID":"5670e001-05e8-4d55-aa6f-da2740ad5f98","Type":"ContainerDied","Data":"c0c5bfdf1afab75af7beab68b8a659abe939938cbbd785bfa8f652dc4ae71bbf"}
Aug 04 10:53:05.515543 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.515419    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f96587765-2hx4x" event={"ID":"5670e001-05e8-4d55-aa6f-da2740ad5f98","Type":"ContainerDied","Data":"3c7c7c5617dd0f181c4fe60ace491549fd05a5819a1f6dc9cc87e23fe6137efc"}
Aug 04 10:53:05.515543 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.515441    2559 scope.go:117] "RemoveContainer" containerID="c0c5bfdf1afab75af7beab68b8a659abe939938cbbd785bfa8f652dc4ae71bbf"
Aug 04 10:53:05.524014 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.523994    2559 scope.go:117] "RemoveContainer" containerID="c0c5bfdf1afab75af7beab68b8a659abe939938cbbd785bfa8f652dc4ae71bbf"
Aug 04 10:53:05.524274 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:53:05.524255    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0c5bfdf1afab75af7beab68b8a659abe939938cbbd785bfa8f652dc4ae71bbf\": container with ID starting with c0c5bfdf1afab75af7beab68b8a659abe939938cbbd785bfa8f652dc4ae71bbf not found: ID does not exist" containerID="c0c5bfdf1afab75af7beab68b8a659abe939938cbbd785bfa8f652dc4ae71bbf"
Aug 04 10:53:05.524322 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.524283    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c5bfdf1afab75af7beab68b8a659abe939938cbbd785bfa8f652dc4ae71bbf"} err="failed to get container status \"c0c5bfdf1afab75af7beab68b8a659abe939938cbbd785bfa8f652dc4ae71bbf\": rpc error: code = NotFound desc = could not find container \"c0c5bfdf1afab75af7beab68b8a659abe939938cbbd785bfa8f652dc4ae71bbf\": container with ID starting with c0c5bfdf1afab75af7beab68b8a659abe939938cbbd785bfa8f652dc4ae71bbf not found: ID does not exist"
Aug 04 10:53:05.535900 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.535870    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f96587765-2hx4x"]
Aug 04 10:53:05.540799 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.540774    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f96587765-2hx4x"]
Aug 04 10:53:05.780943 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:53:05.780866    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5670e001-05e8-4d55-aa6f-da2740ad5f98" path="/var/lib/kubelet/pods/5670e001-05e8-4d55-aa6f-da2740ad5f98/volumes"
Aug 04 10:54:06.397086 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.397057    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f96587765-rpfrv"]
Aug 04 10:54:06.397516 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.397381    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5670e001-05e8-4d55-aa6f-da2740ad5f98" containerName="manager"
Aug 04 10:54:06.397516 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.397392    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5670e001-05e8-4d55-aa6f-da2740ad5f98" containerName="manager"
Aug 04 10:54:06.397516 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.397441    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5670e001-05e8-4d55-aa6f-da2740ad5f98" containerName="manager"
Aug 04 10:54:06.400377 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.400360    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f96587765-rpfrv"
Aug 04 10:54:06.403439 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.403418    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 10:54:06.403553 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.403445    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6vljx\""
Aug 04 10:54:06.403553 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.403421    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 10:54:06.409973 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.409953    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f96587765-rpfrv"]
Aug 04 10:54:06.509345 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.509309    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd8ch\" (UniqueName: \"kubernetes.io/projected/47d4b034-082d-4eb0-888d-ae5a2ce69050-kube-api-access-fd8ch\") pod \"maas-controller-f96587765-rpfrv\" (UID: \"47d4b034-082d-4eb0-888d-ae5a2ce69050\") " pod="opendatahub/maas-controller-f96587765-rpfrv"
Aug 04 10:54:06.509543 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.509369    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47d4b034-082d-4eb0-888d-ae5a2ce69050-webhook-cert\") pod \"maas-controller-f96587765-rpfrv\" (UID: \"47d4b034-082d-4eb0-888d-ae5a2ce69050\") " pod="opendatahub/maas-controller-f96587765-rpfrv"
Aug 04 10:54:06.610512 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.610477    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd8ch\" (UniqueName: \"kubernetes.io/projected/47d4b034-082d-4eb0-888d-ae5a2ce69050-kube-api-access-fd8ch\") pod \"maas-controller-f96587765-rpfrv\" (UID: \"47d4b034-082d-4eb0-888d-ae5a2ce69050\") " pod="opendatahub/maas-controller-f96587765-rpfrv"
Aug 04 10:54:06.610742 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.610532    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47d4b034-082d-4eb0-888d-ae5a2ce69050-webhook-cert\") pod \"maas-controller-f96587765-rpfrv\" (UID: \"47d4b034-082d-4eb0-888d-ae5a2ce69050\") " pod="opendatahub/maas-controller-f96587765-rpfrv"
Aug 04 10:54:06.613183 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.613156    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47d4b034-082d-4eb0-888d-ae5a2ce69050-webhook-cert\") pod \"maas-controller-f96587765-rpfrv\" (UID: \"47d4b034-082d-4eb0-888d-ae5a2ce69050\") " pod="opendatahub/maas-controller-f96587765-rpfrv"
Aug 04 10:54:06.619512 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.619490    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd8ch\" (UniqueName: \"kubernetes.io/projected/47d4b034-082d-4eb0-888d-ae5a2ce69050-kube-api-access-fd8ch\") pod \"maas-controller-f96587765-rpfrv\" (UID: \"47d4b034-082d-4eb0-888d-ae5a2ce69050\") " pod="opendatahub/maas-controller-f96587765-rpfrv"
Aug 04 10:54:06.711312 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.711220    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f96587765-rpfrv"
Aug 04 10:54:06.845621 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:06.845597    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f96587765-rpfrv"]
Aug 04 10:54:06.847737 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:54:06.847706    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d4b034_082d_4eb0_888d_ae5a2ce69050.slice/crio-57cd8f658323fd89f7fabc3da888f3bebb278d014820058808fbae83f9866ff6 WatchSource:0}: Error finding container 57cd8f658323fd89f7fabc3da888f3bebb278d014820058808fbae83f9866ff6: Status 404 returned error can't find the container with id 57cd8f658323fd89f7fabc3da888f3bebb278d014820058808fbae83f9866ff6
Aug 04 10:54:07.791984 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:07.791949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f96587765-rpfrv" event={"ID":"47d4b034-082d-4eb0-888d-ae5a2ce69050","Type":"ContainerStarted","Data":"ea6b0de055870be6c86490ad09249f52beed4aff131b9abb8f5731d5651d2d3d"}
Aug 04 10:54:07.792390 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:07.791998    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f96587765-rpfrv" event={"ID":"47d4b034-082d-4eb0-888d-ae5a2ce69050","Type":"ContainerStarted","Data":"57cd8f658323fd89f7fabc3da888f3bebb278d014820058808fbae83f9866ff6"}
Aug 04 10:54:07.792390 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:07.792029    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f96587765-rpfrv"
Aug 04 10:54:07.811748 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:07.811653    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f96587765-rpfrv" podStartSLOduration=1.113463206 podStartE2EDuration="1.811623128s" totalImagesPullingTime="698.159922ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:54:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:54:07.809532771 +0000 UTC m=+1038.535603107" watchObservedRunningTime="2026-08-04 10:54:07.811623128 +0000 UTC m=+1038.537693463"
Aug 04 10:54:18.798561 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:18.798530    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f96587765-rpfrv"
Aug 04 10:54:23.403736 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.403692    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f96587765-rpfrv"]
Aug 04 10:54:23.404255 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.404008    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-f96587765-rpfrv" podUID="47d4b034-082d-4eb0-888d-ae5a2ce69050" containerName="manager" containerID="cri-o://ea6b0de055870be6c86490ad09249f52beed4aff131b9abb8f5731d5651d2d3d" gracePeriod=30
Aug 04 10:54:23.661361 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.661294    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f96587765-rpfrv"
Aug 04 10:54:23.756600 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.756569    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd8ch\" (UniqueName: \"kubernetes.io/projected/47d4b034-082d-4eb0-888d-ae5a2ce69050-kube-api-access-fd8ch\") pod \"47d4b034-082d-4eb0-888d-ae5a2ce69050\" (UID: \"47d4b034-082d-4eb0-888d-ae5a2ce69050\") "
Aug 04 10:54:23.756784 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.756690    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47d4b034-082d-4eb0-888d-ae5a2ce69050-webhook-cert\") pod \"47d4b034-082d-4eb0-888d-ae5a2ce69050\" (UID: \"47d4b034-082d-4eb0-888d-ae5a2ce69050\") "
Aug 04 10:54:23.758974 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.758938    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47d4b034-082d-4eb0-888d-ae5a2ce69050-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "47d4b034-082d-4eb0-888d-ae5a2ce69050" (UID: "47d4b034-082d-4eb0-888d-ae5a2ce69050"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 10:54:23.759103 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.758979    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47d4b034-082d-4eb0-888d-ae5a2ce69050-kube-api-access-fd8ch" (OuterVolumeSpecName: "kube-api-access-fd8ch") pod "47d4b034-082d-4eb0-888d-ae5a2ce69050" (UID: "47d4b034-082d-4eb0-888d-ae5a2ce69050"). InnerVolumeSpecName "kube-api-access-fd8ch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 10:54:23.857553 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.857520    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47d4b034-082d-4eb0-888d-ae5a2ce69050-webhook-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:54:23.857553 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.857548    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd8ch\" (UniqueName: \"kubernetes.io/projected/47d4b034-082d-4eb0-888d-ae5a2ce69050-kube-api-access-fd8ch\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 10:54:23.861564 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.861532    2559 generic.go:356] "Generic (PLEG): container finished" podID="47d4b034-082d-4eb0-888d-ae5a2ce69050" containerID="ea6b0de055870be6c86490ad09249f52beed4aff131b9abb8f5731d5651d2d3d" exitCode=0
Aug 04 10:54:23.861726 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.861582    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f96587765-rpfrv"
Aug 04 10:54:23.861726 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.861615    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f96587765-rpfrv" event={"ID":"47d4b034-082d-4eb0-888d-ae5a2ce69050","Type":"ContainerDied","Data":"ea6b0de055870be6c86490ad09249f52beed4aff131b9abb8f5731d5651d2d3d"}
Aug 04 10:54:23.861726 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.861690    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f96587765-rpfrv" event={"ID":"47d4b034-082d-4eb0-888d-ae5a2ce69050","Type":"ContainerDied","Data":"57cd8f658323fd89f7fabc3da888f3bebb278d014820058808fbae83f9866ff6"}
Aug 04 10:54:23.861726 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.861713    2559 scope.go:117] "RemoveContainer" containerID="ea6b0de055870be6c86490ad09249f52beed4aff131b9abb8f5731d5651d2d3d"
Aug 04 10:54:23.870678 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.870658    2559 scope.go:117] "RemoveContainer" containerID="ea6b0de055870be6c86490ad09249f52beed4aff131b9abb8f5731d5651d2d3d"
Aug 04 10:54:23.870937 ip-10-0-136-162 kubenswrapper[2559]: E0804 10:54:23.870913    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea6b0de055870be6c86490ad09249f52beed4aff131b9abb8f5731d5651d2d3d\": container with ID starting with ea6b0de055870be6c86490ad09249f52beed4aff131b9abb8f5731d5651d2d3d not found: ID does not exist" containerID="ea6b0de055870be6c86490ad09249f52beed4aff131b9abb8f5731d5651d2d3d"
Aug 04 10:54:23.871002 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.870946    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6b0de055870be6c86490ad09249f52beed4aff131b9abb8f5731d5651d2d3d"} err="failed to get container status \"ea6b0de055870be6c86490ad09249f52beed4aff131b9abb8f5731d5651d2d3d\": rpc error: code = NotFound desc = could not find container \"ea6b0de055870be6c86490ad09249f52beed4aff131b9abb8f5731d5651d2d3d\": container with ID starting with ea6b0de055870be6c86490ad09249f52beed4aff131b9abb8f5731d5651d2d3d not found: ID does not exist"
Aug 04 10:54:23.878290 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.878261    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f96587765-rpfrv"]
Aug 04 10:54:23.881490 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:23.881467    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f96587765-rpfrv"]
Aug 04 10:54:24.643004 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.642970    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f96587765-qrm9c"]
Aug 04 10:54:24.643444 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.643312    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47d4b034-082d-4eb0-888d-ae5a2ce69050" containerName="manager"
Aug 04 10:54:24.643444 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.643329    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="47d4b034-082d-4eb0-888d-ae5a2ce69050" containerName="manager"
Aug 04 10:54:24.643444 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.643382    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="47d4b034-082d-4eb0-888d-ae5a2ce69050" containerName="manager"
Aug 04 10:54:24.647508 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.647482    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f96587765-qrm9c"
Aug 04 10:54:24.650516 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.650495    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6vljx\""
Aug 04 10:54:24.650628 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.650533    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 10:54:24.650628 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.650543    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 10:54:24.654151 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.654105    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f96587765-qrm9c"]
Aug 04 10:54:24.764879 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.764833    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81cf906d-3725-409e-996d-3b524aeaa43d-webhook-cert\") pod \"maas-controller-f96587765-qrm9c\" (UID: \"81cf906d-3725-409e-996d-3b524aeaa43d\") " pod="opendatahub/maas-controller-f96587765-qrm9c"
Aug 04 10:54:24.765047 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.764916    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mffm9\" (UniqueName: \"kubernetes.io/projected/81cf906d-3725-409e-996d-3b524aeaa43d-kube-api-access-mffm9\") pod \"maas-controller-f96587765-qrm9c\" (UID: \"81cf906d-3725-409e-996d-3b524aeaa43d\") " pod="opendatahub/maas-controller-f96587765-qrm9c"
Aug 04 10:54:24.866099 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.866069    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81cf906d-3725-409e-996d-3b524aeaa43d-webhook-cert\") pod \"maas-controller-f96587765-qrm9c\" (UID: \"81cf906d-3725-409e-996d-3b524aeaa43d\") " pod="opendatahub/maas-controller-f96587765-qrm9c"
Aug 04 10:54:24.866287 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.866130    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mffm9\" (UniqueName: \"kubernetes.io/projected/81cf906d-3725-409e-996d-3b524aeaa43d-kube-api-access-mffm9\") pod \"maas-controller-f96587765-qrm9c\" (UID: \"81cf906d-3725-409e-996d-3b524aeaa43d\") " pod="opendatahub/maas-controller-f96587765-qrm9c"
Aug 04 10:54:24.868887 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.868865    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81cf906d-3725-409e-996d-3b524aeaa43d-webhook-cert\") pod \"maas-controller-f96587765-qrm9c\" (UID: \"81cf906d-3725-409e-996d-3b524aeaa43d\") " pod="opendatahub/maas-controller-f96587765-qrm9c"
Aug 04 10:54:24.874246 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.874218    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mffm9\" (UniqueName: \"kubernetes.io/projected/81cf906d-3725-409e-996d-3b524aeaa43d-kube-api-access-mffm9\") pod \"maas-controller-f96587765-qrm9c\" (UID: \"81cf906d-3725-409e-996d-3b524aeaa43d\") " pod="opendatahub/maas-controller-f96587765-qrm9c"
Aug 04 10:54:24.958885 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:24.958806    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f96587765-qrm9c"
Aug 04 10:54:25.094451 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:25.094428    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f96587765-qrm9c"]
Aug 04 10:54:25.096995 ip-10-0-136-162 kubenswrapper[2559]: W0804 10:54:25.096967    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81cf906d_3725_409e_996d_3b524aeaa43d.slice/crio-22553f2731e226a767de3fd7d0ec132fd57ce62618e55eb5408dda631a7214a8 WatchSource:0}: Error finding container 22553f2731e226a767de3fd7d0ec132fd57ce62618e55eb5408dda631a7214a8: Status 404 returned error can't find the container with id 22553f2731e226a767de3fd7d0ec132fd57ce62618e55eb5408dda631a7214a8
Aug 04 10:54:25.782087 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:25.782009    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47d4b034-082d-4eb0-888d-ae5a2ce69050" path="/var/lib/kubelet/pods/47d4b034-082d-4eb0-888d-ae5a2ce69050/volumes"
Aug 04 10:54:25.874325 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:25.874288    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f96587765-qrm9c" event={"ID":"81cf906d-3725-409e-996d-3b524aeaa43d","Type":"ContainerStarted","Data":"b15ade5554d03916bbaa5ef2669db65816531c4c24b59a5aba370506d78624ef"}
Aug 04 10:54:25.874478 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:25.874342    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f96587765-qrm9c" event={"ID":"81cf906d-3725-409e-996d-3b524aeaa43d","Type":"ContainerStarted","Data":"22553f2731e226a767de3fd7d0ec132fd57ce62618e55eb5408dda631a7214a8"}
Aug 04 10:54:25.874478 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:25.874449    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f96587765-qrm9c"
Aug 04 10:54:25.892823 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:25.892764    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f96587765-qrm9c" podStartSLOduration=1.6041717530000001 podStartE2EDuration="1.892740239s" totalImagesPullingTime="288.568486ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:54:25.89203247 +0000 UTC m=+1056.618102806" watchObservedRunningTime="2026-08-04 10:54:25.892740239 +0000 UTC m=+1056.618810575"
Aug 04 10:54:36.881368 ip-10-0-136-162 kubenswrapper[2559]: I0804 10:54:36.881331    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f96587765-qrm9c"
Aug 04 11:04:59.267195 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.267164    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"]
Aug 04 11:04:59.270429 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.270412    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.273200 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.273181    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-259f1614-kserve-self-signed-certs\""
Aug 04 11:04:59.287053 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.287025    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"]
Aug 04 11:04:59.340579 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.340552    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-tmp-dir\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.340736 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.340601    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd28d66-ef53-4d31-b60b-b69698dc9aed-tls-certs\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.340779 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.340736    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-home\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.340779 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.340765    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68wzn\" (UniqueName: \"kubernetes.io/projected/bcd28d66-ef53-4d31-b60b-b69698dc9aed-kube-api-access-68wzn\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.340848 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.340794    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-model-cache\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.340898 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.340844    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-dshm\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.441688 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.441625    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-home\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.441688 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.441693    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68wzn\" (UniqueName: \"kubernetes.io/projected/bcd28d66-ef53-4d31-b60b-b69698dc9aed-kube-api-access-68wzn\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.441989 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.441719    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-model-cache\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.441989 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.441753    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-dshm\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.441989 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.441784    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-tmp-dir\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.441989 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.441835    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd28d66-ef53-4d31-b60b-b69698dc9aed-tls-certs\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.442391 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.442123    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-home\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.442391 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.442260    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-model-cache\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.442391 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.442333    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-tmp-dir\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.444431 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.444411    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-dshm\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.444825 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.444807    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd28d66-ef53-4d31-b60b-b69698dc9aed-tls-certs\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.449113 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.449090    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68wzn\" (UniqueName: \"kubernetes.io/projected/bcd28d66-ef53-4d31-b60b-b69698dc9aed-kube-api-access-68wzn\") pod \"e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") " pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.580429 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.580354    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:04:59.711396 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:04:59.711360    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"]
Aug 04 11:04:59.714390 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:04:59.714361    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcd28d66_ef53_4d31_b60b_b69698dc9aed.slice/crio-d3d84b6b59da5b837313522d9bbae87b2931d6eb91bc204d7d87323617788a73 WatchSource:0}: Error finding container d3d84b6b59da5b837313522d9bbae87b2931d6eb91bc204d7d87323617788a73: Status 404 returned error can't find the container with id d3d84b6b59da5b837313522d9bbae87b2931d6eb91bc204d7d87323617788a73
Aug 04 11:05:00.701042 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:00.701008    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb" event={"ID":"bcd28d66-ef53-4d31-b60b-b69698dc9aed","Type":"ContainerStarted","Data":"072283d036018ae290f350898b771c9a9398c15a98b8345ce414d507dcc1c25d"}
Aug 04 11:05:00.701042 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:00.701048    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb" event={"ID":"bcd28d66-ef53-4d31-b60b-b69698dc9aed","Type":"ContainerStarted","Data":"d3d84b6b59da5b837313522d9bbae87b2931d6eb91bc204d7d87323617788a73"}
Aug 04 11:05:00.716615 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:00.716563    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb" podStartSLOduration=1.716543921 podStartE2EDuration="1.716543921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:04:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:05:00.716075994 +0000 UTC m=+1691.442146341" watchObservedRunningTime="2026-08-04 11:05:00.716543921 +0000 UTC m=+1691.442614262"
Aug 04 11:05:06.968627 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:06.968591    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"]
Aug 04 11:05:06.972838 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:06.972813    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:06.975125 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:06.975104    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-259f1614-kserve-self-signed-certs\""
Aug 04 11:05:06.995222 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:06.995190    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"]
Aug 04 11:05:07.105454 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.105423    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6glf\" (UniqueName: \"kubernetes.io/projected/af867ee4-e264-4c5b-8ba6-670c1caa9802-kube-api-access-w6glf\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.105598 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.105461    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-dshm\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.105598 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.105489    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af867ee4-e264-4c5b-8ba6-670c1caa9802-tls-certs\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.105689 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.105586    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-model-cache\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.105689 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.105626    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-tmp-dir\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.105689 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.105675    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-home\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.206714 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.206675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-model-cache\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.206714 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.206715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-tmp-dir\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.206921 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.206755    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-home\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.206921 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.206794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6glf\" (UniqueName: \"kubernetes.io/projected/af867ee4-e264-4c5b-8ba6-670c1caa9802-kube-api-access-w6glf\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.206921 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.206829    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-dshm\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.206921 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.206866    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af867ee4-e264-4c5b-8ba6-670c1caa9802-tls-certs\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.207158 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.207139    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-model-cache\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.207193 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.207176    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-tmp-dir\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.207226 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.207203    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-home\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.209225 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.209196    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-dshm\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.209776 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.209756    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af867ee4-e264-4c5b-8ba6-670c1caa9802-tls-certs\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.216190 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.216168    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6glf\" (UniqueName: \"kubernetes.io/projected/af867ee4-e264-4c5b-8ba6-670c1caa9802-kube-api-access-w6glf\") pod \"e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") " pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.284775 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.284703    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:07.420140 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.420115    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"]
Aug 04 11:05:07.422094 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:05:07.422063    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf867ee4_e264_4c5b_8ba6_670c1caa9802.slice/crio-9334faebec3d9c8699bde1b67f6ff9e41507806e666149f8f1be7ddf6602bec9 WatchSource:0}: Error finding container 9334faebec3d9c8699bde1b67f6ff9e41507806e666149f8f1be7ddf6602bec9: Status 404 returned error can't find the container with id 9334faebec3d9c8699bde1b67f6ff9e41507806e666149f8f1be7ddf6602bec9
Aug 04 11:05:07.733576 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.733542    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd" event={"ID":"af867ee4-e264-4c5b-8ba6-670c1caa9802","Type":"ContainerStarted","Data":"02585c202ba38c7733f5a8e852dc90c63efedbcbae08c14583cdb9c636e25c25"}
Aug 04 11:05:07.733741 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.733582    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd" event={"ID":"af867ee4-e264-4c5b-8ba6-670c1caa9802","Type":"ContainerStarted","Data":"9334faebec3d9c8699bde1b67f6ff9e41507806e666149f8f1be7ddf6602bec9"}
Aug 04 11:05:07.750754 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:07.750713    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd" podStartSLOduration=1.750698029 podStartE2EDuration="1.750698029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:05:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:05:07.749262223 +0000 UTC m=+1698.475332581" watchObservedRunningTime="2026-08-04 11:05:07.750698029 +0000 UTC m=+1698.476768364"
Aug 04 11:05:09.581505 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:09.581421    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:05:09.581505 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:09.581469    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:05:09.593815 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:09.593785    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:05:09.762428 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:09.762398    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:05:17.285679 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:17.285579    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:17.285679 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:17.285629    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:17.298317 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:17.298294    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:17.799214 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:17.799187    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:32.762248 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:32.762213    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"]
Aug 04 11:05:34.254633 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:34.254587    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"]
Aug 04 11:05:47.785446 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:47.785389    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb" podUID="bcd28d66-ef53-4d31-b60b-b69698dc9aed" containerName="main" containerID="cri-o://072283d036018ae290f350898b771c9a9398c15a98b8345ce414d507dcc1c25d" gracePeriod=45
Aug 04 11:05:47.930780 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:47.930744    2559 generic.go:356] "Generic (PLEG): container finished" podID="bcd28d66-ef53-4d31-b60b-b69698dc9aed" containerID="072283d036018ae290f350898b771c9a9398c15a98b8345ce414d507dcc1c25d" exitCode=0
Aug 04 11:05:47.930999 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:47.930830    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb" event={"ID":"bcd28d66-ef53-4d31-b60b-b69698dc9aed","Type":"ContainerDied","Data":"072283d036018ae290f350898b771c9a9398c15a98b8345ce414d507dcc1c25d"}
Aug 04 11:05:48.024333 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.024305    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:05:48.129803 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.129776    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-dshm\") pod \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") "
Aug 04 11:05:48.129958 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.129813    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68wzn\" (UniqueName: \"kubernetes.io/projected/bcd28d66-ef53-4d31-b60b-b69698dc9aed-kube-api-access-68wzn\") pod \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") "
Aug 04 11:05:48.129958 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.129861    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-model-cache\") pod \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") "
Aug 04 11:05:48.129958 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.129894    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-home\") pod \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") "
Aug 04 11:05:48.129958 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.129925    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-tmp-dir\") pod \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") "
Aug 04 11:05:48.130180 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.129998    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd28d66-ef53-4d31-b60b-b69698dc9aed-tls-certs\") pod \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\" (UID: \"bcd28d66-ef53-4d31-b60b-b69698dc9aed\") "
Aug 04 11:05:48.130231 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.130205    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-home" (OuterVolumeSpecName: "home") pod "bcd28d66-ef53-4d31-b60b-b69698dc9aed" (UID: "bcd28d66-ef53-4d31-b60b-b69698dc9aed"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:05:48.130231 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.130199    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-model-cache" (OuterVolumeSpecName: "model-cache") pod "bcd28d66-ef53-4d31-b60b-b69698dc9aed" (UID: "bcd28d66-ef53-4d31-b60b-b69698dc9aed"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:05:48.130342 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.130311    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bcd28d66-ef53-4d31-b60b-b69698dc9aed" (UID: "bcd28d66-ef53-4d31-b60b-b69698dc9aed"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:05:48.130342 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.130329    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-model-cache\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:05:48.130438 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.130345    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-home\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:05:48.132232 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.132203    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-dshm" (OuterVolumeSpecName: "dshm") pod "bcd28d66-ef53-4d31-b60b-b69698dc9aed" (UID: "bcd28d66-ef53-4d31-b60b-b69698dc9aed"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:05:48.132339 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.132234    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcd28d66-ef53-4d31-b60b-b69698dc9aed-kube-api-access-68wzn" (OuterVolumeSpecName: "kube-api-access-68wzn") pod "bcd28d66-ef53-4d31-b60b-b69698dc9aed" (UID: "bcd28d66-ef53-4d31-b60b-b69698dc9aed"). InnerVolumeSpecName "kube-api-access-68wzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:05:48.132339 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.132229    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcd28d66-ef53-4d31-b60b-b69698dc9aed-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bcd28d66-ef53-4d31-b60b-b69698dc9aed" (UID: "bcd28d66-ef53-4d31-b60b-b69698dc9aed"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:05:48.231274 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.231238    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-tmp-dir\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:05:48.231274 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.231265    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd28d66-ef53-4d31-b60b-b69698dc9aed-tls-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:05:48.231274 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.231277    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcd28d66-ef53-4d31-b60b-b69698dc9aed-dshm\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:05:48.231487 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.231288    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68wzn\" (UniqueName: \"kubernetes.io/projected/bcd28d66-ef53-4d31-b60b-b69698dc9aed-kube-api-access-68wzn\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:05:48.936616 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.936581    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"
Aug 04 11:05:48.937076 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.936618    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb" event={"ID":"bcd28d66-ef53-4d31-b60b-b69698dc9aed","Type":"ContainerDied","Data":"d3d84b6b59da5b837313522d9bbae87b2931d6eb91bc204d7d87323617788a73"}
Aug 04 11:05:48.937076 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.936684    2559 scope.go:117] "RemoveContainer" containerID="072283d036018ae290f350898b771c9a9398c15a98b8345ce414d507dcc1c25d"
Aug 04 11:05:48.957514 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.957489    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"]
Aug 04 11:05:48.961136 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:48.961115    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-259f1614-kserve-57546b44b7-zzmmb"]
Aug 04 11:05:49.274436 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.274348    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd" podUID="af867ee4-e264-4c5b-8ba6-670c1caa9802" containerName="main" containerID="cri-o://02585c202ba38c7733f5a8e852dc90c63efedbcbae08c14583cdb9c636e25c25" gracePeriod=45
Aug 04 11:05:49.530545 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.530491    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:49.642525 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.642490    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-model-cache\") pod \"af867ee4-e264-4c5b-8ba6-670c1caa9802\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") "
Aug 04 11:05:49.642755 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.642613    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-tmp-dir\") pod \"af867ee4-e264-4c5b-8ba6-670c1caa9802\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") "
Aug 04 11:05:49.642755 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.642690    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6glf\" (UniqueName: \"kubernetes.io/projected/af867ee4-e264-4c5b-8ba6-670c1caa9802-kube-api-access-w6glf\") pod \"af867ee4-e264-4c5b-8ba6-670c1caa9802\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") "
Aug 04 11:05:49.642755 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.642722    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af867ee4-e264-4c5b-8ba6-670c1caa9802-tls-certs\") pod \"af867ee4-e264-4c5b-8ba6-670c1caa9802\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") "
Aug 04 11:05:49.642931 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.642762    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-dshm\") pod \"af867ee4-e264-4c5b-8ba6-670c1caa9802\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") "
Aug 04 11:05:49.642931 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.642771    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-model-cache" (OuterVolumeSpecName: "model-cache") pod "af867ee4-e264-4c5b-8ba6-670c1caa9802" (UID: "af867ee4-e264-4c5b-8ba6-670c1caa9802"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:05:49.642931 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.642824    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-home\") pod \"af867ee4-e264-4c5b-8ba6-670c1caa9802\" (UID: \"af867ee4-e264-4c5b-8ba6-670c1caa9802\") "
Aug 04 11:05:49.642931 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.642863    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "af867ee4-e264-4c5b-8ba6-670c1caa9802" (UID: "af867ee4-e264-4c5b-8ba6-670c1caa9802"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:05:49.643115 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.643064    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-home" (OuterVolumeSpecName: "home") pod "af867ee4-e264-4c5b-8ba6-670c1caa9802" (UID: "af867ee4-e264-4c5b-8ba6-670c1caa9802"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:05:49.643115 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.643067    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-tmp-dir\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:05:49.643115 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.643092    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-model-cache\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:05:49.645084 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.645048    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-dshm" (OuterVolumeSpecName: "dshm") pod "af867ee4-e264-4c5b-8ba6-670c1caa9802" (UID: "af867ee4-e264-4c5b-8ba6-670c1caa9802"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:05:49.645207 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.645122    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af867ee4-e264-4c5b-8ba6-670c1caa9802-kube-api-access-w6glf" (OuterVolumeSpecName: "kube-api-access-w6glf") pod "af867ee4-e264-4c5b-8ba6-670c1caa9802" (UID: "af867ee4-e264-4c5b-8ba6-670c1caa9802"). InnerVolumeSpecName "kube-api-access-w6glf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:05:49.645207 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.645143    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af867ee4-e264-4c5b-8ba6-670c1caa9802-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "af867ee4-e264-4c5b-8ba6-670c1caa9802" (UID: "af867ee4-e264-4c5b-8ba6-670c1caa9802"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:05:49.744328 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.744294    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-dshm\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:05:49.744328 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.744319    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af867ee4-e264-4c5b-8ba6-670c1caa9802-home\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:05:49.744328 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.744331    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6glf\" (UniqueName: \"kubernetes.io/projected/af867ee4-e264-4c5b-8ba6-670c1caa9802-kube-api-access-w6glf\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:05:49.744547 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.744340    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af867ee4-e264-4c5b-8ba6-670c1caa9802-tls-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:05:49.781308 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.781231    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcd28d66-ef53-4d31-b60b-b69698dc9aed" path="/var/lib/kubelet/pods/bcd28d66-ef53-4d31-b60b-b69698dc9aed/volumes"
Aug 04 11:05:49.942296 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.942272    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"
Aug 04 11:05:49.942698 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.942263    2559 generic.go:356] "Generic (PLEG): container finished" podID="af867ee4-e264-4c5b-8ba6-670c1caa9802" containerID="02585c202ba38c7733f5a8e852dc90c63efedbcbae08c14583cdb9c636e25c25" exitCode=0
Aug 04 11:05:49.942698 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.942266    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd" event={"ID":"af867ee4-e264-4c5b-8ba6-670c1caa9802","Type":"ContainerDied","Data":"02585c202ba38c7733f5a8e852dc90c63efedbcbae08c14583cdb9c636e25c25"}
Aug 04 11:05:49.942698 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.942536    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd" event={"ID":"af867ee4-e264-4c5b-8ba6-670c1caa9802","Type":"ContainerDied","Data":"9334faebec3d9c8699bde1b67f6ff9e41507806e666149f8f1be7ddf6602bec9"}
Aug 04 11:05:49.942698 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.942569    2559 scope.go:117] "RemoveContainer" containerID="02585c202ba38c7733f5a8e852dc90c63efedbcbae08c14583cdb9c636e25c25"
Aug 04 11:05:49.952515 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.952491    2559 scope.go:117] "RemoveContainer" containerID="02585c202ba38c7733f5a8e852dc90c63efedbcbae08c14583cdb9c636e25c25"
Aug 04 11:05:49.952989 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:05:49.952955    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02585c202ba38c7733f5a8e852dc90c63efedbcbae08c14583cdb9c636e25c25\": container with ID starting with 02585c202ba38c7733f5a8e852dc90c63efedbcbae08c14583cdb9c636e25c25 not found: ID does not exist" containerID="02585c202ba38c7733f5a8e852dc90c63efedbcbae08c14583cdb9c636e25c25"
Aug 04 11:05:49.953110 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.953003    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02585c202ba38c7733f5a8e852dc90c63efedbcbae08c14583cdb9c636e25c25"} err="failed to get container status \"02585c202ba38c7733f5a8e852dc90c63efedbcbae08c14583cdb9c636e25c25\": rpc error: code = NotFound desc = could not find container \"02585c202ba38c7733f5a8e852dc90c63efedbcbae08c14583cdb9c636e25c25\": container with ID starting with 02585c202ba38c7733f5a8e852dc90c63efedbcbae08c14583cdb9c636e25c25 not found: ID does not exist"
Aug 04 11:05:49.957821 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.957793    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"]
Aug 04 11:05:49.961211 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:49.961180    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-259f1614-kserve-745f4c576c-vttrd"]
Aug 04 11:05:51.787400 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:05:51.787363    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af867ee4-e264-4c5b-8ba6-670c1caa9802" path="/var/lib/kubelet/pods/af867ee4-e264-4c5b-8ba6-670c1caa9802/volumes"
Aug 04 11:09:31.098605 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.098570    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"]
Aug 04 11:09:31.099117 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.099094    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af867ee4-e264-4c5b-8ba6-670c1caa9802" containerName="main"
Aug 04 11:09:31.099161 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.099123    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="af867ee4-e264-4c5b-8ba6-670c1caa9802" containerName="main"
Aug 04 11:09:31.099161 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.099147    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcd28d66-ef53-4d31-b60b-b69698dc9aed" containerName="main"
Aug 04 11:09:31.099161 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.099156    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcd28d66-ef53-4d31-b60b-b69698dc9aed" containerName="main"
Aug 04 11:09:31.099271 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.099248    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="af867ee4-e264-4c5b-8ba6-670c1caa9802" containerName="main"
Aug 04 11:09:31.099271 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.099263    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcd28d66-ef53-4d31-b60b-b69698dc9aed" containerName="main"
Aug 04 11:09:31.101971 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.101955    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.104091 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.104075    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6279d3cc-openshift-default-dockercfg-b9c92\""
Aug 04 11:09:31.119628 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.119595    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"]
Aug 04 11:09:31.272260 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.272225    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-workload-certs\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.272422 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.272274    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6tb6\" (UniqueName: \"kubernetes.io/projected/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-kube-api-access-z6tb6\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.272422 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.272294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-workload-socket\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.272422 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.272351    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-podinfo\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.272422 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.272391    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-envoy\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.272422 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.272411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istiod-ca-cert\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.272585 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.272481    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-data\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.272585 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.272535    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-credential-socket\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.272585 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.272557    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-token\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.374025 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.373945    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6tb6\" (UniqueName: \"kubernetes.io/projected/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-kube-api-access-z6tb6\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.374025 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.373983    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-workload-socket\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.374197 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.374113    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-podinfo\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.374197 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.374155    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-envoy\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.374197 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.374178    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istiod-ca-cert\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.374322 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.374230    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-data\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.374322 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.374290    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-credential-socket\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.374322 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.374313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-token\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.374322 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.374313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-workload-socket\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.374520 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.374417    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-workload-certs\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.374681 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.374658    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-data\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.374772 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.374716    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-credential-socket\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.374772 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.374746    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-workload-certs\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.375005 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.374982    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istiod-ca-cert\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.376440 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.376418    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-envoy\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.376567 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.376551    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-podinfo\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.381919 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.381893    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-token\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.382042 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.382024    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6tb6\" (UniqueName: \"kubernetes.io/projected/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-kube-api-access-z6tb6\") pod \"e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") " pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.412142 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.412117    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:31.548299 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.548273    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"]
Aug 04 11:09:31.550204 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:09:31.550171    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601fff74_9391_4e27_8f7d_8f1d3b4b8baf.slice/crio-32245baf995b2fc8981422d172e04feb2716db6bbf30eba4bc44397f0450f8c8 WatchSource:0}: Error finding container 32245baf995b2fc8981422d172e04feb2716db6bbf30eba4bc44397f0450f8c8: Status 404 returned error can't find the container with id 32245baf995b2fc8981422d172e04feb2716db6bbf30eba4bc44397f0450f8c8
Aug 04 11:09:31.552412 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.552377    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:09:31.552479 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.552459    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:09:31.552515 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.552502    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:09:31.936154 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.936118    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt" event={"ID":"601fff74-9391-4e27-8f7d-8f1d3b4b8baf","Type":"ContainerStarted","Data":"b46a156f7cc9284949e7a07953fb335ca53caef006f24c325bc780e466caa020"}
Aug 04 11:09:31.936336 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.936167    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt" event={"ID":"601fff74-9391-4e27-8f7d-8f1d3b4b8baf","Type":"ContainerStarted","Data":"32245baf995b2fc8981422d172e04feb2716db6bbf30eba4bc44397f0450f8c8"}
Aug 04 11:09:31.955769 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:31.955722    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt" podStartSLOduration=0.955709909 podStartE2EDuration="955.709909ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:09:31.953743556 +0000 UTC m=+1962.679813890" watchObservedRunningTime="2026-08-04 11:09:31.955709909 +0000 UTC m=+1962.681780223"
Aug 04 11:09:32.412557 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:32.412526    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:32.414042 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:32.414011    2559 patch_prober.go:28] interesting pod/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Aug 04 11:09:32.414190 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:32.414099    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt" podUID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Aug 04 11:09:33.416378 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:33.416345    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:33.945088 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:33.945057    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:33.945885 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:33.945864    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:34.384697 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:34.384667    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"]
Aug 04 11:09:34.388014 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:34.387994    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:09:34.390141 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:34.390121    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6279d3cc-serving-cert\""
Aug 04 11:09:34.398784 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:34.398760    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"]
Aug 04 11:09:34.504348 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:34.504320    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61f083e9-a4cf-419c-a5f2-3c3538478f76-maas-api-tls\") pod \"maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp\" (UID: \"61f083e9-a4cf-419c-a5f2-3c3538478f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:09:34.504718 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:34.504381    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61f083e9-a4cf-419c-a5f2-3c3538478f76-openshift-service-ca\") pod \"maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp\" (UID: \"61f083e9-a4cf-419c-a5f2-3c3538478f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:09:34.504718 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:34.504421    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtrs8\" (UniqueName: \"kubernetes.io/projected/61f083e9-a4cf-419c-a5f2-3c3538478f76-kube-api-access-xtrs8\") pod \"maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp\" (UID: \"61f083e9-a4cf-419c-a5f2-3c3538478f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:09:34.604859 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:34.604831    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61f083e9-a4cf-419c-a5f2-3c3538478f76-openshift-service-ca\") pod \"maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp\" (UID: \"61f083e9-a4cf-419c-a5f2-3c3538478f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:09:34.605025 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:34.604875    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtrs8\" (UniqueName: \"kubernetes.io/projected/61f083e9-a4cf-419c-a5f2-3c3538478f76-kube-api-access-xtrs8\") pod \"maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp\" (UID: \"61f083e9-a4cf-419c-a5f2-3c3538478f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:09:34.605025 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:34.604928    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61f083e9-a4cf-419c-a5f2-3c3538478f76-maas-api-tls\") pod \"maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp\" (UID: \"61f083e9-a4cf-419c-a5f2-3c3538478f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:09:34.605156 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:09:34.605074    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-serving-cert: secret "maas-api-e2e-ait-6279d3cc-serving-cert" not found
Aug 04 11:09:34.605156 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:09:34.605133    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61f083e9-a4cf-419c-a5f2-3c3538478f76-maas-api-tls podName:61f083e9-a4cf-419c-a5f2-3c3538478f76 nodeName:}" failed. No retries permitted until 2026-08-04 11:09:35.10511283 +0000 UTC m=+1965.831183149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/61f083e9-a4cf-419c-a5f2-3c3538478f76-maas-api-tls") pod "maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp" (UID: "61f083e9-a4cf-419c-a5f2-3c3538478f76") : secret "maas-api-e2e-ait-6279d3cc-serving-cert" not found
Aug 04 11:09:34.605524 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:34.605497    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61f083e9-a4cf-419c-a5f2-3c3538478f76-openshift-service-ca\") pod \"maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp\" (UID: \"61f083e9-a4cf-419c-a5f2-3c3538478f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:09:34.613688 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:34.613662    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtrs8\" (UniqueName: \"kubernetes.io/projected/61f083e9-a4cf-419c-a5f2-3c3538478f76-kube-api-access-xtrs8\") pod \"maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp\" (UID: \"61f083e9-a4cf-419c-a5f2-3c3538478f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:09:35.110618 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:35.110578    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61f083e9-a4cf-419c-a5f2-3c3538478f76-maas-api-tls\") pod \"maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp\" (UID: \"61f083e9-a4cf-419c-a5f2-3c3538478f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:09:35.113205 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:35.113179    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61f083e9-a4cf-419c-a5f2-3c3538478f76-maas-api-tls\") pod \"maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp\" (UID: \"61f083e9-a4cf-419c-a5f2-3c3538478f76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:09:35.299802 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:35.299765    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:09:35.436471 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:35.436448    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"]
Aug 04 11:09:35.438546 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:09:35.438516    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f083e9_a4cf_419c_a5f2_3c3538478f76.slice/crio-f56147eab17e26423476476c136d987497bfe05604d37259a247e6752fd6a522 WatchSource:0}: Error finding container f56147eab17e26423476476c136d987497bfe05604d37259a247e6752fd6a522: Status 404 returned error can't find the container with id f56147eab17e26423476476c136d987497bfe05604d37259a247e6752fd6a522
Aug 04 11:09:35.440326 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:35.440299    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 11:09:35.955124 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:35.955093    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp" event={"ID":"61f083e9-a4cf-419c-a5f2-3c3538478f76","Type":"ContainerStarted","Data":"f56147eab17e26423476476c136d987497bfe05604d37259a247e6752fd6a522"}
Aug 04 11:09:36.960704 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:36.960676    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp" event={"ID":"61f083e9-a4cf-419c-a5f2-3c3538478f76","Type":"ContainerStarted","Data":"590f5e8f5a3651502632ce2894c9e91d00bf26fb84ba0713887708828867922e"}
Aug 04 11:09:36.960988 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:36.960759    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:09:36.977141 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:36.977100    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp" podStartSLOduration=1.525096554 podStartE2EDuration="2.977086404s" totalImagesPullingTime="1.45198985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:09:36.975765847 +0000 UTC m=+1967.701836183" watchObservedRunningTime="2026-08-04 11:09:36.977086404 +0000 UTC m=+1967.703156743"
Aug 04 11:09:42.976769 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:42.976740    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:09:48.017059 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:48.017029    2559 generic.go:356] "Generic (PLEG): container finished" podID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerID="b46a156f7cc9284949e7a07953fb335ca53caef006f24c325bc780e466caa020" exitCode=0
Aug 04 11:09:48.017544 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:48.017120    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt" event={"ID":"601fff74-9391-4e27-8f7d-8f1d3b4b8baf","Type":"ContainerDied","Data":"b46a156f7cc9284949e7a07953fb335ca53caef006f24c325bc780e466caa020"}
Aug 04 11:09:48.017544 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:48.017530    2559 scope.go:117] "RemoveContainer" containerID="b46a156f7cc9284949e7a07953fb335ca53caef006f24c325bc780e466caa020"
Aug 04 11:09:48.018566 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:48.018542    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:09:48.018616 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:48.018604    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:09:48.018668 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:48.018650    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:09:48.945451 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:48.945415    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:49.025816 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:49.025770    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt" event={"ID":"601fff74-9391-4e27-8f7d-8f1d3b4b8baf","Type":"ContainerStarted","Data":"06fa6b6f22278ddad3da05f08d3023101c38dadffe6657b67056e74be93fb400"}
Aug 04 11:09:49.413033 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:49.413002    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:49.414370 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:49.414343    2559 patch_prober.go:28] interesting pod/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Aug 04 11:09:49.414562 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:49.414537    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt" podUID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Aug 04 11:09:50.413487 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:50.413450    2559 patch_prober.go:28] interesting pod/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Aug 04 11:09:50.414092 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:50.414060    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt" podUID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Aug 04 11:09:51.413099 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:51.413058    2559 patch_prober.go:28] interesting pod/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Aug 04 11:09:51.413293 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:51.413136    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt" podUID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Aug 04 11:09:52.413285 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:52.412842    2559 patch_prober.go:28] interesting pod/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Aug 04 11:09:52.413285 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:52.412921    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt" podUID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Aug 04 11:09:53.413580 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:53.413537    2559 patch_prober.go:28] interesting pod/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Aug 04 11:09:53.414091 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:53.413606    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt" podUID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Aug 04 11:09:54.417536 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:54.417492    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:54.417980 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:54.417849    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:09:54.418468 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:09:54.418452    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:10:04.850581 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:04.850528    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"]
Aug 04 11:10:04.851182 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:04.850787    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp" podUID="61f083e9-a4cf-419c-a5f2-3c3538478f76" containerName="maas-api" containerID="cri-o://590f5e8f5a3651502632ce2894c9e91d00bf26fb84ba0713887708828867922e" gracePeriod=30
Aug 04 11:10:05.105182 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.105102    2559 generic.go:356] "Generic (PLEG): container finished" podID="61f083e9-a4cf-419c-a5f2-3c3538478f76" containerID="590f5e8f5a3651502632ce2894c9e91d00bf26fb84ba0713887708828867922e" exitCode=0
Aug 04 11:10:05.105182 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.105125    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:10:05.105341 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.105180    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp" event={"ID":"61f083e9-a4cf-419c-a5f2-3c3538478f76","Type":"ContainerDied","Data":"590f5e8f5a3651502632ce2894c9e91d00bf26fb84ba0713887708828867922e"}
Aug 04 11:10:05.105341 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.105234    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp" event={"ID":"61f083e9-a4cf-419c-a5f2-3c3538478f76","Type":"ContainerDied","Data":"f56147eab17e26423476476c136d987497bfe05604d37259a247e6752fd6a522"}
Aug 04 11:10:05.105341 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.105261    2559 scope.go:117] "RemoveContainer" containerID="590f5e8f5a3651502632ce2894c9e91d00bf26fb84ba0713887708828867922e"
Aug 04 11:10:05.114140 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.114116    2559 scope.go:117] "RemoveContainer" containerID="590f5e8f5a3651502632ce2894c9e91d00bf26fb84ba0713887708828867922e"
Aug 04 11:10:05.114425 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:10:05.114407    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"590f5e8f5a3651502632ce2894c9e91d00bf26fb84ba0713887708828867922e\": container with ID starting with 590f5e8f5a3651502632ce2894c9e91d00bf26fb84ba0713887708828867922e not found: ID does not exist" containerID="590f5e8f5a3651502632ce2894c9e91d00bf26fb84ba0713887708828867922e"
Aug 04 11:10:05.114505 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.114434    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"590f5e8f5a3651502632ce2894c9e91d00bf26fb84ba0713887708828867922e"} err="failed to get container status \"590f5e8f5a3651502632ce2894c9e91d00bf26fb84ba0713887708828867922e\": rpc error: code = NotFound desc = could not find container \"590f5e8f5a3651502632ce2894c9e91d00bf26fb84ba0713887708828867922e\": container with ID starting with 590f5e8f5a3651502632ce2894c9e91d00bf26fb84ba0713887708828867922e not found: ID does not exist"
Aug 04 11:10:05.160364 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.160327    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtrs8\" (UniqueName: \"kubernetes.io/projected/61f083e9-a4cf-419c-a5f2-3c3538478f76-kube-api-access-xtrs8\") pod \"61f083e9-a4cf-419c-a5f2-3c3538478f76\" (UID: \"61f083e9-a4cf-419c-a5f2-3c3538478f76\") "
Aug 04 11:10:05.160543 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.160393    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61f083e9-a4cf-419c-a5f2-3c3538478f76-openshift-service-ca\") pod \"61f083e9-a4cf-419c-a5f2-3c3538478f76\" (UID: \"61f083e9-a4cf-419c-a5f2-3c3538478f76\") "
Aug 04 11:10:05.160543 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.160423    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61f083e9-a4cf-419c-a5f2-3c3538478f76-maas-api-tls\") pod \"61f083e9-a4cf-419c-a5f2-3c3538478f76\" (UID: \"61f083e9-a4cf-419c-a5f2-3c3538478f76\") "
Aug 04 11:10:05.161704 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.161612    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61f083e9-a4cf-419c-a5f2-3c3538478f76-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "61f083e9-a4cf-419c-a5f2-3c3538478f76" (UID: "61f083e9-a4cf-419c-a5f2-3c3538478f76"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:10:05.164262 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.164232    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61f083e9-a4cf-419c-a5f2-3c3538478f76-kube-api-access-xtrs8" (OuterVolumeSpecName: "kube-api-access-xtrs8") pod "61f083e9-a4cf-419c-a5f2-3c3538478f76" (UID: "61f083e9-a4cf-419c-a5f2-3c3538478f76"). InnerVolumeSpecName "kube-api-access-xtrs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:10:05.170840 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.170801    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61f083e9-a4cf-419c-a5f2-3c3538478f76-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "61f083e9-a4cf-419c-a5f2-3c3538478f76" (UID: "61f083e9-a4cf-419c-a5f2-3c3538478f76"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:10:05.178163 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.178137    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"]
Aug 04 11:10:05.178370 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.178340    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt" podUID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerName="istio-proxy" containerID="cri-o://06fa6b6f22278ddad3da05f08d3023101c38dadffe6657b67056e74be93fb400" gracePeriod=30
Aug 04 11:10:05.262013 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.261975    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61f083e9-a4cf-419c-a5f2-3c3538478f76-openshift-service-ca\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:05.262013 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.262005    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61f083e9-a4cf-419c-a5f2-3c3538478f76-maas-api-tls\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:05.262013 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:05.262015    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtrs8\" (UniqueName: \"kubernetes.io/projected/61f083e9-a4cf-419c-a5f2-3c3538478f76-kube-api-access-xtrs8\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:06.111134 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.111091    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"
Aug 04 11:10:06.133475 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.133443    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"]
Aug 04 11:10:06.144717 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.144692    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6279d3cc-59b55489cf-zs9sp"]
Aug 04 11:10:06.201451 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.201421    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"]
Aug 04 11:10:06.201875 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.201851    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f083e9-a4cf-419c-a5f2-3c3538478f76" containerName="maas-api"
Aug 04 11:10:06.201875 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.201873    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f083e9-a4cf-419c-a5f2-3c3538478f76" containerName="maas-api"
Aug 04 11:10:06.202071 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.201960    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="61f083e9-a4cf-419c-a5f2-3c3538478f76" containerName="maas-api"
Aug 04 11:10:06.206250 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.206232    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.208744 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.208719    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-93c76061-gw-openshift-default-dockercfg-6prxh\""
Aug 04 11:10:06.217146 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.217121    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"]
Aug 04 11:10:06.269991 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.269960    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-workload-socket\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.269991 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.269990    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09714493-ed1e-4da3-8478-3bf115252453-istio-token\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.270178 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.270014    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-credential-socket\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.270178 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.270033    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09714493-ed1e-4da3-8478-3bf115252453-istio-podinfo\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.270178 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.270096    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-workload-certs\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.270178 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.270137    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09714493-ed1e-4da3-8478-3bf115252453-istiod-ca-cert\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.270178 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.270165    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-istio-envoy\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.270414 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.270182    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-istio-data\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.270414 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.270333    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdrmc\" (UniqueName: \"kubernetes.io/projected/09714493-ed1e-4da3-8478-3bf115252453-kube-api-access-bdrmc\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.370879 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.370798    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdrmc\" (UniqueName: \"kubernetes.io/projected/09714493-ed1e-4da3-8478-3bf115252453-kube-api-access-bdrmc\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.370879 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.370845    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-workload-socket\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.370879 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.370864    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09714493-ed1e-4da3-8478-3bf115252453-istio-token\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.371138 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.370892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-credential-socket\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.371138 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.371033    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09714493-ed1e-4da3-8478-3bf115252453-istio-podinfo\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.371138 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.371077    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-workload-certs\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.371138 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.371105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09714493-ed1e-4da3-8478-3bf115252453-istiod-ca-cert\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.371321 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.371257    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-credential-socket\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.371321 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.371261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-istio-envoy\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.371321 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.371313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-istio-data\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.371472 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.371358    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-workload-socket\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.371472 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.371439    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-workload-certs\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.371660 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.371614    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-istio-data\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.371770 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.371750    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09714493-ed1e-4da3-8478-3bf115252453-istiod-ca-cert\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.373358 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.373337    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-istio-envoy\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.373696 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.373675    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09714493-ed1e-4da3-8478-3bf115252453-istio-podinfo\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.381771 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.381742    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09714493-ed1e-4da3-8478-3bf115252453-istio-token\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.382098 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.382080    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdrmc\" (UniqueName: \"kubernetes.io/projected/09714493-ed1e-4da3-8478-3bf115252453-kube-api-access-bdrmc\") pod \"e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") " pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.516188 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.516158    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:06.648444 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.648365    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"]
Aug 04 11:10:06.652448 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:10:06.652424    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09714493_ed1e_4da3_8478_3bf115252453.slice/crio-e80d4b26b40858afdc2663ec7e7d0b42fccc7682b9743615aebdba0f0ae33445 WatchSource:0}: Error finding container e80d4b26b40858afdc2663ec7e7d0b42fccc7682b9743615aebdba0f0ae33445: Status 404 returned error can't find the container with id e80d4b26b40858afdc2663ec7e7d0b42fccc7682b9743615aebdba0f0ae33445
Aug 04 11:10:06.654488 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.654458    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:10:06.654570 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.654526    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:10:06.654570 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:06.654555    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:10:07.122662 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:07.120779    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q" event={"ID":"09714493-ed1e-4da3-8478-3bf115252453","Type":"ContainerStarted","Data":"cc96c066e2dada7fb082f8384de41029fe6c8953f0413acfc41633dcf759b453"}
Aug 04 11:10:07.122662 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:07.120890    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q" event={"ID":"09714493-ed1e-4da3-8478-3bf115252453","Type":"ContainerStarted","Data":"e80d4b26b40858afdc2663ec7e7d0b42fccc7682b9743615aebdba0f0ae33445"}
Aug 04 11:10:07.147056 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:07.147011    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q" podStartSLOduration=1.146998021 podStartE2EDuration="1.146998021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:10:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:10:07.146795695 +0000 UTC m=+1997.872866029" watchObservedRunningTime="2026-08-04 11:10:07.146998021 +0000 UTC m=+1997.873068353"
Aug 04 11:10:07.517334 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:07.517255    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:07.522008 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:07.521982    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:07.782134 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:07.782047    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61f083e9-a4cf-419c-a5f2-3c3538478f76" path="/var/lib/kubelet/pods/61f083e9-a4cf-419c-a5f2-3c3538478f76/volumes"
Aug 04 11:10:08.125080 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:08.125054    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:08.126135 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:08.126114    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:09.420605 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:09.420573    2559 patch_prober.go:28] interesting pod/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 11:10:09.420985 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:09.420627    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt" podUID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 11:10:10.439770 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.439743    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:10:10.502964 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.502900    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6tb6\" (UniqueName: \"kubernetes.io/projected/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-kube-api-access-z6tb6\") pod \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") "
Aug 04 11:10:10.503086 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.503006    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-workload-certs\") pod \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") "
Aug 04 11:10:10.503086 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.503042    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-envoy\") pod \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") "
Aug 04 11:10:10.503086 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.503058    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-token\") pod \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") "
Aug 04 11:10:10.503086 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.503078    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-data\") pod \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") "
Aug 04 11:10:10.503268 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.503119    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-credential-socket\") pod \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") "
Aug 04 11:10:10.503268 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.503168    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-podinfo\") pod \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") "
Aug 04 11:10:10.503268 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.503208    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-workload-socket\") pod \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") "
Aug 04 11:10:10.503268 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.503246    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istiod-ca-cert\") pod \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\" (UID: \"601fff74-9391-4e27-8f7d-8f1d3b4b8baf\") "
Aug 04 11:10:10.503455 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.503298    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "601fff74-9391-4e27-8f7d-8f1d3b4b8baf" (UID: "601fff74-9391-4e27-8f7d-8f1d3b4b8baf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:10:10.503517 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.503477    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "601fff74-9391-4e27-8f7d-8f1d3b4b8baf" (UID: "601fff74-9391-4e27-8f7d-8f1d3b4b8baf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:10:10.503689 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.503667    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:10.503956 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.503694    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:10.503956 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.503900    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-data" (OuterVolumeSpecName: "istio-data") pod "601fff74-9391-4e27-8f7d-8f1d3b4b8baf" (UID: "601fff74-9391-4e27-8f7d-8f1d3b4b8baf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:10:10.504081 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.503963    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "601fff74-9391-4e27-8f7d-8f1d3b4b8baf" (UID: "601fff74-9391-4e27-8f7d-8f1d3b4b8baf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:10:10.504081 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.504015    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "601fff74-9391-4e27-8f7d-8f1d3b4b8baf" (UID: "601fff74-9391-4e27-8f7d-8f1d3b4b8baf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:10:10.505498 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.505474    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-kube-api-access-z6tb6" (OuterVolumeSpecName: "kube-api-access-z6tb6") pod "601fff74-9391-4e27-8f7d-8f1d3b4b8baf" (UID: "601fff74-9391-4e27-8f7d-8f1d3b4b8baf"). InnerVolumeSpecName "kube-api-access-z6tb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:10:10.505597 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.505501    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-token" (OuterVolumeSpecName: "istio-token") pod "601fff74-9391-4e27-8f7d-8f1d3b4b8baf" (UID: "601fff74-9391-4e27-8f7d-8f1d3b4b8baf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:10:10.505597 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.505522    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "601fff74-9391-4e27-8f7d-8f1d3b4b8baf" (UID: "601fff74-9391-4e27-8f7d-8f1d3b4b8baf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:10:10.505809 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.505786    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "601fff74-9391-4e27-8f7d-8f1d3b4b8baf" (UID: "601fff74-9391-4e27-8f7d-8f1d3b4b8baf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 11:10:10.604240 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.604210    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6tb6\" (UniqueName: \"kubernetes.io/projected/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-kube-api-access-z6tb6\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:10.604240 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.604234    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:10.604240 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.604244    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:10.604427 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.604251    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:10.604427 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.604258    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:10.604427 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.604266    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:10.604427 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:10.604274    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/601fff74-9391-4e27-8f7d-8f1d3b4b8baf-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:11.142790 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:11.142757    2559 generic.go:356] "Generic (PLEG): container finished" podID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerID="06fa6b6f22278ddad3da05f08d3023101c38dadffe6657b67056e74be93fb400" exitCode=0
Aug 04 11:10:11.142933 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:11.142804    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"
Aug 04 11:10:11.142933 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:11.142826    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt" event={"ID":"601fff74-9391-4e27-8f7d-8f1d3b4b8baf","Type":"ContainerDied","Data":"06fa6b6f22278ddad3da05f08d3023101c38dadffe6657b67056e74be93fb400"}
Aug 04 11:10:11.142933 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:11.142869    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt" event={"ID":"601fff74-9391-4e27-8f7d-8f1d3b4b8baf","Type":"ContainerDied","Data":"32245baf995b2fc8981422d172e04feb2716db6bbf30eba4bc44397f0450f8c8"}
Aug 04 11:10:11.142933 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:11.142892    2559 scope.go:117] "RemoveContainer" containerID="06fa6b6f22278ddad3da05f08d3023101c38dadffe6657b67056e74be93fb400"
Aug 04 11:10:11.152289 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:11.152274    2559 scope.go:117] "RemoveContainer" containerID="b46a156f7cc9284949e7a07953fb335ca53caef006f24c325bc780e466caa020"
Aug 04 11:10:11.159924 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:11.159908    2559 scope.go:117] "RemoveContainer" containerID="06fa6b6f22278ddad3da05f08d3023101c38dadffe6657b67056e74be93fb400"
Aug 04 11:10:11.160184 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:10:11.160162    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06fa6b6f22278ddad3da05f08d3023101c38dadffe6657b67056e74be93fb400\": container with ID starting with 06fa6b6f22278ddad3da05f08d3023101c38dadffe6657b67056e74be93fb400 not found: ID does not exist" containerID="06fa6b6f22278ddad3da05f08d3023101c38dadffe6657b67056e74be93fb400"
Aug 04 11:10:11.160230 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:11.160194    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06fa6b6f22278ddad3da05f08d3023101c38dadffe6657b67056e74be93fb400"} err="failed to get container status \"06fa6b6f22278ddad3da05f08d3023101c38dadffe6657b67056e74be93fb400\": rpc error: code = NotFound desc = could not find container \"06fa6b6f22278ddad3da05f08d3023101c38dadffe6657b67056e74be93fb400\": container with ID starting with 06fa6b6f22278ddad3da05f08d3023101c38dadffe6657b67056e74be93fb400 not found: ID does not exist"
Aug 04 11:10:11.160230 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:11.160211    2559 scope.go:117] "RemoveContainer" containerID="b46a156f7cc9284949e7a07953fb335ca53caef006f24c325bc780e466caa020"
Aug 04 11:10:11.160409 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:10:11.160390    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b46a156f7cc9284949e7a07953fb335ca53caef006f24c325bc780e466caa020\": container with ID starting with b46a156f7cc9284949e7a07953fb335ca53caef006f24c325bc780e466caa020 not found: ID does not exist" containerID="b46a156f7cc9284949e7a07953fb335ca53caef006f24c325bc780e466caa020"
Aug 04 11:10:11.160451 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:11.160415    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b46a156f7cc9284949e7a07953fb335ca53caef006f24c325bc780e466caa020"} err="failed to get container status \"b46a156f7cc9284949e7a07953fb335ca53caef006f24c325bc780e466caa020\": rpc error: code = NotFound desc = could not find container \"b46a156f7cc9284949e7a07953fb335ca53caef006f24c325bc780e466caa020\": container with ID starting with b46a156f7cc9284949e7a07953fb335ca53caef006f24c325bc780e466caa020 not found: ID does not exist"
Aug 04 11:10:11.165048 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:11.165027    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"]
Aug 04 11:10:11.168387 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:11.168369    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6279d3cc-openshift-default-79586648c4-blcpt"]
Aug 04 11:10:11.787425 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:11.787387    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" path="/var/lib/kubelet/pods/601fff74-9391-4e27-8f7d-8f1d3b4b8baf/volumes"
Aug 04 11:10:21.192533 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:21.192500    2559 generic.go:356] "Generic (PLEG): container finished" podID="09714493-ed1e-4da3-8478-3bf115252453" containerID="cc96c066e2dada7fb082f8384de41029fe6c8953f0413acfc41633dcf759b453" exitCode=0
Aug 04 11:10:21.193031 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:21.192584    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q" event={"ID":"09714493-ed1e-4da3-8478-3bf115252453","Type":"ContainerDied","Data":"cc96c066e2dada7fb082f8384de41029fe6c8953f0413acfc41633dcf759b453"}
Aug 04 11:10:21.193031 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:21.192982    2559 scope.go:117] "RemoveContainer" containerID="cc96c066e2dada7fb082f8384de41029fe6c8953f0413acfc41633dcf759b453"
Aug 04 11:10:21.194047 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:21.194019    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:10:21.194151 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:21.194084    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:10:21.194151 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:21.194123    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:10:22.198838 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:22.198805    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q" event={"ID":"09714493-ed1e-4da3-8478-3bf115252453","Type":"ContainerStarted","Data":"bc97127a2ccc26968f9b4b9945a8b8f5d845a330522424ebac22bd64a63b169b"}
Aug 04 11:10:22.517009 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:22.516860    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:22.518378 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:22.518030    2559 patch_prober.go:28] interesting pod/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Aug 04 11:10:22.518378 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:22.518087    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q" podUID="09714493-ed1e-4da3-8478-3bf115252453" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Aug 04 11:10:23.125319 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:23.125277    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:23.517006 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:23.516900    2559 patch_prober.go:28] interesting pod/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Aug 04 11:10:23.517006 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:23.516990    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q" podUID="09714493-ed1e-4da3-8478-3bf115252453" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Aug 04 11:10:24.517041 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:24.517004    2559 patch_prober.go:28] interesting pod/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Aug 04 11:10:24.517613 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:24.517581    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q" podUID="09714493-ed1e-4da3-8478-3bf115252453" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Aug 04 11:10:25.517287 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:25.517240    2559 patch_prober.go:28] interesting pod/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Aug 04 11:10:25.517794 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:25.517309    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q" podUID="09714493-ed1e-4da3-8478-3bf115252453" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Aug 04 11:10:26.517263 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:26.516795    2559 patch_prober.go:28] interesting pod/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Aug 04 11:10:26.517263 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:26.516857    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q" podUID="09714493-ed1e-4da3-8478-3bf115252453" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Aug 04 11:10:27.520983 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:27.520954    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:27.521945 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:27.521926    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:39.842925 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:39.842888    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"]
Aug 04 11:10:39.843656 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:39.843202    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q" podUID="09714493-ed1e-4da3-8478-3bf115252453" containerName="istio-proxy" containerID="cri-o://bc97127a2ccc26968f9b4b9945a8b8f5d845a330522424ebac22bd64a63b169b" gracePeriod=30
Aug 04 11:10:40.601202 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.601156    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"]
Aug 04 11:10:40.601695 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.601676    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerName="istio-proxy"
Aug 04 11:10:40.601797 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.601698    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerName="istio-proxy"
Aug 04 11:10:40.601797 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.601720    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerName="istio-proxy"
Aug 04 11:10:40.601797 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.601729    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerName="istio-proxy"
Aug 04 11:10:40.601893 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.601839    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerName="istio-proxy"
Aug 04 11:10:40.601893 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.601852    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="601fff74-9391-4e27-8f7d-8f1d3b4b8baf" containerName="istio-proxy"
Aug 04 11:10:40.605278 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.605259    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.607506 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.607486    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9269199f-openshift-default-dockercfg-lfvrb\""
Aug 04 11:10:40.615271 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.615246    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"]
Aug 04 11:10:40.664191 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.664168    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-token\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.664333 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.664229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-podinfo\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.664333 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.664303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-credential-socket\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.664333 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.664326    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-data\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.664495 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.664352    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-workload-certs\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.664495 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.664392    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istiod-ca-cert\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.664495 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.664430    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-workload-socket\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.664671 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.664491    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-envoy\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.664671 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.664544    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrjf6\" (UniqueName: \"kubernetes.io/projected/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-kube-api-access-jrjf6\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.764947 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.764914    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-envoy\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.765131 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.764962    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrjf6\" (UniqueName: \"kubernetes.io/projected/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-kube-api-access-jrjf6\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.765131 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.764989    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-token\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.765131 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.765047    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-podinfo\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.765131 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.765099    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-credential-socket\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.765131 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.765122    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-data\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.765402 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.765148    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-workload-certs\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.765402 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.765191    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istiod-ca-cert\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.765402 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.765215    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-workload-socket\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.765571 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.765504    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-data\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.765571 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.765528    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-credential-socket\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.765681 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.765583    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-workload-certs\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.765681 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.765633    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-workload-socket\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.766217 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.766194    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istiod-ca-cert\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.767484 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.767450    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-envoy\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.767597 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.767581    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-podinfo\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.772346 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.772326    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-token\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.772681 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.772627    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrjf6\" (UniqueName: \"kubernetes.io/projected/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-kube-api-access-jrjf6\") pod \"e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") " pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:40.916280 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:40.916212    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:41.049403 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:41.049372    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"]
Aug 04 11:10:41.053062 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:10:41.053031    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48a0fd6_4705_44e2_a877_ccb1f98ef8bb.slice/crio-e58c215d398a5126682ffb86222b04891a258fba331d7cf36babd857ebf81607 WatchSource:0}: Error finding container e58c215d398a5126682ffb86222b04891a258fba331d7cf36babd857ebf81607: Status 404 returned error can't find the container with id e58c215d398a5126682ffb86222b04891a258fba331d7cf36babd857ebf81607
Aug 04 11:10:41.055342 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:41.055310    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:10:41.055419 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:41.055383    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:10:41.055419 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:41.055409    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:10:41.293598 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:41.293506    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh" event={"ID":"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb","Type":"ContainerStarted","Data":"b60b1ad49df8b561187db05d287edcdbce7a1a65636b0459790904d80edffd27"}
Aug 04 11:10:41.293598 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:41.293558    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh" event={"ID":"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb","Type":"ContainerStarted","Data":"e58c215d398a5126682ffb86222b04891a258fba331d7cf36babd857ebf81607"}
Aug 04 11:10:41.314509 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:41.314460    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh" podStartSLOduration=1.314446336 podStartE2EDuration="1.314446336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:10:41.313191572 +0000 UTC m=+2032.039261901" watchObservedRunningTime="2026-08-04 11:10:41.314446336 +0000 UTC m=+2032.040516670"
Aug 04 11:10:41.917347 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:41.917318    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:42.523859 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:42.523818    2559 patch_prober.go:28] interesting pod/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 11:10:42.524035 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:42.523883    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q" podUID="09714493-ed1e-4da3-8478-3bf115252453" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 11:10:42.921935 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:42.921901    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:43.302482 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:43.302401    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:43.303278 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:43.303261    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:45.088115 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.088082    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:45.107882 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.107857    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-istio-envoy\") pod \"09714493-ed1e-4da3-8478-3bf115252453\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") "
Aug 04 11:10:45.108025 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.107910    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09714493-ed1e-4da3-8478-3bf115252453-istiod-ca-cert\") pod \"09714493-ed1e-4da3-8478-3bf115252453\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") "
Aug 04 11:10:45.108025 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.107957    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-istio-data\") pod \"09714493-ed1e-4da3-8478-3bf115252453\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") "
Aug 04 11:10:45.108025 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.107995    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-workload-socket\") pod \"09714493-ed1e-4da3-8478-3bf115252453\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") "
Aug 04 11:10:45.108198 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.108026    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09714493-ed1e-4da3-8478-3bf115252453-istio-token\") pod \"09714493-ed1e-4da3-8478-3bf115252453\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") "
Aug 04 11:10:45.108198 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.108053    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdrmc\" (UniqueName: \"kubernetes.io/projected/09714493-ed1e-4da3-8478-3bf115252453-kube-api-access-bdrmc\") pod \"09714493-ed1e-4da3-8478-3bf115252453\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") "
Aug 04 11:10:45.108198 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.108086    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09714493-ed1e-4da3-8478-3bf115252453-istio-podinfo\") pod \"09714493-ed1e-4da3-8478-3bf115252453\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") "
Aug 04 11:10:45.108198 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.108114    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-credential-socket\") pod \"09714493-ed1e-4da3-8478-3bf115252453\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") "
Aug 04 11:10:45.108198 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.108147    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-workload-certs\") pod \"09714493-ed1e-4da3-8478-3bf115252453\" (UID: \"09714493-ed1e-4da3-8478-3bf115252453\") "
Aug 04 11:10:45.108798 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.108480    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09714493-ed1e-4da3-8478-3bf115252453" (UID: "09714493-ed1e-4da3-8478-3bf115252453"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:10:45.108798 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.108499    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09714493-ed1e-4da3-8478-3bf115252453" (UID: "09714493-ed1e-4da3-8478-3bf115252453"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:10:45.111203 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.111170    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09714493-ed1e-4da3-8478-3bf115252453-istio-token" (OuterVolumeSpecName: "istio-token") pod "09714493-ed1e-4da3-8478-3bf115252453" (UID: "09714493-ed1e-4da3-8478-3bf115252453"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:10:45.111360 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.111329    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09714493-ed1e-4da3-8478-3bf115252453-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09714493-ed1e-4da3-8478-3bf115252453" (UID: "09714493-ed1e-4da3-8478-3bf115252453"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:10:45.111568 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.111542    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09714493-ed1e-4da3-8478-3bf115252453" (UID: "09714493-ed1e-4da3-8478-3bf115252453"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:10:45.111954 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.111928    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09714493-ed1e-4da3-8478-3bf115252453-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09714493-ed1e-4da3-8478-3bf115252453" (UID: "09714493-ed1e-4da3-8478-3bf115252453"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 11:10:45.112282 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.112249    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-istio-data" (OuterVolumeSpecName: "istio-data") pod "09714493-ed1e-4da3-8478-3bf115252453" (UID: "09714493-ed1e-4da3-8478-3bf115252453"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:10:45.113373 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.113337    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09714493-ed1e-4da3-8478-3bf115252453" (UID: "09714493-ed1e-4da3-8478-3bf115252453"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:10:45.113950 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.113913    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09714493-ed1e-4da3-8478-3bf115252453-kube-api-access-bdrmc" (OuterVolumeSpecName: "kube-api-access-bdrmc") pod "09714493-ed1e-4da3-8478-3bf115252453" (UID: "09714493-ed1e-4da3-8478-3bf115252453"). InnerVolumeSpecName "kube-api-access-bdrmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:10:45.209525 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.209464    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:45.209525 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.209487    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09714493-ed1e-4da3-8478-3bf115252453-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:45.209525 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.209495    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:45.209525 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.209503    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:45.209525 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.209511    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09714493-ed1e-4da3-8478-3bf115252453-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:45.209525 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.209519    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdrmc\" (UniqueName: \"kubernetes.io/projected/09714493-ed1e-4da3-8478-3bf115252453-kube-api-access-bdrmc\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:45.209525 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.209527    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09714493-ed1e-4da3-8478-3bf115252453-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:45.209825 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.209535    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:45.209825 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.209543    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09714493-ed1e-4da3-8478-3bf115252453-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:10:45.312996 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.312966    2559 generic.go:356] "Generic (PLEG): container finished" podID="09714493-ed1e-4da3-8478-3bf115252453" containerID="bc97127a2ccc26968f9b4b9945a8b8f5d845a330522424ebac22bd64a63b169b" exitCode=0
Aug 04 11:10:45.313124 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.313015    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"
Aug 04 11:10:45.313124 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.313048    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q" event={"ID":"09714493-ed1e-4da3-8478-3bf115252453","Type":"ContainerDied","Data":"bc97127a2ccc26968f9b4b9945a8b8f5d845a330522424ebac22bd64a63b169b"}
Aug 04 11:10:45.313124 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.313089    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q" event={"ID":"09714493-ed1e-4da3-8478-3bf115252453","Type":"ContainerDied","Data":"e80d4b26b40858afdc2663ec7e7d0b42fccc7682b9743615aebdba0f0ae33445"}
Aug 04 11:10:45.313124 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.313110    2559 scope.go:117] "RemoveContainer" containerID="bc97127a2ccc26968f9b4b9945a8b8f5d845a330522424ebac22bd64a63b169b"
Aug 04 11:10:45.322551 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.322532    2559 scope.go:117] "RemoveContainer" containerID="cc96c066e2dada7fb082f8384de41029fe6c8953f0413acfc41633dcf759b453"
Aug 04 11:10:45.330285 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.330271    2559 scope.go:117] "RemoveContainer" containerID="bc97127a2ccc26968f9b4b9945a8b8f5d845a330522424ebac22bd64a63b169b"
Aug 04 11:10:45.330534 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:10:45.330516    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc97127a2ccc26968f9b4b9945a8b8f5d845a330522424ebac22bd64a63b169b\": container with ID starting with bc97127a2ccc26968f9b4b9945a8b8f5d845a330522424ebac22bd64a63b169b not found: ID does not exist" containerID="bc97127a2ccc26968f9b4b9945a8b8f5d845a330522424ebac22bd64a63b169b"
Aug 04 11:10:45.330570 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.330544    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc97127a2ccc26968f9b4b9945a8b8f5d845a330522424ebac22bd64a63b169b"} err="failed to get container status \"bc97127a2ccc26968f9b4b9945a8b8f5d845a330522424ebac22bd64a63b169b\": rpc error: code = NotFound desc = could not find container \"bc97127a2ccc26968f9b4b9945a8b8f5d845a330522424ebac22bd64a63b169b\": container with ID starting with bc97127a2ccc26968f9b4b9945a8b8f5d845a330522424ebac22bd64a63b169b not found: ID does not exist"
Aug 04 11:10:45.330570 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.330561    2559 scope.go:117] "RemoveContainer" containerID="cc96c066e2dada7fb082f8384de41029fe6c8953f0413acfc41633dcf759b453"
Aug 04 11:10:45.330826 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:10:45.330807    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc96c066e2dada7fb082f8384de41029fe6c8953f0413acfc41633dcf759b453\": container with ID starting with cc96c066e2dada7fb082f8384de41029fe6c8953f0413acfc41633dcf759b453 not found: ID does not exist" containerID="cc96c066e2dada7fb082f8384de41029fe6c8953f0413acfc41633dcf759b453"
Aug 04 11:10:45.330869 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.330833    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc96c066e2dada7fb082f8384de41029fe6c8953f0413acfc41633dcf759b453"} err="failed to get container status \"cc96c066e2dada7fb082f8384de41029fe6c8953f0413acfc41633dcf759b453\": rpc error: code = NotFound desc = could not find container \"cc96c066e2dada7fb082f8384de41029fe6c8953f0413acfc41633dcf759b453\": container with ID starting with cc96c066e2dada7fb082f8384de41029fe6c8953f0413acfc41633dcf759b453 not found: ID does not exist"
Aug 04 11:10:45.334123 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.334094    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"]
Aug 04 11:10:45.337535 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.337517    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-93c76061-gw-openshift-default-5c9696d8f6-9z54q"]
Aug 04 11:10:45.781695 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:45.781668    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09714493-ed1e-4da3-8478-3bf115252453" path="/var/lib/kubelet/pods/09714493-ed1e-4da3-8478-3bf115252453/volumes"
Aug 04 11:10:56.369918 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:56.369876    2559 generic.go:356] "Generic (PLEG): container finished" podID="a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" containerID="b60b1ad49df8b561187db05d287edcdbce7a1a65636b0459790904d80edffd27" exitCode=0
Aug 04 11:10:56.370413 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:56.369950    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh" event={"ID":"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb","Type":"ContainerDied","Data":"b60b1ad49df8b561187db05d287edcdbce7a1a65636b0459790904d80edffd27"}
Aug 04 11:10:56.370480 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:56.370444    2559 scope.go:117] "RemoveContainer" containerID="b60b1ad49df8b561187db05d287edcdbce7a1a65636b0459790904d80edffd27"
Aug 04 11:10:56.371507 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:56.371477    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:10:56.371626 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:56.371546    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:10:56.371626 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:56.371576    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:10:57.376629 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:57.376590    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh" event={"ID":"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb","Type":"ContainerStarted","Data":"c2071a245403e5ed2c78ffa1d371c722f64013a7e09814f8f70bc2de90429c63"}
Aug 04 11:10:57.918080 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:57.918044    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:57.918868 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:57.918836    2559 patch_prober.go:28] interesting pod/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Aug 04 11:10:57.918991 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:57.918901    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh" podUID="a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Aug 04 11:10:58.303194 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:58.303113    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:10:58.917582 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:58.917545    2559 patch_prober.go:28] interesting pod/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Aug 04 11:10:58.918219 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:58.918177    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh" podUID="a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Aug 04 11:10:59.917002 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:59.916944    2559 patch_prober.go:28] interesting pod/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Aug 04 11:10:59.917299 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:10:59.917264    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh" podUID="a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Aug 04 11:11:00.917410 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:00.917371    2559 patch_prober.go:28] interesting pod/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Aug 04 11:11:00.918039 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:00.918005    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh" podUID="a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Aug 04 11:11:01.917724 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:01.917684    2559 patch_prober.go:28] interesting pod/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Aug 04 11:11:01.918318 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:01.918284    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh" podUID="a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Aug 04 11:11:02.920287 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:02.920257    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:11:02.921333 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:02.921313    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:11:08.430737 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:08.430698    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9269199f-xjkmw"]
Aug 04 11:11:08.431098 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:08.431028    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09714493-ed1e-4da3-8478-3bf115252453" containerName="istio-proxy"
Aug 04 11:11:08.431098 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:08.431039    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="09714493-ed1e-4da3-8478-3bf115252453" containerName="istio-proxy"
Aug 04 11:11:08.431098 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:08.431053    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09714493-ed1e-4da3-8478-3bf115252453" containerName="istio-proxy"
Aug 04 11:11:08.431098 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:08.431059    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="09714493-ed1e-4da3-8478-3bf115252453" containerName="istio-proxy"
Aug 04 11:11:08.431223 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:08.431119    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="09714493-ed1e-4da3-8478-3bf115252453" containerName="istio-proxy"
Aug 04 11:11:08.431223 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:08.431129    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="09714493-ed1e-4da3-8478-3bf115252453" containerName="istio-proxy"
Aug 04 11:11:08.434251 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:08.434235    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9269199f-xjkmw"
Aug 04 11:11:08.436814 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:08.436795    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tgsgx\""
Aug 04 11:11:08.442322 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:08.442299    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9269199f-xjkmw"]
Aug 04 11:11:08.504130 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:08.504101    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f65e88b-2038-4355-acf8-c7a630acefe5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9269199f-xjkmw\" (UID: \"0f65e88b-2038-4355-acf8-c7a630acefe5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9269199f-xjkmw"
Aug 04 11:11:08.604493 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:08.604468    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f65e88b-2038-4355-acf8-c7a630acefe5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9269199f-xjkmw\" (UID: \"0f65e88b-2038-4355-acf8-c7a630acefe5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9269199f-xjkmw"
Aug 04 11:11:08.605112 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:08.605071    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f65e88b-2038-4355-acf8-c7a630acefe5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9269199f-xjkmw\" (UID: \"0f65e88b-2038-4355-acf8-c7a630acefe5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9269199f-xjkmw"
Aug 04 11:11:08.745457 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:08.745386    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9269199f-xjkmw"
Aug 04 11:11:08.875569 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:08.875538    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9269199f-xjkmw"]
Aug 04 11:11:08.879029 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:11:08.878998    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f65e88b_2038_4355_acf8_c7a630acefe5.slice/crio-eafbb50b559758a50bf2bff223b1a4cc734426f1c263b0aad76b2e140e81d078 WatchSource:0}: Error finding container eafbb50b559758a50bf2bff223b1a4cc734426f1c263b0aad76b2e140e81d078: Status 404 returned error can't find the container with id eafbb50b559758a50bf2bff223b1a4cc734426f1c263b0aad76b2e140e81d078
Aug 04 11:11:09.431934 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:09.431896    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9269199f-xjkmw" event={"ID":"0f65e88b-2038-4355-acf8-c7a630acefe5","Type":"ContainerStarted","Data":"eafbb50b559758a50bf2bff223b1a4cc734426f1c263b0aad76b2e140e81d078"}
Aug 04 11:11:12.445333 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:12.445291    2559 generic.go:356] "Generic (PLEG): container finished" podID="0f65e88b-2038-4355-acf8-c7a630acefe5" containerID="f4fefbc277d9330402b9f3eeca74721d155b95bab6c1dcf3fa8f2b896f4b2fd5" exitCode=0
Aug 04 11:11:12.445699 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:12.445348    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9269199f-xjkmw" event={"ID":"0f65e88b-2038-4355-acf8-c7a630acefe5","Type":"ContainerDied","Data":"f4fefbc277d9330402b9f3eeca74721d155b95bab6c1dcf3fa8f2b896f4b2fd5"}
Aug 04 11:11:13.577426 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:13.577404    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9269199f-xjkmw"
Aug 04 11:11:13.644653 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:13.644608    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f65e88b-2038-4355-acf8-c7a630acefe5-maas-api-service-ca\") pod \"0f65e88b-2038-4355-acf8-c7a630acefe5\" (UID: \"0f65e88b-2038-4355-acf8-c7a630acefe5\") "
Aug 04 11:11:13.644911 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:13.644891    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f65e88b-2038-4355-acf8-c7a630acefe5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0f65e88b-2038-4355-acf8-c7a630acefe5" (UID: "0f65e88b-2038-4355-acf8-c7a630acefe5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:11:13.746245 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:13.746188    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f65e88b-2038-4355-acf8-c7a630acefe5-maas-api-service-ca\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:11:14.455355 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:14.455324    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9269199f-xjkmw"
Aug 04 11:11:14.455552 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:14.455311    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9269199f-xjkmw" event={"ID":"0f65e88b-2038-4355-acf8-c7a630acefe5","Type":"ContainerDied","Data":"eafbb50b559758a50bf2bff223b1a4cc734426f1c263b0aad76b2e140e81d078"}
Aug 04 11:11:14.455552 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:14.455476    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eafbb50b559758a50bf2bff223b1a4cc734426f1c263b0aad76b2e140e81d078"
Aug 04 11:11:24.563119 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:24.563086    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9269199f-xjkmw"]
Aug 04 11:11:24.565912 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:24.565891    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9269199f-xjkmw"]
Aug 04 11:11:25.700853 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:25.700818    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"]
Aug 04 11:11:25.701297 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:25.701099    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh" podUID="a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" containerName="istio-proxy" containerID="cri-o://c2071a245403e5ed2c78ffa1d371c722f64013a7e09814f8f70bc2de90429c63" gracePeriod=30
Aug 04 11:11:25.780967 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:25.780936    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f65e88b-2038-4355-acf8-c7a630acefe5" path="/var/lib/kubelet/pods/0f65e88b-2038-4355-acf8-c7a630acefe5/volumes"
Aug 04 11:11:26.474316 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.474284    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"]
Aug 04 11:11:26.474660 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.474631    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f65e88b-2038-4355-acf8-c7a630acefe5" containerName="revoke-keys"
Aug 04 11:11:26.474710 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.474662    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f65e88b-2038-4355-acf8-c7a630acefe5" containerName="revoke-keys"
Aug 04 11:11:26.474745 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.474730    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f65e88b-2038-4355-acf8-c7a630acefe5" containerName="revoke-keys"
Aug 04 11:11:26.477679 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.477663    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.479764 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.479740    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-dfeef193-openshift-default-dockercfg-lhh49\""
Aug 04 11:11:26.489687 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.489665    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"]
Aug 04 11:11:26.555766 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.555732    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-podinfo\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.555906 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.555821    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-token\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.555906 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.555859    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-credential-socket\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.555906 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.555877    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-workload-socket\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.555906 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.555892    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istiod-ca-cert\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.556131 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.555978    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-envoy\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.556131 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.556032    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fkkn\" (UniqueName: \"kubernetes.io/projected/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-kube-api-access-6fkkn\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.556131 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.556062    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-workload-certs\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.556131 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.556105    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-data\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.657015 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.656979    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-podinfo\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.657199 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.657029    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-token\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.657199 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.657064    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-credential-socket\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.657199 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.657080    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-workload-socket\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.657199 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.657096    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istiod-ca-cert\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.657199 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.657142    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-envoy\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.657460 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.657296    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fkkn\" (UniqueName: \"kubernetes.io/projected/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-kube-api-access-6fkkn\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.657460 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.657343    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-workload-certs\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.657460 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.657377    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-data\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.657627 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.657597    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-workload-socket\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.657715 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.657701    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-data\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.657997 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.657975    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-workload-certs\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.658131 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.658113    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-credential-socket\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.658218 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.658196    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istiod-ca-cert\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.659527 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.659500    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-envoy\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.659662 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.659627    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-podinfo\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.665345 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.665319    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-token\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.665777 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.665759    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fkkn\" (UniqueName: \"kubernetes.io/projected/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-kube-api-access-6fkkn\") pod \"e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") " pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.787066 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.787006    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:26.921194 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.921174    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"]
Aug 04 11:11:26.923399 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:11:26.923368    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66ef3d80_9a7f_4cba_99f2_5191aa0b6408.slice/crio-c9855b7f5d846986ddf6bc3e51babea1e57da6d4a3265b9a85426e3b16765e1b WatchSource:0}: Error finding container c9855b7f5d846986ddf6bc3e51babea1e57da6d4a3265b9a85426e3b16765e1b: Status 404 returned error can't find the container with id c9855b7f5d846986ddf6bc3e51babea1e57da6d4a3265b9a85426e3b16765e1b
Aug 04 11:11:26.925586 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.925555    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:11:26.925666 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.925616    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:11:26.925707 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:26.925676    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:11:27.514923 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:27.514888    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v" event={"ID":"66ef3d80-9a7f-4cba-99f2-5191aa0b6408","Type":"ContainerStarted","Data":"141c3d020c881c87c8dbf2d9bd3d0120819eb8e1a92cb805be31666fd6266ba7"}
Aug 04 11:11:27.515116 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:27.514943    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v" event={"ID":"66ef3d80-9a7f-4cba-99f2-5191aa0b6408","Type":"ContainerStarted","Data":"c9855b7f5d846986ddf6bc3e51babea1e57da6d4a3265b9a85426e3b16765e1b"}
Aug 04 11:11:27.534240 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:27.534194    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v" podStartSLOduration=1.534180572 podStartE2EDuration="1.534180572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:11:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:11:27.53244891 +0000 UTC m=+2078.258519243" watchObservedRunningTime="2026-08-04 11:11:27.534180572 +0000 UTC m=+2078.260250906"
Aug 04 11:11:27.787599 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:27.787526    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:27.792139 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:27.792114    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:28.519703 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:28.519671    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:28.520552 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:28.520534    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:30.947040 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:30.947017    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:11:31.095884 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.095858    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrjf6\" (UniqueName: \"kubernetes.io/projected/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-kube-api-access-jrjf6\") pod \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") "
Aug 04 11:11:31.096034 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.095920    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istiod-ca-cert\") pod \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") "
Aug 04 11:11:31.096034 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.095967    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-data\") pod \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") "
Aug 04 11:11:31.096034 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.095991    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-credential-socket\") pod \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") "
Aug 04 11:11:31.096034 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.096011    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-workload-certs\") pod \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") "
Aug 04 11:11:31.096521 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.096049    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-podinfo\") pod \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") "
Aug 04 11:11:31.096521 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.096107    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-token\") pod \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") "
Aug 04 11:11:31.096521 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.096143    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-envoy\") pod \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") "
Aug 04 11:11:31.096521 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.096186    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-workload-socket\") pod \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\" (UID: \"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb\") "
Aug 04 11:11:31.096521 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.096243    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" (UID: "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:11:31.096521 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.096253    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" (UID: "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:11:31.096521 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.096267    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" (UID: "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:11:31.096521 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.096310    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" (UID: "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:11:31.096521 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.096466    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" (UID: "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:11:31.096521 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.096488    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:11:31.096521 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.096509    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:11:31.096521 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.096524    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:11:31.097051 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.096539    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:11:31.098370 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.098346    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" (UID: "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:11:31.098370 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.098360    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" (UID: "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:11:31.098559 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.098542    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" (UID: "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 11:11:31.098622 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.098606    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-kube-api-access-jrjf6" (OuterVolumeSpecName: "kube-api-access-jrjf6") pod "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" (UID: "a48a0fd6-4705-44e2-a877-ccb1f98ef8bb"). InnerVolumeSpecName "kube-api-access-jrjf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:11:31.197009 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.196983    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:11:31.197009 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.197006    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:11:31.197154 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.197015    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:11:31.197154 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.197024    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:11:31.197154 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.197033    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrjf6\" (UniqueName: \"kubernetes.io/projected/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb-kube-api-access-jrjf6\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:11:31.534937 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.534850    2559 generic.go:356] "Generic (PLEG): container finished" podID="a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" containerID="c2071a245403e5ed2c78ffa1d371c722f64013a7e09814f8f70bc2de90429c63" exitCode=0
Aug 04 11:11:31.534937 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.534907    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh" event={"ID":"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb","Type":"ContainerDied","Data":"c2071a245403e5ed2c78ffa1d371c722f64013a7e09814f8f70bc2de90429c63"}
Aug 04 11:11:31.535126 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.534975    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh" event={"ID":"a48a0fd6-4705-44e2-a877-ccb1f98ef8bb","Type":"ContainerDied","Data":"e58c215d398a5126682ffb86222b04891a258fba331d7cf36babd857ebf81607"}
Aug 04 11:11:31.535126 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.534909    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"
Aug 04 11:11:31.535126 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.534992    2559 scope.go:117] "RemoveContainer" containerID="c2071a245403e5ed2c78ffa1d371c722f64013a7e09814f8f70bc2de90429c63"
Aug 04 11:11:31.544814 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.544797    2559 scope.go:117] "RemoveContainer" containerID="b60b1ad49df8b561187db05d287edcdbce7a1a65636b0459790904d80edffd27"
Aug 04 11:11:31.552222 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.552202    2559 scope.go:117] "RemoveContainer" containerID="c2071a245403e5ed2c78ffa1d371c722f64013a7e09814f8f70bc2de90429c63"
Aug 04 11:11:31.552486 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:11:31.552468    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2071a245403e5ed2c78ffa1d371c722f64013a7e09814f8f70bc2de90429c63\": container with ID starting with c2071a245403e5ed2c78ffa1d371c722f64013a7e09814f8f70bc2de90429c63 not found: ID does not exist" containerID="c2071a245403e5ed2c78ffa1d371c722f64013a7e09814f8f70bc2de90429c63"
Aug 04 11:11:31.552562 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.552497    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2071a245403e5ed2c78ffa1d371c722f64013a7e09814f8f70bc2de90429c63"} err="failed to get container status \"c2071a245403e5ed2c78ffa1d371c722f64013a7e09814f8f70bc2de90429c63\": rpc error: code = NotFound desc = could not find container \"c2071a245403e5ed2c78ffa1d371c722f64013a7e09814f8f70bc2de90429c63\": container with ID starting with c2071a245403e5ed2c78ffa1d371c722f64013a7e09814f8f70bc2de90429c63 not found: ID does not exist"
Aug 04 11:11:31.552562 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.552517    2559 scope.go:117] "RemoveContainer" containerID="b60b1ad49df8b561187db05d287edcdbce7a1a65636b0459790904d80edffd27"
Aug 04 11:11:31.552810 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:11:31.552793    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b60b1ad49df8b561187db05d287edcdbce7a1a65636b0459790904d80edffd27\": container with ID starting with b60b1ad49df8b561187db05d287edcdbce7a1a65636b0459790904d80edffd27 not found: ID does not exist" containerID="b60b1ad49df8b561187db05d287edcdbce7a1a65636b0459790904d80edffd27"
Aug 04 11:11:31.552858 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.552815    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b60b1ad49df8b561187db05d287edcdbce7a1a65636b0459790904d80edffd27"} err="failed to get container status \"b60b1ad49df8b561187db05d287edcdbce7a1a65636b0459790904d80edffd27\": rpc error: code = NotFound desc = could not find container \"b60b1ad49df8b561187db05d287edcdbce7a1a65636b0459790904d80edffd27\": container with ID starting with b60b1ad49df8b561187db05d287edcdbce7a1a65636b0459790904d80edffd27 not found: ID does not exist"
Aug 04 11:11:31.556731 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.556710    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"]
Aug 04 11:11:31.561341 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.561313    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9269199f-openshift-default-5fff567d86-8pgvh"]
Aug 04 11:11:31.781382 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:31.781353    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" path="/var/lib/kubelet/pods/a48a0fd6-4705-44e2-a877-ccb1f98ef8bb/volumes"
Aug 04 11:11:43.521296 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:43.521262    2559 patch_prober.go:28] interesting pod/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Aug 04 11:11:43.521728 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:43.521321    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v" podUID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Aug 04 11:11:43.595484 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:43.595455    2559 generic.go:356] "Generic (PLEG): container finished" podID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerID="141c3d020c881c87c8dbf2d9bd3d0120819eb8e1a92cb805be31666fd6266ba7" exitCode=0
Aug 04 11:11:43.595619 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:43.595495    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v" event={"ID":"66ef3d80-9a7f-4cba-99f2-5191aa0b6408","Type":"ContainerDied","Data":"141c3d020c881c87c8dbf2d9bd3d0120819eb8e1a92cb805be31666fd6266ba7"}
Aug 04 11:11:43.595858 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:43.595845    2559 scope.go:117] "RemoveContainer" containerID="141c3d020c881c87c8dbf2d9bd3d0120819eb8e1a92cb805be31666fd6266ba7"
Aug 04 11:11:43.596880 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:43.596854    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:11:43.596946 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:43.596921    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:11:43.596984 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:43.596954    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:11:44.601438 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:44.601407    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v" event={"ID":"66ef3d80-9a7f-4cba-99f2-5191aa0b6408","Type":"ContainerStarted","Data":"c412c37a15e907ed1627561a082a065a1799542271460119850e7a6b1e86fa97"}
Aug 04 11:11:44.787155 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:44.787125    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:44.787363 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:44.787335    2559 patch_prober.go:28] interesting pod/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Aug 04 11:11:44.787419 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:44.787397    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v" podUID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Aug 04 11:11:45.788121 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:45.788085    2559 patch_prober.go:28] interesting pod/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Aug 04 11:11:45.788510 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:45.788134    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v" podUID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Aug 04 11:11:46.787823 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:46.787789    2559 patch_prober.go:28] interesting pod/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Aug 04 11:11:46.787997 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:46.787841    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v" podUID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Aug 04 11:11:47.787627 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:47.787596    2559 patch_prober.go:28] interesting pod/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Aug 04 11:11:47.788033 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:47.787670    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v" podUID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Aug 04 11:11:48.787400 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:48.787366    2559 patch_prober.go:28] interesting pod/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Aug 04 11:11:48.787569 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:48.787437    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v" podUID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Aug 04 11:11:49.791374 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:49.791347    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:49.791735 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:49.791666    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:49.792375 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:49.792356    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:11:53.766693 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:53.766655    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc"]
Aug 04 11:11:53.767047 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:53.766987    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" containerName="istio-proxy"
Aug 04 11:11:53.767047 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:53.766997    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" containerName="istio-proxy"
Aug 04 11:11:53.767047 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:53.767004    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" containerName="istio-proxy"
Aug 04 11:11:53.767047 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:53.767011    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" containerName="istio-proxy"
Aug 04 11:11:53.767179 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:53.767063    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" containerName="istio-proxy"
Aug 04 11:11:53.769856 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:53.769839    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc"
Aug 04 11:11:53.772088 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:53.772063    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tgsgx\""
Aug 04 11:11:53.783534 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:53.783505    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc"]
Aug 04 11:11:53.792373 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:53.792342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/873cd94e-18cb-443d-a9c1-5b5528cb2ec0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc\" (UID: \"873cd94e-18cb-443d-a9c1-5b5528cb2ec0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc"
Aug 04 11:11:53.893244 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:53.893220    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/873cd94e-18cb-443d-a9c1-5b5528cb2ec0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc\" (UID: \"873cd94e-18cb-443d-a9c1-5b5528cb2ec0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc"
Aug 04 11:11:53.893812 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:53.893793    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/873cd94e-18cb-443d-a9c1-5b5528cb2ec0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc\" (UID: \"873cd94e-18cb-443d-a9c1-5b5528cb2ec0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc"
Aug 04 11:11:54.081811 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:54.081743    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc"
Aug 04 11:11:54.214957 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:54.214923    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc"]
Aug 04 11:11:54.217430 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:11:54.217402    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod873cd94e_18cb_443d_a9c1_5b5528cb2ec0.slice/crio-e4f158e2d3c1fb89634e3a8472dcc3562091ae333193e9534d91745bee55355e WatchSource:0}: Error finding container e4f158e2d3c1fb89634e3a8472dcc3562091ae333193e9534d91745bee55355e: Status 404 returned error can't find the container with id e4f158e2d3c1fb89634e3a8472dcc3562091ae333193e9534d91745bee55355e
Aug 04 11:11:54.653279 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:54.653245    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc" event={"ID":"873cd94e-18cb-443d-a9c1-5b5528cb2ec0","Type":"ContainerStarted","Data":"e16b0ee5c2861c7c4336606bb942ce1811badda8258206c2a8376b8335447d70"}
Aug 04 11:11:54.653421 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:54.653293    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc" event={"ID":"873cd94e-18cb-443d-a9c1-5b5528cb2ec0","Type":"ContainerStarted","Data":"e4f158e2d3c1fb89634e3a8472dcc3562091ae333193e9534d91745bee55355e"}
Aug 04 11:11:54.669863 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:54.669782    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc" podStartSLOduration=1.669764513 podStartE2EDuration="1.669764513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:11:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:11:54.668420587 +0000 UTC m=+2105.394490920" watchObservedRunningTime="2026-08-04 11:11:54.669764513 +0000 UTC m=+2105.395834848"
Aug 04 11:11:55.659279 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:55.659242    2559 generic.go:356] "Generic (PLEG): container finished" podID="873cd94e-18cb-443d-a9c1-5b5528cb2ec0" containerID="e16b0ee5c2861c7c4336606bb942ce1811badda8258206c2a8376b8335447d70" exitCode=0
Aug 04 11:11:55.659633 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:55.659286    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc" event={"ID":"873cd94e-18cb-443d-a9c1-5b5528cb2ec0","Type":"ContainerDied","Data":"e16b0ee5c2861c7c4336606bb942ce1811badda8258206c2a8376b8335447d70"}
Aug 04 11:11:56.799138 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:56.799112    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc"
Aug 04 11:11:56.819414 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:56.819385    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/873cd94e-18cb-443d-a9c1-5b5528cb2ec0-maas-api-service-ca\") pod \"873cd94e-18cb-443d-a9c1-5b5528cb2ec0\" (UID: \"873cd94e-18cb-443d-a9c1-5b5528cb2ec0\") "
Aug 04 11:11:56.819745 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:56.819722    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/873cd94e-18cb-443d-a9c1-5b5528cb2ec0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "873cd94e-18cb-443d-a9c1-5b5528cb2ec0" (UID: "873cd94e-18cb-443d-a9c1-5b5528cb2ec0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:11:56.920524 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:56.920464    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/873cd94e-18cb-443d-a9c1-5b5528cb2ec0-maas-api-service-ca\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:11:57.669102 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:57.669070    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc"
Aug 04 11:11:57.669262 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:57.669106    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc" event={"ID":"873cd94e-18cb-443d-a9c1-5b5528cb2ec0","Type":"ContainerDied","Data":"e4f158e2d3c1fb89634e3a8472dcc3562091ae333193e9534d91745bee55355e"}
Aug 04 11:11:57.669262 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:11:57.669180    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4f158e2d3c1fb89634e3a8472dcc3562091ae333193e9534d91745bee55355e"
Aug 04 11:12:00.887477 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:00.887443    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc"]
Aug 04 11:12:00.890265 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:00.890240    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dfeef193-ql5kc"]
Aug 04 11:12:01.015000 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:01.014967    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"]
Aug 04 11:12:01.015255 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:01.015192    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v" podUID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerName="istio-proxy" containerID="cri-o://c412c37a15e907ed1627561a082a065a1799542271460119850e7a6b1e86fa97" gracePeriod=30
Aug 04 11:12:01.780371 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:01.780337    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="873cd94e-18cb-443d-a9c1-5b5528cb2ec0" path="/var/lib/kubelet/pods/873cd94e-18cb-443d-a9c1-5b5528cb2ec0/volumes"
Aug 04 11:12:04.793848 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:04.793810    2559 patch_prober.go:28] interesting pod/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 11:12:04.794210 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:04.793873    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v" podUID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 11:12:06.265733 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.265708    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:12:06.297764 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.297738    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-podinfo\") pod \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") "
Aug 04 11:12:06.297884 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.297769    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istiod-ca-cert\") pod \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") "
Aug 04 11:12:06.297884 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.297794    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-data\") pod \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") "
Aug 04 11:12:06.297884 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.297833    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-token\") pod \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") "
Aug 04 11:12:06.297884 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.297861    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-credential-socket\") pod \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") "
Aug 04 11:12:06.298082 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.297907    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-workload-socket\") pod \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") "
Aug 04 11:12:06.298082 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.297956    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-envoy\") pod \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") "
Aug 04 11:12:06.298082 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.297991    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fkkn\" (UniqueName: \"kubernetes.io/projected/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-kube-api-access-6fkkn\") pod \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") "
Aug 04 11:12:06.298082 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.298018    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-workload-certs\") pod \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\" (UID: \"66ef3d80-9a7f-4cba-99f2-5191aa0b6408\") "
Aug 04 11:12:06.298303 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.298173    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-data" (OuterVolumeSpecName: "istio-data") pod "66ef3d80-9a7f-4cba-99f2-5191aa0b6408" (UID: "66ef3d80-9a7f-4cba-99f2-5191aa0b6408"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:12:06.298303 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.298179    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "66ef3d80-9a7f-4cba-99f2-5191aa0b6408" (UID: "66ef3d80-9a7f-4cba-99f2-5191aa0b6408"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:12:06.298303 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.298255    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "66ef3d80-9a7f-4cba-99f2-5191aa0b6408" (UID: "66ef3d80-9a7f-4cba-99f2-5191aa0b6408"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:12:06.298453 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.298352    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "66ef3d80-9a7f-4cba-99f2-5191aa0b6408" (UID: "66ef3d80-9a7f-4cba-99f2-5191aa0b6408"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:12:06.298453 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.298376    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:12:06.298453 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.298394    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:12:06.298453 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.298430    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "66ef3d80-9a7f-4cba-99f2-5191aa0b6408" (UID: "66ef3d80-9a7f-4cba-99f2-5191aa0b6408"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:12:06.300058 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.300026    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "66ef3d80-9a7f-4cba-99f2-5191aa0b6408" (UID: "66ef3d80-9a7f-4cba-99f2-5191aa0b6408"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 11:12:06.300205 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.300182    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-token" (OuterVolumeSpecName: "istio-token") pod "66ef3d80-9a7f-4cba-99f2-5191aa0b6408" (UID: "66ef3d80-9a7f-4cba-99f2-5191aa0b6408"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:12:06.300368 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.300353    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "66ef3d80-9a7f-4cba-99f2-5191aa0b6408" (UID: "66ef3d80-9a7f-4cba-99f2-5191aa0b6408"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:12:06.300692 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.300668    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-kube-api-access-6fkkn" (OuterVolumeSpecName: "kube-api-access-6fkkn") pod "66ef3d80-9a7f-4cba-99f2-5191aa0b6408" (UID: "66ef3d80-9a7f-4cba-99f2-5191aa0b6408"). InnerVolumeSpecName "kube-api-access-6fkkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:12:06.399440 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.399415    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:12:06.399440 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.399441    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fkkn\" (UniqueName: \"kubernetes.io/projected/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-kube-api-access-6fkkn\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:12:06.399596 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.399450    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:12:06.399596 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.399458    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:12:06.399596 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.399466    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:12:06.399596 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.399474    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:12:06.399596 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.399481    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66ef3d80-9a7f-4cba-99f2-5191aa0b6408-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:12:06.715013 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.714933    2559 generic.go:356] "Generic (PLEG): container finished" podID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerID="c412c37a15e907ed1627561a082a065a1799542271460119850e7a6b1e86fa97" exitCode=0
Aug 04 11:12:06.715013 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.714988    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"
Aug 04 11:12:06.715013 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.715009    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v" event={"ID":"66ef3d80-9a7f-4cba-99f2-5191aa0b6408","Type":"ContainerDied","Data":"c412c37a15e907ed1627561a082a065a1799542271460119850e7a6b1e86fa97"}
Aug 04 11:12:06.715222 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.715060    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v" event={"ID":"66ef3d80-9a7f-4cba-99f2-5191aa0b6408","Type":"ContainerDied","Data":"c9855b7f5d846986ddf6bc3e51babea1e57da6d4a3265b9a85426e3b16765e1b"}
Aug 04 11:12:06.715222 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.715088    2559 scope.go:117] "RemoveContainer" containerID="c412c37a15e907ed1627561a082a065a1799542271460119850e7a6b1e86fa97"
Aug 04 11:12:06.724179 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.724157    2559 scope.go:117] "RemoveContainer" containerID="141c3d020c881c87c8dbf2d9bd3d0120819eb8e1a92cb805be31666fd6266ba7"
Aug 04 11:12:06.731707 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.731686    2559 scope.go:117] "RemoveContainer" containerID="c412c37a15e907ed1627561a082a065a1799542271460119850e7a6b1e86fa97"
Aug 04 11:12:06.731946 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:12:06.731927    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c412c37a15e907ed1627561a082a065a1799542271460119850e7a6b1e86fa97\": container with ID starting with c412c37a15e907ed1627561a082a065a1799542271460119850e7a6b1e86fa97 not found: ID does not exist" containerID="c412c37a15e907ed1627561a082a065a1799542271460119850e7a6b1e86fa97"
Aug 04 11:12:06.732017 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.731958    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c412c37a15e907ed1627561a082a065a1799542271460119850e7a6b1e86fa97"} err="failed to get container status \"c412c37a15e907ed1627561a082a065a1799542271460119850e7a6b1e86fa97\": rpc error: code = NotFound desc = could not find container \"c412c37a15e907ed1627561a082a065a1799542271460119850e7a6b1e86fa97\": container with ID starting with c412c37a15e907ed1627561a082a065a1799542271460119850e7a6b1e86fa97 not found: ID does not exist"
Aug 04 11:12:06.732017 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.731983    2559 scope.go:117] "RemoveContainer" containerID="141c3d020c881c87c8dbf2d9bd3d0120819eb8e1a92cb805be31666fd6266ba7"
Aug 04 11:12:06.732226 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:12:06.732209    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"141c3d020c881c87c8dbf2d9bd3d0120819eb8e1a92cb805be31666fd6266ba7\": container with ID starting with 141c3d020c881c87c8dbf2d9bd3d0120819eb8e1a92cb805be31666fd6266ba7 not found: ID does not exist" containerID="141c3d020c881c87c8dbf2d9bd3d0120819eb8e1a92cb805be31666fd6266ba7"
Aug 04 11:12:06.732279 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.732233    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"141c3d020c881c87c8dbf2d9bd3d0120819eb8e1a92cb805be31666fd6266ba7"} err="failed to get container status \"141c3d020c881c87c8dbf2d9bd3d0120819eb8e1a92cb805be31666fd6266ba7\": rpc error: code = NotFound desc = could not find container \"141c3d020c881c87c8dbf2d9bd3d0120819eb8e1a92cb805be31666fd6266ba7\": container with ID starting with 141c3d020c881c87c8dbf2d9bd3d0120819eb8e1a92cb805be31666fd6266ba7 not found: ID does not exist"
Aug 04 11:12:06.739038 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.739015    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"]
Aug 04 11:12:06.743933 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:06.743915    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-dfeef193-openshift-default-688fd9db96-spj6v"]
Aug 04 11:12:07.785659 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:12:07.783290    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" path="/var/lib/kubelet/pods/66ef3d80-9a7f-4cba-99f2-5191aa0b6408/volumes"
Aug 04 11:14:01.516657 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.516615    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"]
Aug 04 11:14:01.517051 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.516948    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerName="istio-proxy"
Aug 04 11:14:01.517051 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.516959    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerName="istio-proxy"
Aug 04 11:14:01.517051 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.516971    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="873cd94e-18cb-443d-a9c1-5b5528cb2ec0" containerName="revoke-keys"
Aug 04 11:14:01.517051 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.516976    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="873cd94e-18cb-443d-a9c1-5b5528cb2ec0" containerName="revoke-keys"
Aug 04 11:14:01.517051 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.516984    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerName="istio-proxy"
Aug 04 11:14:01.517051 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.516989    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerName="istio-proxy"
Aug 04 11:14:01.517051 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.517041    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a48a0fd6-4705-44e2-a877-ccb1f98ef8bb" containerName="istio-proxy"
Aug 04 11:14:01.517051 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.517049    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerName="istio-proxy"
Aug 04 11:14:01.517051 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.517056    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="873cd94e-18cb-443d-a9c1-5b5528cb2ec0" containerName="revoke-keys"
Aug 04 11:14:01.517318 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.517062    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="66ef3d80-9a7f-4cba-99f2-5191aa0b6408" containerName="istio-proxy"
Aug 04 11:14:01.519843 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.519827    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.524695 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.524668    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7d02d259-openshift-default-dockercfg-vq6xn\""
Aug 04 11:14:01.581019 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.580989    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"]
Aug 04 11:14:01.695621 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.695590    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-podinfo\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.695809 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.695661    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-workload-socket\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.695809 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.695702    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-workload-certs\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.695809 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.695762    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-credential-socket\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.695809 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.695778    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-data\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.695809 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.695796    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d803aa0c-4a5d-4437-9648-959d12af03a0-istiod-ca-cert\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.695966 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.695845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcqf4\" (UniqueName: \"kubernetes.io/projected/d803aa0c-4a5d-4437-9648-959d12af03a0-kube-api-access-mcqf4\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.695966 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.695878    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-envoy\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.695966 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.695906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-token\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.796318 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.796250    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-podinfo\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.796318 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.796300    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-workload-socket\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.796524 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.796477    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-workload-certs\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.796583 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.796524    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-credential-socket\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.796583 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.796550    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-data\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.796719 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.796581    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d803aa0c-4a5d-4437-9648-959d12af03a0-istiod-ca-cert\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.796719 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.796624    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcqf4\" (UniqueName: \"kubernetes.io/projected/d803aa0c-4a5d-4437-9648-959d12af03a0-kube-api-access-mcqf4\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.796719 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.796696    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-envoy\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.796866 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.796726    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-token\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.796866 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.796725    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-workload-socket\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.796866 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.796813    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-workload-certs\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.797012 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.796985    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-credential-socket\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.797238 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.797218    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-data\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.797409 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.797361    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d803aa0c-4a5d-4437-9648-959d12af03a0-istiod-ca-cert\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.798953 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.798931    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-podinfo\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.799082 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.799062    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-envoy\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.805024 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.805005    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-token\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.807282 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.807262    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcqf4\" (UniqueName: \"kubernetes.io/projected/d803aa0c-4a5d-4437-9648-959d12af03a0-kube-api-access-mcqf4\") pod \"e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") " pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.829734 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.829711    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:01.977368 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.977339    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"]
Aug 04 11:14:01.979610 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:14:01.979583    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd803aa0c_4a5d_4437_9648_959d12af03a0.slice/crio-0e9fd5796a19d8764bfe5c6c9b8ca2acaa04895d42a9b52ee9083336569c63ca WatchSource:0}: Error finding container 0e9fd5796a19d8764bfe5c6c9b8ca2acaa04895d42a9b52ee9083336569c63ca: Status 404 returned error can't find the container with id 0e9fd5796a19d8764bfe5c6c9b8ca2acaa04895d42a9b52ee9083336569c63ca
Aug 04 11:14:01.981615 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.981585    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:14:01.981717 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.981670    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:14:01.981717 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:01.981703    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:14:02.229613 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:02.229580    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v" event={"ID":"d803aa0c-4a5d-4437-9648-959d12af03a0","Type":"ContainerStarted","Data":"c403530eb7f90d9d91f7848611d803946ebe030f278e62d4574a24f3e0c4f892"}
Aug 04 11:14:02.229810 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:02.229659    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v" event={"ID":"d803aa0c-4a5d-4437-9648-959d12af03a0","Type":"ContainerStarted","Data":"0e9fd5796a19d8764bfe5c6c9b8ca2acaa04895d42a9b52ee9083336569c63ca"}
Aug 04 11:14:02.250978 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:02.250923    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v" podStartSLOduration=1.250902882 podStartE2EDuration="1.250902882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:14:02.248121506 +0000 UTC m=+2232.974191862" watchObservedRunningTime="2026-08-04 11:14:02.250902882 +0000 UTC m=+2232.976973221"
Aug 04 11:14:02.830489 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:02.830451    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:03.835583 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:03.835556    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:04.239081 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:04.239047    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:04.239926 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:04.239895    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:18.303006 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:18.302972    2559 generic.go:356] "Generic (PLEG): container finished" podID="d803aa0c-4a5d-4437-9648-959d12af03a0" containerID="c403530eb7f90d9d91f7848611d803946ebe030f278e62d4574a24f3e0c4f892" exitCode=0
Aug 04 11:14:18.303409 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:18.303045    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v" event={"ID":"d803aa0c-4a5d-4437-9648-959d12af03a0","Type":"ContainerDied","Data":"c403530eb7f90d9d91f7848611d803946ebe030f278e62d4574a24f3e0c4f892"}
Aug 04 11:14:18.303450 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:18.303411    2559 scope.go:117] "RemoveContainer" containerID="c403530eb7f90d9d91f7848611d803946ebe030f278e62d4574a24f3e0c4f892"
Aug 04 11:14:18.304399 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:18.304372    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:14:18.304471 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:18.304454    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:14:18.304519 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:18.304503    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:14:19.239827 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:19.239783    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:19.311561 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:19.311516    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v" event={"ID":"d803aa0c-4a5d-4437-9648-959d12af03a0","Type":"ContainerStarted","Data":"6ab9f4517870513450b8041a984d5074a2571f42017f734fa4a4539835755e93"}
Aug 04 11:14:19.830474 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:19.830444    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:19.831908 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:19.831875    2559 patch_prober.go:28] interesting pod/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Aug 04 11:14:19.832048 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:19.831942    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v" podUID="d803aa0c-4a5d-4437-9648-959d12af03a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Aug 04 11:14:20.830981 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:20.830935    2559 patch_prober.go:28] interesting pod/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Aug 04 11:14:20.831466 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:20.831014    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v" podUID="d803aa0c-4a5d-4437-9648-959d12af03a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Aug 04 11:14:21.830994 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:21.830953    2559 patch_prober.go:28] interesting pod/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Aug 04 11:14:21.831469 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:21.831025    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v" podUID="d803aa0c-4a5d-4437-9648-959d12af03a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Aug 04 11:14:22.831199 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:22.831151    2559 patch_prober.go:28] interesting pod/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Aug 04 11:14:22.831708 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:22.831232    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v" podUID="d803aa0c-4a5d-4437-9648-959d12af03a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Aug 04 11:14:23.830756 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:23.830706    2559 patch_prober.go:28] interesting pod/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Aug 04 11:14:23.831065 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:23.831021    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v" podUID="d803aa0c-4a5d-4437-9648-959d12af03a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Aug 04 11:14:24.834654 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:24.834616    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:24.835019 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:24.834990    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:24.835727 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:24.835706    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:36.576948 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:36.576909    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65"]
Aug 04 11:14:36.579299 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:36.579282    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65"
Aug 04 11:14:36.581895 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:36.581872    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tgsgx\""
Aug 04 11:14:36.588214 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:36.588191    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65"]
Aug 04 11:14:36.677911 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:36.677879    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2b369e-e153-412f-9094-b546aeb84b07-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7d02d259-64g65\" (UID: \"3d2b369e-e153-412f-9094-b546aeb84b07\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65"
Aug 04 11:14:36.778714 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:36.778689    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2b369e-e153-412f-9094-b546aeb84b07-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7d02d259-64g65\" (UID: \"3d2b369e-e153-412f-9094-b546aeb84b07\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65"
Aug 04 11:14:36.779272 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:36.779253    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2b369e-e153-412f-9094-b546aeb84b07-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7d02d259-64g65\" (UID: \"3d2b369e-e153-412f-9094-b546aeb84b07\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65"
Aug 04 11:14:36.890486 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:36.890452    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65"
Aug 04 11:14:37.020015 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:37.019960    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65"]
Aug 04 11:14:37.022790 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:14:37.022761    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d2b369e_e153_412f_9094_b546aeb84b07.slice/crio-ac2922640fdd6d203f1281df11861b96082b8de5e49769e6255283bc0ed5b105 WatchSource:0}: Error finding container ac2922640fdd6d203f1281df11861b96082b8de5e49769e6255283bc0ed5b105: Status 404 returned error can't find the container with id ac2922640fdd6d203f1281df11861b96082b8de5e49769e6255283bc0ed5b105
Aug 04 11:14:37.399989 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:37.399952    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65" event={"ID":"3d2b369e-e153-412f-9094-b546aeb84b07","Type":"ContainerStarted","Data":"b6c10408842ef672f117af2215b89a6a2f453f95a81a9bfa62fc6e86c8248e1b"}
Aug 04 11:14:37.400158 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:37.400001    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65" event={"ID":"3d2b369e-e153-412f-9094-b546aeb84b07","Type":"ContainerStarted","Data":"ac2922640fdd6d203f1281df11861b96082b8de5e49769e6255283bc0ed5b105"}
Aug 04 11:14:37.415412 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:37.415363    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65" podStartSLOduration=1.415348201 podStartE2EDuration="1.415348201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:14:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:14:37.414715722 +0000 UTC m=+2268.140786057" watchObservedRunningTime="2026-08-04 11:14:37.415348201 +0000 UTC m=+2268.141418534"
Aug 04 11:14:38.406836 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:38.406803    2559 generic.go:356] "Generic (PLEG): container finished" podID="3d2b369e-e153-412f-9094-b546aeb84b07" containerID="b6c10408842ef672f117af2215b89a6a2f453f95a81a9bfa62fc6e86c8248e1b" exitCode=0
Aug 04 11:14:38.406836 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:38.406839    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65" event={"ID":"3d2b369e-e153-412f-9094-b546aeb84b07","Type":"ContainerDied","Data":"b6c10408842ef672f117af2215b89a6a2f453f95a81a9bfa62fc6e86c8248e1b"}
Aug 04 11:14:39.540711 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:39.540686    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65"
Aug 04 11:14:39.606454 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:39.606430    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2b369e-e153-412f-9094-b546aeb84b07-maas-api-service-ca\") pod \"3d2b369e-e153-412f-9094-b546aeb84b07\" (UID: \"3d2b369e-e153-412f-9094-b546aeb84b07\") "
Aug 04 11:14:39.606886 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:39.606859    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d2b369e-e153-412f-9094-b546aeb84b07-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3d2b369e-e153-412f-9094-b546aeb84b07" (UID: "3d2b369e-e153-412f-9094-b546aeb84b07"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:14:39.607039 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:39.607012    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2b369e-e153-412f-9094-b546aeb84b07-maas-api-service-ca\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:14:40.417849 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:40.417817    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65" event={"ID":"3d2b369e-e153-412f-9094-b546aeb84b07","Type":"ContainerDied","Data":"ac2922640fdd6d203f1281df11861b96082b8de5e49769e6255283bc0ed5b105"}
Aug 04 11:14:40.417849 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:40.417843    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65"
Aug 04 11:14:40.418067 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:40.417869    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac2922640fdd6d203f1281df11861b96082b8de5e49769e6255283bc0ed5b105"
Aug 04 11:14:47.919591 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:47.919556    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65"]
Aug 04 11:14:47.921917 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:47.921894    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7d02d259-64g65"]
Aug 04 11:14:49.780544 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:49.780512    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d2b369e-e153-412f-9094-b546aeb84b07" path="/var/lib/kubelet/pods/3d2b369e-e153-412f-9094-b546aeb84b07/volumes"
Aug 04 11:14:54.454054 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:54.454025    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"]
Aug 04 11:14:54.454437 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:54.454235    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v" podUID="d803aa0c-4a5d-4437-9648-959d12af03a0" containerName="istio-proxy" containerID="cri-o://6ab9f4517870513450b8041a984d5074a2571f42017f734fa4a4539835755e93" gracePeriod=30
Aug 04 11:14:54.837766 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:54.837680    2559 patch_prober.go:28] interesting pod/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 11:14:54.837766 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:54.837734    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v" podUID="d803aa0c-4a5d-4437-9648-959d12af03a0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 11:14:59.699363 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.699338    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:14:59.871683 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.871656    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-envoy\") pod \"d803aa0c-4a5d-4437-9648-959d12af03a0\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") "
Aug 04 11:14:59.871823 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.871686    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d803aa0c-4a5d-4437-9648-959d12af03a0-istiod-ca-cert\") pod \"d803aa0c-4a5d-4437-9648-959d12af03a0\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") "
Aug 04 11:14:59.871823 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.871706    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-podinfo\") pod \"d803aa0c-4a5d-4437-9648-959d12af03a0\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") "
Aug 04 11:14:59.871823 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.871726    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-workload-socket\") pod \"d803aa0c-4a5d-4437-9648-959d12af03a0\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") "
Aug 04 11:14:59.871823 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.871742    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-token\") pod \"d803aa0c-4a5d-4437-9648-959d12af03a0\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") "
Aug 04 11:14:59.872043 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.871841    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-credential-socket\") pod \"d803aa0c-4a5d-4437-9648-959d12af03a0\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") "
Aug 04 11:14:59.872043 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.871891    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-workload-certs\") pod \"d803aa0c-4a5d-4437-9648-959d12af03a0\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") "
Aug 04 11:14:59.872043 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.871911    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-data\") pod \"d803aa0c-4a5d-4437-9648-959d12af03a0\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") "
Aug 04 11:14:59.872043 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.871958    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcqf4\" (UniqueName: \"kubernetes.io/projected/d803aa0c-4a5d-4437-9648-959d12af03a0-kube-api-access-mcqf4\") pod \"d803aa0c-4a5d-4437-9648-959d12af03a0\" (UID: \"d803aa0c-4a5d-4437-9648-959d12af03a0\") "
Aug 04 11:14:59.872043 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.872029    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d803aa0c-4a5d-4437-9648-959d12af03a0" (UID: "d803aa0c-4a5d-4437-9648-959d12af03a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:14:59.872288 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.872144    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d803aa0c-4a5d-4437-9648-959d12af03a0" (UID: "d803aa0c-4a5d-4437-9648-959d12af03a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:14:59.872288 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.872160    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d803aa0c-4a5d-4437-9648-959d12af03a0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d803aa0c-4a5d-4437-9648-959d12af03a0" (UID: "d803aa0c-4a5d-4437-9648-959d12af03a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:14:59.872383 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.872277    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d803aa0c-4a5d-4437-9648-959d12af03a0-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:14:59.872383 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.872337    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:14:59.872383 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.872346    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d803aa0c-4a5d-4437-9648-959d12af03a0" (UID: "d803aa0c-4a5d-4437-9648-959d12af03a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:14:59.872383 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.872351    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:14:59.872383 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.872379    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-data" (OuterVolumeSpecName: "istio-data") pod "d803aa0c-4a5d-4437-9648-959d12af03a0" (UID: "d803aa0c-4a5d-4437-9648-959d12af03a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:14:59.874425 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.874396    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d803aa0c-4a5d-4437-9648-959d12af03a0" (UID: "d803aa0c-4a5d-4437-9648-959d12af03a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 11:14:59.874532 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.874396    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d803aa0c-4a5d-4437-9648-959d12af03a0" (UID: "d803aa0c-4a5d-4437-9648-959d12af03a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:14:59.874617 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.874532    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-token" (OuterVolumeSpecName: "istio-token") pod "d803aa0c-4a5d-4437-9648-959d12af03a0" (UID: "d803aa0c-4a5d-4437-9648-959d12af03a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:14:59.874617 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.874557    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d803aa0c-4a5d-4437-9648-959d12af03a0-kube-api-access-mcqf4" (OuterVolumeSpecName: "kube-api-access-mcqf4") pod "d803aa0c-4a5d-4437-9648-959d12af03a0" (UID: "d803aa0c-4a5d-4437-9648-959d12af03a0"). InnerVolumeSpecName "kube-api-access-mcqf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:14:59.973429 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.973402    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:14:59.973429 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.973427    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:14:59.973596 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.973439    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:14:59.973596 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.973451    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:14:59.973596 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.973462    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d803aa0c-4a5d-4437-9648-959d12af03a0-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:14:59.973596 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:14:59.973471    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcqf4\" (UniqueName: \"kubernetes.io/projected/d803aa0c-4a5d-4437-9648-959d12af03a0-kube-api-access-mcqf4\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:15:00.513285 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:15:00.513245    2559 generic.go:356] "Generic (PLEG): container finished" podID="d803aa0c-4a5d-4437-9648-959d12af03a0" containerID="6ab9f4517870513450b8041a984d5074a2571f42017f734fa4a4539835755e93" exitCode=0
Aug 04 11:15:00.513454 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:15:00.513305    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v" event={"ID":"d803aa0c-4a5d-4437-9648-959d12af03a0","Type":"ContainerDied","Data":"6ab9f4517870513450b8041a984d5074a2571f42017f734fa4a4539835755e93"}
Aug 04 11:15:00.513454 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:15:00.513309    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"
Aug 04 11:15:00.513454 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:15:00.513347    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v" event={"ID":"d803aa0c-4a5d-4437-9648-959d12af03a0","Type":"ContainerDied","Data":"0e9fd5796a19d8764bfe5c6c9b8ca2acaa04895d42a9b52ee9083336569c63ca"}
Aug 04 11:15:00.513454 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:15:00.513367    2559 scope.go:117] "RemoveContainer" containerID="6ab9f4517870513450b8041a984d5074a2571f42017f734fa4a4539835755e93"
Aug 04 11:15:00.523720 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:15:00.523698    2559 scope.go:117] "RemoveContainer" containerID="c403530eb7f90d9d91f7848611d803946ebe030f278e62d4574a24f3e0c4f892"
Aug 04 11:15:00.532598 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:15:00.532436    2559 scope.go:117] "RemoveContainer" containerID="6ab9f4517870513450b8041a984d5074a2571f42017f734fa4a4539835755e93"
Aug 04 11:15:00.533247 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:15:00.533215    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ab9f4517870513450b8041a984d5074a2571f42017f734fa4a4539835755e93\": container with ID starting with 6ab9f4517870513450b8041a984d5074a2571f42017f734fa4a4539835755e93 not found: ID does not exist" containerID="6ab9f4517870513450b8041a984d5074a2571f42017f734fa4a4539835755e93"
Aug 04 11:15:00.533350 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:15:00.533256    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ab9f4517870513450b8041a984d5074a2571f42017f734fa4a4539835755e93"} err="failed to get container status \"6ab9f4517870513450b8041a984d5074a2571f42017f734fa4a4539835755e93\": rpc error: code = NotFound desc = could not find container \"6ab9f4517870513450b8041a984d5074a2571f42017f734fa4a4539835755e93\": container with ID starting with 6ab9f4517870513450b8041a984d5074a2571f42017f734fa4a4539835755e93 not found: ID does not exist"
Aug 04 11:15:00.533350 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:15:00.533308    2559 scope.go:117] "RemoveContainer" containerID="c403530eb7f90d9d91f7848611d803946ebe030f278e62d4574a24f3e0c4f892"
Aug 04 11:15:00.533614 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:15:00.533590    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c403530eb7f90d9d91f7848611d803946ebe030f278e62d4574a24f3e0c4f892\": container with ID starting with c403530eb7f90d9d91f7848611d803946ebe030f278e62d4574a24f3e0c4f892 not found: ID does not exist" containerID="c403530eb7f90d9d91f7848611d803946ebe030f278e62d4574a24f3e0c4f892"
Aug 04 11:15:00.533740 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:15:00.533618    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c403530eb7f90d9d91f7848611d803946ebe030f278e62d4574a24f3e0c4f892"} err="failed to get container status \"c403530eb7f90d9d91f7848611d803946ebe030f278e62d4574a24f3e0c4f892\": rpc error: code = NotFound desc = could not find container \"c403530eb7f90d9d91f7848611d803946ebe030f278e62d4574a24f3e0c4f892\": container with ID starting with c403530eb7f90d9d91f7848611d803946ebe030f278e62d4574a24f3e0c4f892 not found: ID does not exist"
Aug 04 11:15:00.535004 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:15:00.534981    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"]
Aug 04 11:15:00.539101 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:15:00.539078    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7d02d259-openshift-default-7876f87b76-xnv6v"]
Aug 04 11:15:01.780293 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:15:01.780259    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d803aa0c-4a5d-4437-9648-959d12af03a0" path="/var/lib/kubelet/pods/d803aa0c-4a5d-4437-9648-959d12af03a0/volumes"
Aug 04 11:17:10.517049 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.517009    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"]
Aug 04 11:17:10.517576 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.517560    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d803aa0c-4a5d-4437-9648-959d12af03a0" containerName="istio-proxy"
Aug 04 11:17:10.517620 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.517579    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d803aa0c-4a5d-4437-9648-959d12af03a0" containerName="istio-proxy"
Aug 04 11:17:10.517620 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.517590    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d803aa0c-4a5d-4437-9648-959d12af03a0" containerName="istio-proxy"
Aug 04 11:17:10.517620 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.517598    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d803aa0c-4a5d-4437-9648-959d12af03a0" containerName="istio-proxy"
Aug 04 11:17:10.517769 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.517619    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d2b369e-e153-412f-9094-b546aeb84b07" containerName="revoke-keys"
Aug 04 11:17:10.517769 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.517627    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d2b369e-e153-412f-9094-b546aeb84b07" containerName="revoke-keys"
Aug 04 11:17:10.517769 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.517742    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d803aa0c-4a5d-4437-9648-959d12af03a0" containerName="istio-proxy"
Aug 04 11:17:10.517769 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.517759    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d2b369e-e153-412f-9094-b546aeb84b07" containerName="revoke-keys"
Aug 04 11:17:10.521384 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.521362    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.523612 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.523591    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c88ef17b-openshift-default-dockercfg-5s8rg\""
Aug 04 11:17:10.533155 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.533133    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"]
Aug 04 11:17:10.693443 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.693359    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-workload-certs\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.693443 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.693398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istiod-ca-cert\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.693443 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.693422    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-credential-socket\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.693443 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.693437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-token\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.693726 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.693515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwt6t\" (UniqueName: \"kubernetes.io/projected/3eb762e7-9fad-4601-b7e8-cd511febb8ba-kube-api-access-zwt6t\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.693726 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.693566    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-podinfo\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.693726 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.693693    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-workload-socket\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.693726 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.693711    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-envoy\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.693860 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.693728    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-data\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.794949 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.794872    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-workload-socket\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.794949 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.794903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-envoy\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.794949 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.794919    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-data\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.794949 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.794940    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-workload-certs\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.795248 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.794963    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istiod-ca-cert\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.795248 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.794997    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-credential-socket\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.795248 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.795021    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-token\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.795248 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.795047    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwt6t\" (UniqueName: \"kubernetes.io/projected/3eb762e7-9fad-4601-b7e8-cd511febb8ba-kube-api-access-zwt6t\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.795248 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.795083    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-podinfo\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.795506 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.795338    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-workload-socket\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.795506 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.795352    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-data\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.795506 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.795431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-workload-certs\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.795607 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.795595    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-credential-socket\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.795919 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.795902    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istiod-ca-cert\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.797261 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.797243    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-envoy\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.797767 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.797752    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-podinfo\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.803248 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.803230    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-token\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.803476 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.803457    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwt6t\" (UniqueName: \"kubernetes.io/projected/3eb762e7-9fad-4601-b7e8-cd511febb8ba-kube-api-access-zwt6t\") pod \"e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") " pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.833141 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.833117    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:10.968946 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.968920    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"]
Aug 04 11:17:10.970958 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:17:10.970930    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb762e7_9fad_4601_b7e8_cd511febb8ba.slice/crio-4a3b17e0b1d66257418ecbc41f614933e3e15830fdef57578eb790ac5d2604fc WatchSource:0}: Error finding container 4a3b17e0b1d66257418ecbc41f614933e3e15830fdef57578eb790ac5d2604fc: Status 404 returned error can't find the container with id 4a3b17e0b1d66257418ecbc41f614933e3e15830fdef57578eb790ac5d2604fc
Aug 04 11:17:10.973106 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.973072    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:17:10.973175 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.973137    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:17:10.973175 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:10.973164    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:17:11.079902 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:11.079808    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l" event={"ID":"3eb762e7-9fad-4601-b7e8-cd511febb8ba","Type":"ContainerStarted","Data":"a13b5cde7e68c7a3d444e4665640a6f24c0fb272dc66bf5e0c7198a90ea2de24"}
Aug 04 11:17:11.079902 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:11.079876    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l" event={"ID":"3eb762e7-9fad-4601-b7e8-cd511febb8ba","Type":"ContainerStarted","Data":"4a3b17e0b1d66257418ecbc41f614933e3e15830fdef57578eb790ac5d2604fc"}
Aug 04 11:17:11.100230 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:11.100150    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l" podStartSLOduration=1.100132123 podStartE2EDuration="1.100132123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:17:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:17:11.098816565 +0000 UTC m=+2421.824886898" watchObservedRunningTime="2026-08-04 11:17:11.100132123 +0000 UTC m=+2421.826202459"
Aug 04 11:17:11.833395 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:11.833366    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:12.838864 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:12.838831    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:13.090025 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:13.089948    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:13.090767 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:13.090749    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:28.091207 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:28.091120    2559 patch_prober.go:28] interesting pod/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 04 11:17:28.091207 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:28.091176    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l" podUID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 04 11:17:28.176312 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:28.176282    2559 generic.go:356] "Generic (PLEG): container finished" podID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerID="a13b5cde7e68c7a3d444e4665640a6f24c0fb272dc66bf5e0c7198a90ea2de24" exitCode=0
Aug 04 11:17:28.176440 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:28.176319    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l" event={"ID":"3eb762e7-9fad-4601-b7e8-cd511febb8ba","Type":"ContainerDied","Data":"a13b5cde7e68c7a3d444e4665640a6f24c0fb272dc66bf5e0c7198a90ea2de24"}
Aug 04 11:17:28.176671 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:28.176634    2559 scope.go:117] "RemoveContainer" containerID="a13b5cde7e68c7a3d444e4665640a6f24c0fb272dc66bf5e0c7198a90ea2de24"
Aug 04 11:17:28.177672 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:28.177629    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:17:28.177736 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:28.177713    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:17:28.177784 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:28.177744    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:17:29.183116 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:29.183080    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l" event={"ID":"3eb762e7-9fad-4601-b7e8-cd511febb8ba","Type":"ContainerStarted","Data":"8601a6ad68f880d63b62187f452d8515c48dc4e7c3c2bb40bc0c7c49d654843e"}
Aug 04 11:17:29.833265 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:29.833226    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:29.833571 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:29.833547    2559 patch_prober.go:28] interesting pod/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 04 11:17:29.833700 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:29.833599    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l" podUID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 04 11:17:30.833832 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:30.833790    2559 patch_prober.go:28] interesting pod/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 04 11:17:30.834323 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:30.833860    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l" podUID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 04 11:17:31.834081 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:31.834039    2559 patch_prober.go:28] interesting pod/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 04 11:17:31.834458 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:31.834099    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l" podUID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 04 11:17:32.833729 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:32.833686    2559 patch_prober.go:28] interesting pod/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 04 11:17:32.833933 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:32.833765    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l" podUID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 04 11:17:33.834355 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:33.834309    2559 patch_prober.go:28] interesting pod/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 04 11:17:33.834905 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:33.834363    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l" podUID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 04 11:17:34.838310 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:34.838274    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:34.838724 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:34.838662    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:34.839412 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:34.839393    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:17:49.987429 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:49.987399    2559 scope.go:117] "RemoveContainer" containerID="f4fefbc277d9330402b9f3eeca74721d155b95bab6c1dcf3fa8f2b896f4b2fd5"
Aug 04 11:17:59.263014 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.262976    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"]
Aug 04 11:17:59.263439 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.263419    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d803aa0c-4a5d-4437-9648-959d12af03a0" containerName="istio-proxy"
Aug 04 11:17:59.266161 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.266146    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.269321 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.269292    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c88ef17b\"/\"default-dockercfg-lwfb9\""
Aug 04 11:17:59.269455 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.269349    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c88ef17b\"/\"openshift-service-ca.crt\""
Aug 04 11:17:59.269455 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.269349    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c88ef17b\"/\"kube-root-ca.crt\""
Aug 04 11:17:59.269455 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.269350    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c88ef17b\"/\"e2e-lifecycle-model-c88ef17b-kserve-self-signed-certs\""
Aug 04 11:17:59.274264 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.274243    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"]
Aug 04 11:17:59.392806 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.392772    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-home\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.392979 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.392811    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e131b9e8-7473-416a-81a6-e718a18daf07-tls-certs\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.392979 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.392874    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-dshm\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.392979 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.392929    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-tmp-dir\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.392979 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.392972    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h24g\" (UniqueName: \"kubernetes.io/projected/e131b9e8-7473-416a-81a6-e718a18daf07-kube-api-access-8h24g\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.393128 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.393009    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-model-cache\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.493782 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.493754    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-tmp-dir\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.493940 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.493795    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h24g\" (UniqueName: \"kubernetes.io/projected/e131b9e8-7473-416a-81a6-e718a18daf07-kube-api-access-8h24g\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.493940 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.493818    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-model-cache\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.494017 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.493993    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-home\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.494052 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.494036    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e131b9e8-7473-416a-81a6-e718a18daf07-tls-certs\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.494172 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.494151    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-tmp-dir\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.494230 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.494167    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-model-cache\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.494230 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.494180    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-dshm\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.494304 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.494291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-home\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.496428 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.496397    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-dshm\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.496612 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.496597    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e131b9e8-7473-416a-81a6-e718a18daf07-tls-certs\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.502322 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.502298    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h24g\" (UniqueName: \"kubernetes.io/projected/e131b9e8-7473-416a-81a6-e718a18daf07-kube-api-access-8h24g\") pod \"e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") " pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.576304 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.576224    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:17:59.711966 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:17:59.711937    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"]
Aug 04 11:17:59.713695 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:17:59.713668    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode131b9e8_7473_416a_81a6_e718a18daf07.slice/crio-fc653fa1a48e872abbb77882c6080acce754f4b1ea02228dd903d8c0fa218d08 WatchSource:0}: Error finding container fc653fa1a48e872abbb77882c6080acce754f4b1ea02228dd903d8c0fa218d08: Status 404 returned error can't find the container with id fc653fa1a48e872abbb77882c6080acce754f4b1ea02228dd903d8c0fa218d08
Aug 04 11:18:00.319570 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:00.319534    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6" event={"ID":"e131b9e8-7473-416a-81a6-e718a18daf07","Type":"ContainerStarted","Data":"2a51103a148649fc6f2d7504b034d0947f7dfa5cf5455bf0de1d0f90cc27ca48"}
Aug 04 11:18:00.319570 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:00.319574    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6" event={"ID":"e131b9e8-7473-416a-81a6-e718a18daf07","Type":"ContainerStarted","Data":"fc653fa1a48e872abbb77882c6080acce754f4b1ea02228dd903d8c0fa218d08"}
Aug 04 11:18:00.339010 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:00.338960    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6" podStartSLOduration=1.338937631 podStartE2EDuration="1.338937631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:17:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:18:00.336482607 +0000 UTC m=+2471.062552941" watchObservedRunningTime="2026-08-04 11:18:00.338937631 +0000 UTC m=+2471.065007966"
Aug 04 11:18:09.576522 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:09.576482    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:18:09.576522 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:09.576529    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:18:09.588599 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:09.588571    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:18:10.378188 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:10.378163    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:18:27.611699 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:27.611659    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d"]
Aug 04 11:18:27.614714 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:27.614694    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d"
Aug 04 11:18:27.617355 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:27.617335    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tgsgx\""
Aug 04 11:18:27.622553 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:27.622529    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d"]
Aug 04 11:18:27.719838 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:27.719800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca7c46aa-7b64-4759-85b4-3dba4aa03f6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d\" (UID: \"ca7c46aa-7b64-4759-85b4-3dba4aa03f6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d"
Aug 04 11:18:27.820851 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:27.820822    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca7c46aa-7b64-4759-85b4-3dba4aa03f6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d\" (UID: \"ca7c46aa-7b64-4759-85b4-3dba4aa03f6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d"
Aug 04 11:18:27.821413 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:27.821395    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca7c46aa-7b64-4759-85b4-3dba4aa03f6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d\" (UID: \"ca7c46aa-7b64-4759-85b4-3dba4aa03f6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d"
Aug 04 11:18:27.927842 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:27.927773    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d"
Aug 04 11:18:28.265083 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:28.265058    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d"]
Aug 04 11:18:28.267053 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:18:28.267026    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7c46aa_7b64_4759_85b4_3dba4aa03f6a.slice/crio-7553ff52b297b115f1b0797a095769de2f7d77a0a7d88f9284c8c3f4a4a31ef7 WatchSource:0}: Error finding container 7553ff52b297b115f1b0797a095769de2f7d77a0a7d88f9284c8c3f4a4a31ef7: Status 404 returned error can't find the container with id 7553ff52b297b115f1b0797a095769de2f7d77a0a7d88f9284c8c3f4a4a31ef7
Aug 04 11:18:28.450038 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:28.450012    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d" event={"ID":"ca7c46aa-7b64-4759-85b4-3dba4aa03f6a","Type":"ContainerStarted","Data":"5420178098ae1d7f1338ea68eb9893fcc92f664bc7b9ae2a0c2d7790295cf1a1"}
Aug 04 11:18:28.450147 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:28.450072    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d" event={"ID":"ca7c46aa-7b64-4759-85b4-3dba4aa03f6a","Type":"ContainerStarted","Data":"7553ff52b297b115f1b0797a095769de2f7d77a0a7d88f9284c8c3f4a4a31ef7"}
Aug 04 11:18:28.469655 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:28.466187    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d" podStartSLOduration=1.466167465 podStartE2EDuration="1.466167465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:18:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:18:28.465013752 +0000 UTC m=+2499.191084086" watchObservedRunningTime="2026-08-04 11:18:28.466167465 +0000 UTC m=+2499.192237800"
Aug 04 11:18:29.455386 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:29.455355    2559 generic.go:356] "Generic (PLEG): container finished" podID="ca7c46aa-7b64-4759-85b4-3dba4aa03f6a" containerID="5420178098ae1d7f1338ea68eb9893fcc92f664bc7b9ae2a0c2d7790295cf1a1" exitCode=0
Aug 04 11:18:29.455765 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:29.455396    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d" event={"ID":"ca7c46aa-7b64-4759-85b4-3dba4aa03f6a","Type":"ContainerDied","Data":"5420178098ae1d7f1338ea68eb9893fcc92f664bc7b9ae2a0c2d7790295cf1a1"}
Aug 04 11:18:30.587106 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:30.587082    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d"
Aug 04 11:18:30.644403 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:30.644375    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca7c46aa-7b64-4759-85b4-3dba4aa03f6a-maas-api-service-ca\") pod \"ca7c46aa-7b64-4759-85b4-3dba4aa03f6a\" (UID: \"ca7c46aa-7b64-4759-85b4-3dba4aa03f6a\") "
Aug 04 11:18:30.644715 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:30.644695    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca7c46aa-7b64-4759-85b4-3dba4aa03f6a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ca7c46aa-7b64-4759-85b4-3dba4aa03f6a" (UID: "ca7c46aa-7b64-4759-85b4-3dba4aa03f6a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:18:30.745032 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:30.744970    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca7c46aa-7b64-4759-85b4-3dba4aa03f6a-maas-api-service-ca\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:18:31.464698 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:31.464665    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d" event={"ID":"ca7c46aa-7b64-4759-85b4-3dba4aa03f6a","Type":"ContainerDied","Data":"7553ff52b297b115f1b0797a095769de2f7d77a0a7d88f9284c8c3f4a4a31ef7"}
Aug 04 11:18:31.464698 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:31.464690    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d"
Aug 04 11:18:31.464895 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:31.464716    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7553ff52b297b115f1b0797a095769de2f7d77a0a7d88f9284c8c3f4a4a31ef7"
Aug 04 11:18:43.586911 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:43.586838    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d"]
Aug 04 11:18:43.592859 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:43.592835    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c88ef17b-ct65d"]
Aug 04 11:18:43.780881 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:43.780846    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca7c46aa-7b64-4759-85b4-3dba4aa03f6a" path="/var/lib/kubelet/pods/ca7c46aa-7b64-4759-85b4-3dba4aa03f6a/volumes"
Aug 04 11:18:50.007272 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:50.007241    2559 scope.go:117] "RemoveContainer" containerID="e16b0ee5c2861c7c4336606bb942ce1811badda8258206c2a8376b8335447d70"
Aug 04 11:18:51.628195 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:18:51.628159    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"]
Aug 04 11:19:06.646839 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:06.646781    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6" podUID="e131b9e8-7473-416a-81a6-e718a18daf07" containerName="main" containerID="cri-o://2a51103a148649fc6f2d7504b034d0947f7dfa5cf5455bf0de1d0f90cc27ca48" gracePeriod=45
Aug 04 11:19:06.881142 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:06.881120    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:19:07.033971 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.033894    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-dshm\") pod \"e131b9e8-7473-416a-81a6-e718a18daf07\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") "
Aug 04 11:19:07.033971 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.033947    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e131b9e8-7473-416a-81a6-e718a18daf07-tls-certs\") pod \"e131b9e8-7473-416a-81a6-e718a18daf07\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") "
Aug 04 11:19:07.034154 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.033980    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-tmp-dir\") pod \"e131b9e8-7473-416a-81a6-e718a18daf07\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") "
Aug 04 11:19:07.034154 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.033998    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-model-cache\") pod \"e131b9e8-7473-416a-81a6-e718a18daf07\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") "
Aug 04 11:19:07.034154 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.034039    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-home\") pod \"e131b9e8-7473-416a-81a6-e718a18daf07\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") "
Aug 04 11:19:07.034154 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.034064    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8h24g\" (UniqueName: \"kubernetes.io/projected/e131b9e8-7473-416a-81a6-e718a18daf07-kube-api-access-8h24g\") pod \"e131b9e8-7473-416a-81a6-e718a18daf07\" (UID: \"e131b9e8-7473-416a-81a6-e718a18daf07\") "
Aug 04 11:19:07.034360 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.034236    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e131b9e8-7473-416a-81a6-e718a18daf07" (UID: "e131b9e8-7473-416a-81a6-e718a18daf07"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:19:07.034360 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.034257    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-model-cache" (OuterVolumeSpecName: "model-cache") pod "e131b9e8-7473-416a-81a6-e718a18daf07" (UID: "e131b9e8-7473-416a-81a6-e718a18daf07"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:19:07.034360 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.034279    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-home" (OuterVolumeSpecName: "home") pod "e131b9e8-7473-416a-81a6-e718a18daf07" (UID: "e131b9e8-7473-416a-81a6-e718a18daf07"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:19:07.034360 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.034338    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-tmp-dir\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:19:07.034517 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.034362    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-model-cache\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:19:07.034517 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.034376    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-home\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:19:07.036193 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.036170    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e131b9e8-7473-416a-81a6-e718a18daf07-kube-api-access-8h24g" (OuterVolumeSpecName: "kube-api-access-8h24g") pod "e131b9e8-7473-416a-81a6-e718a18daf07" (UID: "e131b9e8-7473-416a-81a6-e718a18daf07"). InnerVolumeSpecName "kube-api-access-8h24g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:19:07.036193 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.036187    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-dshm" (OuterVolumeSpecName: "dshm") pod "e131b9e8-7473-416a-81a6-e718a18daf07" (UID: "e131b9e8-7473-416a-81a6-e718a18daf07"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:19:07.036310 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.036242    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e131b9e8-7473-416a-81a6-e718a18daf07-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e131b9e8-7473-416a-81a6-e718a18daf07" (UID: "e131b9e8-7473-416a-81a6-e718a18daf07"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:19:07.134934 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.134897    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8h24g\" (UniqueName: \"kubernetes.io/projected/e131b9e8-7473-416a-81a6-e718a18daf07-kube-api-access-8h24g\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:19:07.134934 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.134929    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e131b9e8-7473-416a-81a6-e718a18daf07-dshm\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:19:07.134934 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.134939    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e131b9e8-7473-416a-81a6-e718a18daf07-tls-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:19:07.626458 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.626422    2559 generic.go:356] "Generic (PLEG): container finished" podID="e131b9e8-7473-416a-81a6-e718a18daf07" containerID="2a51103a148649fc6f2d7504b034d0947f7dfa5cf5455bf0de1d0f90cc27ca48" exitCode=0
Aug 04 11:19:07.626617 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.626483    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"
Aug 04 11:19:07.626617 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.626507    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6" event={"ID":"e131b9e8-7473-416a-81a6-e718a18daf07","Type":"ContainerDied","Data":"2a51103a148649fc6f2d7504b034d0947f7dfa5cf5455bf0de1d0f90cc27ca48"}
Aug 04 11:19:07.626617 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.626556    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6" event={"ID":"e131b9e8-7473-416a-81a6-e718a18daf07","Type":"ContainerDied","Data":"fc653fa1a48e872abbb77882c6080acce754f4b1ea02228dd903d8c0fa218d08"}
Aug 04 11:19:07.626617 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.626574    2559 scope.go:117] "RemoveContainer" containerID="2a51103a148649fc6f2d7504b034d0947f7dfa5cf5455bf0de1d0f90cc27ca48"
Aug 04 11:19:07.635155 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.635139    2559 scope.go:117] "RemoveContainer" containerID="2a51103a148649fc6f2d7504b034d0947f7dfa5cf5455bf0de1d0f90cc27ca48"
Aug 04 11:19:07.635412 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:19:07.635393    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a51103a148649fc6f2d7504b034d0947f7dfa5cf5455bf0de1d0f90cc27ca48\": container with ID starting with 2a51103a148649fc6f2d7504b034d0947f7dfa5cf5455bf0de1d0f90cc27ca48 not found: ID does not exist" containerID="2a51103a148649fc6f2d7504b034d0947f7dfa5cf5455bf0de1d0f90cc27ca48"
Aug 04 11:19:07.635478 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.635424    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a51103a148649fc6f2d7504b034d0947f7dfa5cf5455bf0de1d0f90cc27ca48"} err="failed to get container status \"2a51103a148649fc6f2d7504b034d0947f7dfa5cf5455bf0de1d0f90cc27ca48\": rpc error: code = NotFound desc = could not find container \"2a51103a148649fc6f2d7504b034d0947f7dfa5cf5455bf0de1d0f90cc27ca48\": container with ID starting with 2a51103a148649fc6f2d7504b034d0947f7dfa5cf5455bf0de1d0f90cc27ca48 not found: ID does not exist"
Aug 04 11:19:07.648539 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.648516    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"]
Aug 04 11:19:07.651891 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.651873    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-c88ef17b/e2e-lifecycle-model-c88ef17b-kserve-76c7cb78c5-xn5w6"]
Aug 04 11:19:07.780320 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:07.780295    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e131b9e8-7473-416a-81a6-e718a18daf07" path="/var/lib/kubelet/pods/e131b9e8-7473-416a-81a6-e718a18daf07/volumes"
Aug 04 11:19:34.261667 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:34.261609    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"]
Aug 04 11:19:34.262210 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:34.261899    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l" podUID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerName="istio-proxy" containerID="cri-o://8601a6ad68f880d63b62187f452d8515c48dc4e7c3c2bb40bc0c7c49d654843e" gracePeriod=30
Aug 04 11:19:34.840984 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:34.840946    2559 patch_prober.go:28] interesting pod/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 11:19:34.841171 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:34.841020    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l" podUID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 11:19:39.503429 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.503404    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:19:39.597488 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.597462    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-podinfo\") pod \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") "
Aug 04 11:19:39.597605 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.597497    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istiod-ca-cert\") pod \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") "
Aug 04 11:19:39.597605 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.597523    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-credential-socket\") pod \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") "
Aug 04 11:19:39.597732 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.597607    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-workload-certs\") pod \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") "
Aug 04 11:19:39.597732 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.597665    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwt6t\" (UniqueName: \"kubernetes.io/projected/3eb762e7-9fad-4601-b7e8-cd511febb8ba-kube-api-access-zwt6t\") pod \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") "
Aug 04 11:19:39.597732 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.597703    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-workload-socket\") pod \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") "
Aug 04 11:19:39.597732 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.597724    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-envoy\") pod \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") "
Aug 04 11:19:39.597922 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.597752    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-token\") pod \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") "
Aug 04 11:19:39.597922 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.597791    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-data\") pod \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\" (UID: \"3eb762e7-9fad-4601-b7e8-cd511febb8ba\") "
Aug 04 11:19:39.598022 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.597924    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3eb762e7-9fad-4601-b7e8-cd511febb8ba" (UID: "3eb762e7-9fad-4601-b7e8-cd511febb8ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:19:39.598022 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.598001    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3eb762e7-9fad-4601-b7e8-cd511febb8ba" (UID: "3eb762e7-9fad-4601-b7e8-cd511febb8ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:19:39.598022 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.597997    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3eb762e7-9fad-4601-b7e8-cd511febb8ba" (UID: "3eb762e7-9fad-4601-b7e8-cd511febb8ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:19:39.598183 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.598132    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:19:39.598183 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.598153    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:19:39.598183 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.598166    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:19:39.598183 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.598135    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "3eb762e7-9fad-4601-b7e8-cd511febb8ba" (UID: "3eb762e7-9fad-4601-b7e8-cd511febb8ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:19:39.598437 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.598270    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3eb762e7-9fad-4601-b7e8-cd511febb8ba" (UID: "3eb762e7-9fad-4601-b7e8-cd511febb8ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:19:39.599943 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.599913    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3eb762e7-9fad-4601-b7e8-cd511febb8ba" (UID: "3eb762e7-9fad-4601-b7e8-cd511febb8ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:19:39.599943 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.599926    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3eb762e7-9fad-4601-b7e8-cd511febb8ba" (UID: "3eb762e7-9fad-4601-b7e8-cd511febb8ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 11:19:39.600220 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.599963    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "3eb762e7-9fad-4601-b7e8-cd511febb8ba" (UID: "3eb762e7-9fad-4601-b7e8-cd511febb8ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:19:39.600220 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.599960    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eb762e7-9fad-4601-b7e8-cd511febb8ba-kube-api-access-zwt6t" (OuterVolumeSpecName: "kube-api-access-zwt6t") pod "3eb762e7-9fad-4601-b7e8-cd511febb8ba" (UID: "3eb762e7-9fad-4601-b7e8-cd511febb8ba"). InnerVolumeSpecName "kube-api-access-zwt6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:19:39.698741 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.698714    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:19:39.698741 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.698737    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwt6t\" (UniqueName: \"kubernetes.io/projected/3eb762e7-9fad-4601-b7e8-cd511febb8ba-kube-api-access-zwt6t\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:19:39.698888 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.698749    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:19:39.698888 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.698761    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:19:39.698888 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.698773    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:19:39.698888 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.698784    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb762e7-9fad-4601-b7e8-cd511febb8ba-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:19:39.771965 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.771936    2559 generic.go:356] "Generic (PLEG): container finished" podID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerID="8601a6ad68f880d63b62187f452d8515c48dc4e7c3c2bb40bc0c7c49d654843e" exitCode=0
Aug 04 11:19:39.772066 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.771994    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"
Aug 04 11:19:39.772066 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.772016    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l" event={"ID":"3eb762e7-9fad-4601-b7e8-cd511febb8ba","Type":"ContainerDied","Data":"8601a6ad68f880d63b62187f452d8515c48dc4e7c3c2bb40bc0c7c49d654843e"}
Aug 04 11:19:39.772151 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.772077    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l" event={"ID":"3eb762e7-9fad-4601-b7e8-cd511febb8ba","Type":"ContainerDied","Data":"4a3b17e0b1d66257418ecbc41f614933e3e15830fdef57578eb790ac5d2604fc"}
Aug 04 11:19:39.772151 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.772109    2559 scope.go:117] "RemoveContainer" containerID="8601a6ad68f880d63b62187f452d8515c48dc4e7c3c2bb40bc0c7c49d654843e"
Aug 04 11:19:39.782058 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.782039    2559 scope.go:117] "RemoveContainer" containerID="a13b5cde7e68c7a3d444e4665640a6f24c0fb272dc66bf5e0c7198a90ea2de24"
Aug 04 11:19:39.790328 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.790312    2559 scope.go:117] "RemoveContainer" containerID="8601a6ad68f880d63b62187f452d8515c48dc4e7c3c2bb40bc0c7c49d654843e"
Aug 04 11:19:39.790573 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:19:39.790556    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8601a6ad68f880d63b62187f452d8515c48dc4e7c3c2bb40bc0c7c49d654843e\": container with ID starting with 8601a6ad68f880d63b62187f452d8515c48dc4e7c3c2bb40bc0c7c49d654843e not found: ID does not exist" containerID="8601a6ad68f880d63b62187f452d8515c48dc4e7c3c2bb40bc0c7c49d654843e"
Aug 04 11:19:39.790619 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.790581    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8601a6ad68f880d63b62187f452d8515c48dc4e7c3c2bb40bc0c7c49d654843e"} err="failed to get container status \"8601a6ad68f880d63b62187f452d8515c48dc4e7c3c2bb40bc0c7c49d654843e\": rpc error: code = NotFound desc = could not find container \"8601a6ad68f880d63b62187f452d8515c48dc4e7c3c2bb40bc0c7c49d654843e\": container with ID starting with 8601a6ad68f880d63b62187f452d8515c48dc4e7c3c2bb40bc0c7c49d654843e not found: ID does not exist"
Aug 04 11:19:39.790619 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.790596    2559 scope.go:117] "RemoveContainer" containerID="a13b5cde7e68c7a3d444e4665640a6f24c0fb272dc66bf5e0c7198a90ea2de24"
Aug 04 11:19:39.790869 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:19:39.790848    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a13b5cde7e68c7a3d444e4665640a6f24c0fb272dc66bf5e0c7198a90ea2de24\": container with ID starting with a13b5cde7e68c7a3d444e4665640a6f24c0fb272dc66bf5e0c7198a90ea2de24 not found: ID does not exist" containerID="a13b5cde7e68c7a3d444e4665640a6f24c0fb272dc66bf5e0c7198a90ea2de24"
Aug 04 11:19:39.790907 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.790877    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a13b5cde7e68c7a3d444e4665640a6f24c0fb272dc66bf5e0c7198a90ea2de24"} err="failed to get container status \"a13b5cde7e68c7a3d444e4665640a6f24c0fb272dc66bf5e0c7198a90ea2de24\": rpc error: code = NotFound desc = could not find container \"a13b5cde7e68c7a3d444e4665640a6f24c0fb272dc66bf5e0c7198a90ea2de24\": container with ID starting with a13b5cde7e68c7a3d444e4665640a6f24c0fb272dc66bf5e0c7198a90ea2de24 not found: ID does not exist"
Aug 04 11:19:39.795620 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.795599    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"]
Aug 04 11:19:39.798810 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:39.798791    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c88ef17b-openshift-default-77b58886dd-4286l"]
Aug 04 11:19:41.781726 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:19:41.781693    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" path="/var/lib/kubelet/pods/3eb762e7-9fad-4601-b7e8-cd511febb8ba/volumes"
Aug 04 11:20:42.657130 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.657093    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"]
Aug 04 11:20:42.657706 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.657557    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerName="istio-proxy"
Aug 04 11:20:42.657706 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.657576    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerName="istio-proxy"
Aug 04 11:20:42.657706 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.657587    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca7c46aa-7b64-4759-85b4-3dba4aa03f6a" containerName="revoke-keys"
Aug 04 11:20:42.657706 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.657595    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca7c46aa-7b64-4759-85b4-3dba4aa03f6a" containerName="revoke-keys"
Aug 04 11:20:42.657706 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.657610    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerName="istio-proxy"
Aug 04 11:20:42.657706 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.657619    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerName="istio-proxy"
Aug 04 11:20:42.657706 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.657671    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e131b9e8-7473-416a-81a6-e718a18daf07" containerName="main"
Aug 04 11:20:42.657706 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.657679    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e131b9e8-7473-416a-81a6-e718a18daf07" containerName="main"
Aug 04 11:20:42.658123 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.657751    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca7c46aa-7b64-4759-85b4-3dba4aa03f6a" containerName="revoke-keys"
Aug 04 11:20:42.658123 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.657765    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e131b9e8-7473-416a-81a6-e718a18daf07" containerName="main"
Aug 04 11:20:42.658123 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.657775    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerName="istio-proxy"
Aug 04 11:20:42.658123 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.657783    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb762e7-9fad-4601-b7e8-cd511febb8ba" containerName="istio-proxy"
Aug 04 11:20:42.660861 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.660840    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.671857 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.671837    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-dc2eb2-openshift-default-dockercfg-86cxk\""
Aug 04 11:20:42.676078 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.676055    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"]
Aug 04 11:20:42.686821 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.686797    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-workload-socket\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.686910 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.686831    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-data\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.686910 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.686848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-envoy\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.686986 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.686954    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-token\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.687026 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.686988    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1228cd3-41ff-42d0-82e8-dea2770fa460-istiod-ca-cert\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.687067 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.687054    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-workload-certs\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.687107 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.687095    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-credential-socket\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.687154 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.687122    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-podinfo\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.687154 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.687142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krdnn\" (UniqueName: \"kubernetes.io/projected/b1228cd3-41ff-42d0-82e8-dea2770fa460-kube-api-access-krdnn\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.787780 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.787748    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-credential-socket\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.787964 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.787794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-podinfo\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.787964 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.787859    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krdnn\" (UniqueName: \"kubernetes.io/projected/b1228cd3-41ff-42d0-82e8-dea2770fa460-kube-api-access-krdnn\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.787964 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.787905    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-workload-socket\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.787964 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.787920    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-data\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.787964 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.787943    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-envoy\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.788240 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.788050    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-token\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.788240 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.788076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1228cd3-41ff-42d0-82e8-dea2770fa460-istiod-ca-cert\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.788240 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.788115    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-workload-certs\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.788240 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.788170    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-credential-socket\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.788240 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.788233    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-workload-socket\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.788479 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.788271    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-data\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.788479 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.788442    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-workload-certs\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.788825 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.788808    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1228cd3-41ff-42d0-82e8-dea2770fa460-istiod-ca-cert\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.790310 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.790289    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-envoy\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.790420 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.790357    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-podinfo\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.799799 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.799779    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-token\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.801876 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.801846    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krdnn\" (UniqueName: \"kubernetes.io/projected/b1228cd3-41ff-42d0-82e8-dea2770fa460-kube-api-access-krdnn\") pod \"e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") " pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:42.970411 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:42.970342    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:43.124162 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:43.124133    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"]
Aug 04 11:20:43.125788 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:20:43.125762    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1228cd3_41ff_42d0_82e8_dea2770fa460.slice/crio-0d41bc6a0a4aaa16d5aba7c649a4afb2a07c3563870d81f04011bcdda34772d7 WatchSource:0}: Error finding container 0d41bc6a0a4aaa16d5aba7c649a4afb2a07c3563870d81f04011bcdda34772d7: Status 404 returned error can't find the container with id 0d41bc6a0a4aaa16d5aba7c649a4afb2a07c3563870d81f04011bcdda34772d7
Aug 04 11:20:43.127905 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:43.127873    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:20:43.127968 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:43.127941    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:20:43.128007 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:43.127975    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:20:44.063561 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:44.063519    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl" event={"ID":"b1228cd3-41ff-42d0-82e8-dea2770fa460","Type":"ContainerStarted","Data":"2c5cfde55ea77c442b9a13c80b90e5240499a1149380775358727d0a40bffa6d"}
Aug 04 11:20:44.063956 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:44.063580    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl" event={"ID":"b1228cd3-41ff-42d0-82e8-dea2770fa460","Type":"ContainerStarted","Data":"0d41bc6a0a4aaa16d5aba7c649a4afb2a07c3563870d81f04011bcdda34772d7"}
Aug 04 11:20:44.088182 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:44.088135    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl" podStartSLOduration=2.088121819 podStartE2EDuration="2.088121819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:20:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:20:44.087916065 +0000 UTC m=+2634.813986399" watchObservedRunningTime="2026-08-04 11:20:44.088121819 +0000 UTC m=+2634.814192152"
Aug 04 11:20:44.970804 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:44.970773    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:44.975261 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:44.975241    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:45.068773 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:45.068743    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:45.069530 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:45.069512    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:20:50.041015 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:50.040984    2559 scope.go:117] "RemoveContainer" containerID="b6c10408842ef672f117af2215b89a6a2f453f95a81a9bfa62fc6e86c8248e1b"
Aug 04 11:20:59.136679 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:59.136627    2559 generic.go:356] "Generic (PLEG): container finished" podID="b1228cd3-41ff-42d0-82e8-dea2770fa460" containerID="2c5cfde55ea77c442b9a13c80b90e5240499a1149380775358727d0a40bffa6d" exitCode=0
Aug 04 11:20:59.137153 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:59.136702    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl" event={"ID":"b1228cd3-41ff-42d0-82e8-dea2770fa460","Type":"ContainerDied","Data":"2c5cfde55ea77c442b9a13c80b90e5240499a1149380775358727d0a40bffa6d"}
Aug 04 11:20:59.137153 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:59.137043    2559 scope.go:117] "RemoveContainer" containerID="2c5cfde55ea77c442b9a13c80b90e5240499a1149380775358727d0a40bffa6d"
Aug 04 11:20:59.138010 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:59.137984    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:20:59.138113 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:59.138075    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:20:59.138113 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:20:59.138109    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:21:00.069386 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:00.069352    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:21:00.143746 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:00.143703    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl" event={"ID":"b1228cd3-41ff-42d0-82e8-dea2770fa460","Type":"ContainerStarted","Data":"2f78743c425ddf239989e7cd1214822d78b99340ba45d4d7fdaf8077b6264adc"}
Aug 04 11:21:00.971482 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:00.971453    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:21:00.972412 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:00.972384    2559 patch_prober.go:28] interesting pod/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Aug 04 11:21:00.972551 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:00.972432    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl" podUID="b1228cd3-41ff-42d0-82e8-dea2770fa460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Aug 04 11:21:01.971273 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:01.971238    2559 patch_prober.go:28] interesting pod/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Aug 04 11:21:01.971663 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:01.971294    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl" podUID="b1228cd3-41ff-42d0-82e8-dea2770fa460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Aug 04 11:21:02.971219 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:02.971186    2559 patch_prober.go:28] interesting pod/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Aug 04 11:21:02.971365 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:02.971248    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl" podUID="b1228cd3-41ff-42d0-82e8-dea2770fa460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Aug 04 11:21:03.971024 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:03.970989    2559 patch_prober.go:28] interesting pod/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Aug 04 11:21:03.971198 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:03.971054    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl" podUID="b1228cd3-41ff-42d0-82e8-dea2770fa460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Aug 04 11:21:04.971540 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:04.971505    2559 patch_prober.go:28] interesting pod/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Aug 04 11:21:04.971925 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:04.971556    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl" podUID="b1228cd3-41ff-42d0-82e8-dea2770fa460" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Aug 04 11:21:05.974843 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:05.974814    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:21:05.975332 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:05.975085    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:21:05.975715 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:05.975700    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:21:11.705842 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.705811    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"]
Aug 04 11:21:11.709360 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.709336    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.711851 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.711829    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-1dd437-openshift-default-dockercfg-526js\""
Aug 04 11:21:11.725492 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.725472    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"]
Aug 04 11:21:11.839171 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.839137    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-data\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.839354 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.839184    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z59gk\" (UniqueName: \"kubernetes.io/projected/23915d38-6b48-48b7-b7c9-05ccf7cd2468-kube-api-access-z59gk\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.839354 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.839211    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istiod-ca-cert\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.839354 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.839236    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-token\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.839354 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.839260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-envoy\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.839354 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.839281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-workload-socket\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.839354 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.839298    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-credential-socket\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.839354 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.839315    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-podinfo\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.839354 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.839344    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-workload-certs\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.940194 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.940152    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-data\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.940360 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.940211    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z59gk\" (UniqueName: \"kubernetes.io/projected/23915d38-6b48-48b7-b7c9-05ccf7cd2468-kube-api-access-z59gk\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.940360 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.940253    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istiod-ca-cert\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.940360 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.940278    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-token\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.940360 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.940336    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-envoy\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.940578 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.940372    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-workload-socket\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.940578 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.940404    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-credential-socket\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.940578 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.940431    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-podinfo\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.940578 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.940462    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-workload-certs\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.940818 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.940585    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-data\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.940818 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.940807    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-workload-certs\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.940925 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.940806    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-credential-socket\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.941040 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.941019    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istiod-ca-cert\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.941089 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.941036    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-workload-socket\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.942784 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.942763    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-envoy\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.943048 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.943025    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-podinfo\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.948471 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.948449    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-token\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:11.948710 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:11.948691    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z59gk\" (UniqueName: \"kubernetes.io/projected/23915d38-6b48-48b7-b7c9-05ccf7cd2468-kube-api-access-z59gk\") pod \"e2e-inf-b-1dd437-openshift-default-566d748746-45td7\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") " pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:12.019527 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:12.019459    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:12.159548 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:12.159524    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"]
Aug 04 11:21:12.161267 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:21:12.161243    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23915d38_6b48_48b7_b7c9_05ccf7cd2468.slice/crio-0e3b64e77b45bdd86096f31b343bfefde9d933e2de9e9ec24c283df829cd1be5 WatchSource:0}: Error finding container 0e3b64e77b45bdd86096f31b343bfefde9d933e2de9e9ec24c283df829cd1be5: Status 404 returned error can't find the container with id 0e3b64e77b45bdd86096f31b343bfefde9d933e2de9e9ec24c283df829cd1be5
Aug 04 11:21:12.163556 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:12.163528    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:21:12.163630 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:12.163591    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:21:12.163630 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:12.163620    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:21:12.194825 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:12.194804    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7" event={"ID":"23915d38-6b48-48b7-b7c9-05ccf7cd2468","Type":"ContainerStarted","Data":"0e3b64e77b45bdd86096f31b343bfefde9d933e2de9e9ec24c283df829cd1be5"}
Aug 04 11:21:13.201051 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:13.201011    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7" event={"ID":"23915d38-6b48-48b7-b7c9-05ccf7cd2468","Type":"ContainerStarted","Data":"d2aa1f83e588f87ce1d2496bf6bf9c45a84bbfb22fd2f6c51b9427e3f11a09e9"}
Aug 04 11:21:13.223843 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:13.223798    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7" podStartSLOduration=2.223784284 podStartE2EDuration="2.223784284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:21:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:21:13.221930871 +0000 UTC m=+2663.948001216" watchObservedRunningTime="2026-08-04 11:21:13.223784284 +0000 UTC m=+2663.949854617"
Aug 04 11:21:14.019755 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:14.019663    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:14.024355 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:14.024331    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:14.205774 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:14.205742    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:14.206620 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:14.206599    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:29.207739 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:29.207625    2559 patch_prober.go:28] interesting pod/e2e-inf-b-1dd437-openshift-default-566d748746-45td7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Aug 04 11:21:29.207739 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:29.207708    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7" podUID="23915d38-6b48-48b7-b7c9-05ccf7cd2468" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Aug 04 11:21:29.277373 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:29.277347    2559 generic.go:356] "Generic (PLEG): container finished" podID="23915d38-6b48-48b7-b7c9-05ccf7cd2468" containerID="d2aa1f83e588f87ce1d2496bf6bf9c45a84bbfb22fd2f6c51b9427e3f11a09e9" exitCode=0
Aug 04 11:21:29.277521 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:29.277387    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7" event={"ID":"23915d38-6b48-48b7-b7c9-05ccf7cd2468","Type":"ContainerDied","Data":"d2aa1f83e588f87ce1d2496bf6bf9c45a84bbfb22fd2f6c51b9427e3f11a09e9"}
Aug 04 11:21:29.277796 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:29.277783    2559 scope.go:117] "RemoveContainer" containerID="d2aa1f83e588f87ce1d2496bf6bf9c45a84bbfb22fd2f6c51b9427e3f11a09e9"
Aug 04 11:21:29.278913 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:29.278886    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:21:29.279000 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:29.278958    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:21:29.279000 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:29.278991    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:21:30.283276 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:30.283243    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7" event={"ID":"23915d38-6b48-48b7-b7c9-05ccf7cd2468","Type":"ContainerStarted","Data":"361385755b80a3c204632f99becc41053884c5216feed96ec95c0cbe9ec18ca4"}
Aug 04 11:21:31.019864 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:31.019832    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:31.020211 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:31.020189    2559 patch_prober.go:28] interesting pod/e2e-inf-b-1dd437-openshift-default-566d748746-45td7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Aug 04 11:21:31.020364 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:31.020337    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7" podUID="23915d38-6b48-48b7-b7c9-05ccf7cd2468" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Aug 04 11:21:32.020792 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:32.020755    2559 patch_prober.go:28] interesting pod/e2e-inf-b-1dd437-openshift-default-566d748746-45td7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Aug 04 11:21:32.021352 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:32.021318    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7" podUID="23915d38-6b48-48b7-b7c9-05ccf7cd2468" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Aug 04 11:21:33.020475 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:33.020435    2559 patch_prober.go:28] interesting pod/e2e-inf-b-1dd437-openshift-default-566d748746-45td7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Aug 04 11:21:33.020702 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:33.020499    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7" podUID="23915d38-6b48-48b7-b7c9-05ccf7cd2468" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Aug 04 11:21:34.020053 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:34.020005    2559 patch_prober.go:28] interesting pod/e2e-inf-b-1dd437-openshift-default-566d748746-45td7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Aug 04 11:21:34.020543 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:34.020073    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7" podUID="23915d38-6b48-48b7-b7c9-05ccf7cd2468" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Aug 04 11:21:35.035955 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:35.035926    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:35.036397 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:35.036218    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:35.037010 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:35.036994    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:21:48.270372 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.270291    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"]
Aug 04 11:21:48.274026 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.274003    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.277362 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.277337    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-dc2eb2\"/\"test-model-dc2eb2-kserve-self-signed-certs\""
Aug 04 11:21:48.277491 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.277324    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-dc2eb2\"/\"openshift-service-ca.crt\""
Aug 04 11:21:48.277491 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.277470    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-dc2eb2\"/\"kube-root-ca.crt\""
Aug 04 11:21:48.277615 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.277471    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-dc2eb2\"/\"default-dockercfg-rwh8v\""
Aug 04 11:21:48.282332 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.282310    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"]
Aug 04 11:21:48.350395 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.350361    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-dshm\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.350520 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.350397    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-425d2\" (UniqueName: \"kubernetes.io/projected/3cf25345-b730-469f-9450-36139b015259-kube-api-access-425d2\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.350520 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.350463    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-home\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.350520 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.350490    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cf25345-b730-469f-9450-36139b015259-tls-certs\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.350728 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.350539    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-model-cache\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.350728 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.350556    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-tmp-dir\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.452049 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.452018    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-dshm\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.452049 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.452051    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-425d2\" (UniqueName: \"kubernetes.io/projected/3cf25345-b730-469f-9450-36139b015259-kube-api-access-425d2\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.452296 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.452089    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-home\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.452296 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.452108    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cf25345-b730-469f-9450-36139b015259-tls-certs\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.452296 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.452141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-model-cache\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.452296 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.452161    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-tmp-dir\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.452514 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.452493    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-model-cache\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.452572 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.452547    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-home\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.452615 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.452570    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-tmp-dir\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.454443 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.454421    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-dshm\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.454764 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.454747    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cf25345-b730-469f-9450-36139b015259-tls-certs\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.459805 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.459787    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-425d2\" (UniqueName: \"kubernetes.io/projected/3cf25345-b730-469f-9450-36139b015259-kube-api-access-425d2\") pod \"test-model-dc2eb2-kserve-6f66965b5-bpp26\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") " pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.583611 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.583508    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:48.717970 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:48.717947    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"]
Aug 04 11:21:48.719603 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:21:48.719576    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cf25345_b730_469f_9450_36139b015259.slice/crio-6331a176dd45546623d593df2ed6beee2b2b7ea6f47d0b7231c5b42376fa04bc WatchSource:0}: Error finding container 6331a176dd45546623d593df2ed6beee2b2b7ea6f47d0b7231c5b42376fa04bc: Status 404 returned error can't find the container with id 6331a176dd45546623d593df2ed6beee2b2b7ea6f47d0b7231c5b42376fa04bc
Aug 04 11:21:49.378875 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:49.378843    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26" event={"ID":"3cf25345-b730-469f-9450-36139b015259","Type":"ContainerStarted","Data":"7547e74d1bfe2d03e6c2957357106ee0b3ec8024cf5310b9ede304da390f3dab"}
Aug 04 11:21:49.378875 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:49.378881    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26" event={"ID":"3cf25345-b730-469f-9450-36139b015259","Type":"ContainerStarted","Data":"6331a176dd45546623d593df2ed6beee2b2b7ea6f47d0b7231c5b42376fa04bc"}
Aug 04 11:21:49.398175 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:49.398130    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26" podStartSLOduration=1.398116173 podStartE2EDuration="1.398116173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:21:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:21:49.396102406 +0000 UTC m=+2700.122172763" watchObservedRunningTime="2026-08-04 11:21:49.398116173 +0000 UTC m=+2700.124186506"
Aug 04 11:21:58.584204 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:58.584165    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:58.584691 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:58.584244    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:58.596512 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:58.596492    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:21:59.438170 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:21:59.438142    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:22:59.653038 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:22:59.653007    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"]
Aug 04 11:23:14.672069 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:14.672031    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26" podUID="3cf25345-b730-469f-9450-36139b015259" containerName="main" containerID="cri-o://7547e74d1bfe2d03e6c2957357106ee0b3ec8024cf5310b9ede304da390f3dab" gracePeriod=45
Aug 04 11:23:14.915871 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:14.915843    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:23:15.072493 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.072412    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-425d2\" (UniqueName: \"kubernetes.io/projected/3cf25345-b730-469f-9450-36139b015259-kube-api-access-425d2\") pod \"3cf25345-b730-469f-9450-36139b015259\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") "
Aug 04 11:23:15.072493 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.072466    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-dshm\") pod \"3cf25345-b730-469f-9450-36139b015259\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") "
Aug 04 11:23:15.072748 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.072503    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-model-cache\") pod \"3cf25345-b730-469f-9450-36139b015259\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") "
Aug 04 11:23:15.072748 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.072550    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-tmp-dir\") pod \"3cf25345-b730-469f-9450-36139b015259\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") "
Aug 04 11:23:15.072748 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.072596    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-home\") pod \"3cf25345-b730-469f-9450-36139b015259\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") "
Aug 04 11:23:15.072748 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.072671    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cf25345-b730-469f-9450-36139b015259-tls-certs\") pod \"3cf25345-b730-469f-9450-36139b015259\" (UID: \"3cf25345-b730-469f-9450-36139b015259\") "
Aug 04 11:23:15.072954 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.072780    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-model-cache" (OuterVolumeSpecName: "model-cache") pod "3cf25345-b730-469f-9450-36139b015259" (UID: "3cf25345-b730-469f-9450-36139b015259"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:23:15.072998 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.072961    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-home" (OuterVolumeSpecName: "home") pod "3cf25345-b730-469f-9450-36139b015259" (UID: "3cf25345-b730-469f-9450-36139b015259"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:23:15.073043 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.072996    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-model-cache\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:15.073043 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.072994    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3cf25345-b730-469f-9450-36139b015259" (UID: "3cf25345-b730-469f-9450-36139b015259"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:23:15.074870 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.074849    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-dshm" (OuterVolumeSpecName: "dshm") pod "3cf25345-b730-469f-9450-36139b015259" (UID: "3cf25345-b730-469f-9450-36139b015259"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:23:15.074942 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.074912    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf25345-b730-469f-9450-36139b015259-kube-api-access-425d2" (OuterVolumeSpecName: "kube-api-access-425d2") pod "3cf25345-b730-469f-9450-36139b015259" (UID: "3cf25345-b730-469f-9450-36139b015259"). InnerVolumeSpecName "kube-api-access-425d2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:23:15.074942 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.074930    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cf25345-b730-469f-9450-36139b015259-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3cf25345-b730-469f-9450-36139b015259" (UID: "3cf25345-b730-469f-9450-36139b015259"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:23:15.174155 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.174125    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-home\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:15.174155 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.174150    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cf25345-b730-469f-9450-36139b015259-tls-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:15.174318 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.174161    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-425d2\" (UniqueName: \"kubernetes.io/projected/3cf25345-b730-469f-9450-36139b015259-kube-api-access-425d2\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:15.174318 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.174170    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-dshm\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:15.174318 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.174177    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cf25345-b730-469f-9450-36139b015259-tmp-dir\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:15.777957 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.777926    2559 generic.go:356] "Generic (PLEG): container finished" podID="3cf25345-b730-469f-9450-36139b015259" containerID="7547e74d1bfe2d03e6c2957357106ee0b3ec8024cf5310b9ede304da390f3dab" exitCode=0
Aug 04 11:23:15.778351 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.778030    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"
Aug 04 11:23:15.782955 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.782931    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26" event={"ID":"3cf25345-b730-469f-9450-36139b015259","Type":"ContainerDied","Data":"7547e74d1bfe2d03e6c2957357106ee0b3ec8024cf5310b9ede304da390f3dab"}
Aug 04 11:23:15.783074 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.782963    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26" event={"ID":"3cf25345-b730-469f-9450-36139b015259","Type":"ContainerDied","Data":"6331a176dd45546623d593df2ed6beee2b2b7ea6f47d0b7231c5b42376fa04bc"}
Aug 04 11:23:15.783074 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.782980    2559 scope.go:117] "RemoveContainer" containerID="7547e74d1bfe2d03e6c2957357106ee0b3ec8024cf5310b9ede304da390f3dab"
Aug 04 11:23:15.792572 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.792555    2559 scope.go:117] "RemoveContainer" containerID="7547e74d1bfe2d03e6c2957357106ee0b3ec8024cf5310b9ede304da390f3dab"
Aug 04 11:23:15.792859 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:23:15.792839    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7547e74d1bfe2d03e6c2957357106ee0b3ec8024cf5310b9ede304da390f3dab\": container with ID starting with 7547e74d1bfe2d03e6c2957357106ee0b3ec8024cf5310b9ede304da390f3dab not found: ID does not exist" containerID="7547e74d1bfe2d03e6c2957357106ee0b3ec8024cf5310b9ede304da390f3dab"
Aug 04 11:23:15.792909 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.792866    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7547e74d1bfe2d03e6c2957357106ee0b3ec8024cf5310b9ede304da390f3dab"} err="failed to get container status \"7547e74d1bfe2d03e6c2957357106ee0b3ec8024cf5310b9ede304da390f3dab\": rpc error: code = NotFound desc = could not find container \"7547e74d1bfe2d03e6c2957357106ee0b3ec8024cf5310b9ede304da390f3dab\": container with ID starting with 7547e74d1bfe2d03e6c2957357106ee0b3ec8024cf5310b9ede304da390f3dab not found: ID does not exist"
Aug 04 11:23:15.807520 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.807501    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"]
Aug 04 11:23:15.813444 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:15.813424    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-dc2eb2/test-model-dc2eb2-kserve-6f66965b5-bpp26"]
Aug 04 11:23:17.774252 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:17.774220    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"]
Aug 04 11:23:17.774658 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:17.774428    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl" podUID="b1228cd3-41ff-42d0-82e8-dea2770fa460" containerName="istio-proxy" containerID="cri-o://2f78743c425ddf239989e7cd1214822d78b99340ba45d4d7fdaf8077b6264adc" gracePeriod=30
Aug 04 11:23:17.781955 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:17.781931    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cf25345-b730-469f-9450-36139b015259" path="/var/lib/kubelet/pods/3cf25345-b730-469f-9450-36139b015259/volumes"
Aug 04 11:23:20.977437 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:20.977402    2559 patch_prober.go:28] interesting pod/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 11:23:20.977910 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:20.977464    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl" podUID="b1228cd3-41ff-42d0-82e8-dea2770fa460" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 11:23:23.032819 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.032793    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:23:23.138856 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.138834    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-token\") pod \"b1228cd3-41ff-42d0-82e8-dea2770fa460\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") "
Aug 04 11:23:23.139012 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.138884    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-data\") pod \"b1228cd3-41ff-42d0-82e8-dea2770fa460\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") "
Aug 04 11:23:23.139012 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.138937    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-credential-socket\") pod \"b1228cd3-41ff-42d0-82e8-dea2770fa460\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") "
Aug 04 11:23:23.139012 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.138962    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-podinfo\") pod \"b1228cd3-41ff-42d0-82e8-dea2770fa460\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") "
Aug 04 11:23:23.139176 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.139018    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-workload-socket\") pod \"b1228cd3-41ff-42d0-82e8-dea2770fa460\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") "
Aug 04 11:23:23.139176 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.139038    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-envoy\") pod \"b1228cd3-41ff-42d0-82e8-dea2770fa460\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") "
Aug 04 11:23:23.139176 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.139061    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1228cd3-41ff-42d0-82e8-dea2770fa460-istiod-ca-cert\") pod \"b1228cd3-41ff-42d0-82e8-dea2770fa460\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") "
Aug 04 11:23:23.139176 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.139093    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krdnn\" (UniqueName: \"kubernetes.io/projected/b1228cd3-41ff-42d0-82e8-dea2770fa460-kube-api-access-krdnn\") pod \"b1228cd3-41ff-42d0-82e8-dea2770fa460\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") "
Aug 04 11:23:23.139176 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.139136    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-workload-certs\") pod \"b1228cd3-41ff-42d0-82e8-dea2770fa460\" (UID: \"b1228cd3-41ff-42d0-82e8-dea2770fa460\") "
Aug 04 11:23:23.139419 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.139219    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-data" (OuterVolumeSpecName: "istio-data") pod "b1228cd3-41ff-42d0-82e8-dea2770fa460" (UID: "b1228cd3-41ff-42d0-82e8-dea2770fa460"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:23:23.139419 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.139270    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b1228cd3-41ff-42d0-82e8-dea2770fa460" (UID: "b1228cd3-41ff-42d0-82e8-dea2770fa460"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:23:23.139419 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.139284    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b1228cd3-41ff-42d0-82e8-dea2770fa460" (UID: "b1228cd3-41ff-42d0-82e8-dea2770fa460"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:23:23.139419 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.139411    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b1228cd3-41ff-42d0-82e8-dea2770fa460" (UID: "b1228cd3-41ff-42d0-82e8-dea2770fa460"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:23:23.139610 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.139484    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:23.139610 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.139500    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:23.139610 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.139516    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:23.139610 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.139529    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:23.139813 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.139740    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1228cd3-41ff-42d0-82e8-dea2770fa460-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b1228cd3-41ff-42d0-82e8-dea2770fa460" (UID: "b1228cd3-41ff-42d0-82e8-dea2770fa460"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:23:23.141064 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.141045    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1228cd3-41ff-42d0-82e8-dea2770fa460" (UID: "b1228cd3-41ff-42d0-82e8-dea2770fa460"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:23:23.141280 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.141264    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1228cd3-41ff-42d0-82e8-dea2770fa460-kube-api-access-krdnn" (OuterVolumeSpecName: "kube-api-access-krdnn") pod "b1228cd3-41ff-42d0-82e8-dea2770fa460" (UID: "b1228cd3-41ff-42d0-82e8-dea2770fa460"). InnerVolumeSpecName "kube-api-access-krdnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:23:23.141631 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.141608    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b1228cd3-41ff-42d0-82e8-dea2770fa460" (UID: "b1228cd3-41ff-42d0-82e8-dea2770fa460"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:23:23.141631 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.141627    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b1228cd3-41ff-42d0-82e8-dea2770fa460" (UID: "b1228cd3-41ff-42d0-82e8-dea2770fa460"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 11:23:23.240289 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.240263    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:23.240289 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.240284    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:23.240289 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.240292    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1228cd3-41ff-42d0-82e8-dea2770fa460-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:23.240446 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.240303    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krdnn\" (UniqueName: \"kubernetes.io/projected/b1228cd3-41ff-42d0-82e8-dea2770fa460-kube-api-access-krdnn\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:23.240446 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.240316    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1228cd3-41ff-42d0-82e8-dea2770fa460-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:23.814352 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.814326    2559 generic.go:356] "Generic (PLEG): container finished" podID="b1228cd3-41ff-42d0-82e8-dea2770fa460" containerID="2f78743c425ddf239989e7cd1214822d78b99340ba45d4d7fdaf8077b6264adc" exitCode=0
Aug 04 11:23:23.814464 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.814372    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"
Aug 04 11:23:23.814464 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.814408    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl" event={"ID":"b1228cd3-41ff-42d0-82e8-dea2770fa460","Type":"ContainerDied","Data":"2f78743c425ddf239989e7cd1214822d78b99340ba45d4d7fdaf8077b6264adc"}
Aug 04 11:23:23.814464 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.814458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl" event={"ID":"b1228cd3-41ff-42d0-82e8-dea2770fa460","Type":"ContainerDied","Data":"0d41bc6a0a4aaa16d5aba7c649a4afb2a07c3563870d81f04011bcdda34772d7"}
Aug 04 11:23:23.814607 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.814480    2559 scope.go:117] "RemoveContainer" containerID="2f78743c425ddf239989e7cd1214822d78b99340ba45d4d7fdaf8077b6264adc"
Aug 04 11:23:23.822826 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.822748    2559 scope.go:117] "RemoveContainer" containerID="2c5cfde55ea77c442b9a13c80b90e5240499a1149380775358727d0a40bffa6d"
Aug 04 11:23:23.830503 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.830486    2559 scope.go:117] "RemoveContainer" containerID="2f78743c425ddf239989e7cd1214822d78b99340ba45d4d7fdaf8077b6264adc"
Aug 04 11:23:23.830789 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:23:23.830765    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f78743c425ddf239989e7cd1214822d78b99340ba45d4d7fdaf8077b6264adc\": container with ID starting with 2f78743c425ddf239989e7cd1214822d78b99340ba45d4d7fdaf8077b6264adc not found: ID does not exist" containerID="2f78743c425ddf239989e7cd1214822d78b99340ba45d4d7fdaf8077b6264adc"
Aug 04 11:23:23.830889 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.830793    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f78743c425ddf239989e7cd1214822d78b99340ba45d4d7fdaf8077b6264adc"} err="failed to get container status \"2f78743c425ddf239989e7cd1214822d78b99340ba45d4d7fdaf8077b6264adc\": rpc error: code = NotFound desc = could not find container \"2f78743c425ddf239989e7cd1214822d78b99340ba45d4d7fdaf8077b6264adc\": container with ID starting with 2f78743c425ddf239989e7cd1214822d78b99340ba45d4d7fdaf8077b6264adc not found: ID does not exist"
Aug 04 11:23:23.830889 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.830809    2559 scope.go:117] "RemoveContainer" containerID="2c5cfde55ea77c442b9a13c80b90e5240499a1149380775358727d0a40bffa6d"
Aug 04 11:23:23.831045 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:23:23.831030    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c5cfde55ea77c442b9a13c80b90e5240499a1149380775358727d0a40bffa6d\": container with ID starting with 2c5cfde55ea77c442b9a13c80b90e5240499a1149380775358727d0a40bffa6d not found: ID does not exist" containerID="2c5cfde55ea77c442b9a13c80b90e5240499a1149380775358727d0a40bffa6d"
Aug 04 11:23:23.831088 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.831050    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c5cfde55ea77c442b9a13c80b90e5240499a1149380775358727d0a40bffa6d"} err="failed to get container status \"2c5cfde55ea77c442b9a13c80b90e5240499a1149380775358727d0a40bffa6d\": rpc error: code = NotFound desc = could not find container \"2c5cfde55ea77c442b9a13c80b90e5240499a1149380775358727d0a40bffa6d\": container with ID starting with 2c5cfde55ea77c442b9a13c80b90e5240499a1149380775358727d0a40bffa6d not found: ID does not exist"
Aug 04 11:23:23.832497 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.832475    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"]
Aug 04 11:23:23.835274 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:23.835255    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-dc2eb2-openshift-default-558d8c6dc4-699wl"]
Aug 04 11:23:25.781432 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:25.781401    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1228cd3-41ff-42d0-82e8-dea2770fa460" path="/var/lib/kubelet/pods/b1228cd3-41ff-42d0-82e8-dea2770fa460/volumes"
Aug 04 11:23:35.265024 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:35.264993    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"]
Aug 04 11:23:35.265447 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:35.265215    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7" podUID="23915d38-6b48-48b7-b7c9-05ccf7cd2468" containerName="istio-proxy" containerID="cri-o://361385755b80a3c204632f99becc41053884c5216feed96ec95c0cbe9ec18ca4" gracePeriod=30
Aug 04 11:23:36.146400 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.146363    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"]
Aug 04 11:23:36.146741 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.146728    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1228cd3-41ff-42d0-82e8-dea2770fa460" containerName="istio-proxy"
Aug 04 11:23:36.146804 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.146744    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1228cd3-41ff-42d0-82e8-dea2770fa460" containerName="istio-proxy"
Aug 04 11:23:36.146804 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.146755    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1228cd3-41ff-42d0-82e8-dea2770fa460" containerName="istio-proxy"
Aug 04 11:23:36.146804 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.146761    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1228cd3-41ff-42d0-82e8-dea2770fa460" containerName="istio-proxy"
Aug 04 11:23:36.146804 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.146788    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf25345-b730-469f-9450-36139b015259" containerName="main"
Aug 04 11:23:36.146804 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.146796    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf25345-b730-469f-9450-36139b015259" containerName="main"
Aug 04 11:23:36.146977 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.146855    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1228cd3-41ff-42d0-82e8-dea2770fa460" containerName="istio-proxy"
Aug 04 11:23:36.146977 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.146862    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf25345-b730-469f-9450-36139b015259" containerName="main"
Aug 04 11:23:36.146977 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.146877    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1228cd3-41ff-42d0-82e8-dea2770fa460" containerName="istio-proxy"
Aug 04 11:23:36.149984 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.149952    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.152500 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.152477    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ba3f3c-openshift-default-dockercfg-hct7q\""
Aug 04 11:23:36.162008 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.161988    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"]
Aug 04 11:23:36.241368 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.241332    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-workload-socket\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.241539 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.241386    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-credential-socket\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.241539 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.241425    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-envoy\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.241539 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.241457    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-token\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.241661 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.241536    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-data\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.241661 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.241581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-workload-certs\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.241661 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.241604    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6ljn\" (UniqueName: \"kubernetes.io/projected/f93d39a3-a915-491b-a0c7-252b08ab3f0d-kube-api-access-d6ljn\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.241771 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.241662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istiod-ca-cert\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.241771 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.241692    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-podinfo\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.342881 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.342847    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-token\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.343304 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.342915    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-data\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.343304 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.342948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-workload-certs\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.343304 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.342972    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6ljn\" (UniqueName: \"kubernetes.io/projected/f93d39a3-a915-491b-a0c7-252b08ab3f0d-kube-api-access-d6ljn\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.343304 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.343109    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istiod-ca-cert\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.343304 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.343145    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-podinfo\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.343304 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.343176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-workload-socket\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.343304 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.343216    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-credential-socket\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.343304 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.343236    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-envoy\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.343714 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.343322    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-data\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.343714 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.343393    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-workload-certs\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.343714 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.343597    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-workload-socket\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.343714 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.343621    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-credential-socket\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.343858 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.343782    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istiod-ca-cert\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.345536 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.345515    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-envoy\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.345739 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.345723    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-podinfo\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.351351 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.351327    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-token\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.351493 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.351472    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6ljn\" (UniqueName: \"kubernetes.io/projected/f93d39a3-a915-491b-a0c7-252b08ab3f0d-kube-api-access-d6ljn\") pod \"e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") " pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.461130 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.461062    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:36.599922 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.599899    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"]
Aug 04 11:23:36.601966 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:23:36.601933    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93d39a3_a915_491b_a0c7_252b08ab3f0d.slice/crio-3aa3d896cb42ec91bb56336bea24b8326596dfc72c5fae0d0a99af3478ec30fe WatchSource:0}: Error finding container 3aa3d896cb42ec91bb56336bea24b8326596dfc72c5fae0d0a99af3478ec30fe: Status 404 returned error can't find the container with id 3aa3d896cb42ec91bb56336bea24b8326596dfc72c5fae0d0a99af3478ec30fe
Aug 04 11:23:36.604168 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.604135    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:23:36.604254 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.604239    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:23:36.604301 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.604285    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:23:36.874773 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.874726    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg" event={"ID":"f93d39a3-a915-491b-a0c7-252b08ab3f0d","Type":"ContainerStarted","Data":"d4e5d4d8ae2a4c44f64d60f5e170691df7761ea35f218a4c554de3e8b9a9bf66"}
Aug 04 11:23:36.875170 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.874797    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg" event={"ID":"f93d39a3-a915-491b-a0c7-252b08ab3f0d","Type":"ContainerStarted","Data":"3aa3d896cb42ec91bb56336bea24b8326596dfc72c5fae0d0a99af3478ec30fe"}
Aug 04 11:23:36.893588 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:36.893544    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg" podStartSLOduration=0.893528457 podStartE2EDuration="893.528457ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:23:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:23:36.89325541 +0000 UTC m=+2807.619325743" watchObservedRunningTime="2026-08-04 11:23:36.893528457 +0000 UTC m=+2807.619598790"
Aug 04 11:23:37.461513 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:37.461479    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:37.466229 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:37.466208    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:37.879498 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:37.879467    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:37.880414 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:37.880395    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:40.525995 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.525966    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:23:40.575863 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.575792    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istiod-ca-cert\") pod \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") "
Aug 04 11:23:40.575863 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.575825    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-credential-socket\") pod \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") "
Aug 04 11:23:40.576098 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.575866    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-data\") pod \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") "
Aug 04 11:23:40.576098 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.575985    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-workload-socket\") pod \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") "
Aug 04 11:23:40.576098 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.576017    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-token\") pod \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") "
Aug 04 11:23:40.576098 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.576062    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-workload-certs\") pod \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") "
Aug 04 11:23:40.576244 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.576108    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-envoy\") pod \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") "
Aug 04 11:23:40.576244 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.576157    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z59gk\" (UniqueName: \"kubernetes.io/projected/23915d38-6b48-48b7-b7c9-05ccf7cd2468-kube-api-access-z59gk\") pod \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") "
Aug 04 11:23:40.576244 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.576224    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-podinfo\") pod \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\" (UID: \"23915d38-6b48-48b7-b7c9-05ccf7cd2468\") "
Aug 04 11:23:40.576339 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.576103    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "23915d38-6b48-48b7-b7c9-05ccf7cd2468" (UID: "23915d38-6b48-48b7-b7c9-05ccf7cd2468"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:23:40.576339 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.576186    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "23915d38-6b48-48b7-b7c9-05ccf7cd2468" (UID: "23915d38-6b48-48b7-b7c9-05ccf7cd2468"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:23:40.576339 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.576126    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-data" (OuterVolumeSpecName: "istio-data") pod "23915d38-6b48-48b7-b7c9-05ccf7cd2468" (UID: "23915d38-6b48-48b7-b7c9-05ccf7cd2468"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:23:40.576339 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.576234    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "23915d38-6b48-48b7-b7c9-05ccf7cd2468" (UID: "23915d38-6b48-48b7-b7c9-05ccf7cd2468"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:23:40.576339 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.576320    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "23915d38-6b48-48b7-b7c9-05ccf7cd2468" (UID: "23915d38-6b48-48b7-b7c9-05ccf7cd2468"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:23:40.576520 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.576489    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:40.576520 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.576504    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:40.576520 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.576520    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:40.576700 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.576530    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:40.576700 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.576540    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:40.578530 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.578501    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23915d38-6b48-48b7-b7c9-05ccf7cd2468-kube-api-access-z59gk" (OuterVolumeSpecName: "kube-api-access-z59gk") pod "23915d38-6b48-48b7-b7c9-05ccf7cd2468" (UID: "23915d38-6b48-48b7-b7c9-05ccf7cd2468"). InnerVolumeSpecName "kube-api-access-z59gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:23:40.578530 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.578526    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "23915d38-6b48-48b7-b7c9-05ccf7cd2468" (UID: "23915d38-6b48-48b7-b7c9-05ccf7cd2468"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:23:40.578852 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.578832    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-token" (OuterVolumeSpecName: "istio-token") pod "23915d38-6b48-48b7-b7c9-05ccf7cd2468" (UID: "23915d38-6b48-48b7-b7c9-05ccf7cd2468"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:23:40.578852 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.578842    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "23915d38-6b48-48b7-b7c9-05ccf7cd2468" (UID: "23915d38-6b48-48b7-b7c9-05ccf7cd2468"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 11:23:40.677819 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.677788    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z59gk\" (UniqueName: \"kubernetes.io/projected/23915d38-6b48-48b7-b7c9-05ccf7cd2468-kube-api-access-z59gk\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:40.677819 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.677813    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:40.677819 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.677823    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:40.678045 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.677831    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23915d38-6b48-48b7-b7c9-05ccf7cd2468-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:23:40.893894 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.893860    2559 generic.go:356] "Generic (PLEG): container finished" podID="23915d38-6b48-48b7-b7c9-05ccf7cd2468" containerID="361385755b80a3c204632f99becc41053884c5216feed96ec95c0cbe9ec18ca4" exitCode=0
Aug 04 11:23:40.894061 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.893911    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7" event={"ID":"23915d38-6b48-48b7-b7c9-05ccf7cd2468","Type":"ContainerDied","Data":"361385755b80a3c204632f99becc41053884c5216feed96ec95c0cbe9ec18ca4"}
Aug 04 11:23:40.894061 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.893953    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7" event={"ID":"23915d38-6b48-48b7-b7c9-05ccf7cd2468","Type":"ContainerDied","Data":"0e3b64e77b45bdd86096f31b343bfefde9d933e2de9e9ec24c283df829cd1be5"}
Aug 04 11:23:40.894061 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.893977    2559 scope.go:117] "RemoveContainer" containerID="361385755b80a3c204632f99becc41053884c5216feed96ec95c0cbe9ec18ca4"
Aug 04 11:23:40.894061 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.893916    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"
Aug 04 11:23:40.903224 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.903204    2559 scope.go:117] "RemoveContainer" containerID="d2aa1f83e588f87ce1d2496bf6bf9c45a84bbfb22fd2f6c51b9427e3f11a09e9"
Aug 04 11:23:40.911886 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.911870    2559 scope.go:117] "RemoveContainer" containerID="361385755b80a3c204632f99becc41053884c5216feed96ec95c0cbe9ec18ca4"
Aug 04 11:23:40.912154 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:23:40.912134    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"361385755b80a3c204632f99becc41053884c5216feed96ec95c0cbe9ec18ca4\": container with ID starting with 361385755b80a3c204632f99becc41053884c5216feed96ec95c0cbe9ec18ca4 not found: ID does not exist" containerID="361385755b80a3c204632f99becc41053884c5216feed96ec95c0cbe9ec18ca4"
Aug 04 11:23:40.912212 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.912162    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361385755b80a3c204632f99becc41053884c5216feed96ec95c0cbe9ec18ca4"} err="failed to get container status \"361385755b80a3c204632f99becc41053884c5216feed96ec95c0cbe9ec18ca4\": rpc error: code = NotFound desc = could not find container \"361385755b80a3c204632f99becc41053884c5216feed96ec95c0cbe9ec18ca4\": container with ID starting with 361385755b80a3c204632f99becc41053884c5216feed96ec95c0cbe9ec18ca4 not found: ID does not exist"
Aug 04 11:23:40.912212 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.912180    2559 scope.go:117] "RemoveContainer" containerID="d2aa1f83e588f87ce1d2496bf6bf9c45a84bbfb22fd2f6c51b9427e3f11a09e9"
Aug 04 11:23:40.912427 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:23:40.912405    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2aa1f83e588f87ce1d2496bf6bf9c45a84bbfb22fd2f6c51b9427e3f11a09e9\": container with ID starting with d2aa1f83e588f87ce1d2496bf6bf9c45a84bbfb22fd2f6c51b9427e3f11a09e9 not found: ID does not exist" containerID="d2aa1f83e588f87ce1d2496bf6bf9c45a84bbfb22fd2f6c51b9427e3f11a09e9"
Aug 04 11:23:40.912486 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.912435    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2aa1f83e588f87ce1d2496bf6bf9c45a84bbfb22fd2f6c51b9427e3f11a09e9"} err="failed to get container status \"d2aa1f83e588f87ce1d2496bf6bf9c45a84bbfb22fd2f6c51b9427e3f11a09e9\": rpc error: code = NotFound desc = could not find container \"d2aa1f83e588f87ce1d2496bf6bf9c45a84bbfb22fd2f6c51b9427e3f11a09e9\": container with ID starting with d2aa1f83e588f87ce1d2496bf6bf9c45a84bbfb22fd2f6c51b9427e3f11a09e9 not found: ID does not exist"
Aug 04 11:23:40.916284 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.916263    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"]
Aug 04 11:23:40.922075 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:40.922054    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-1dd437-openshift-default-566d748746-45td7"]
Aug 04 11:23:41.781182 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:41.781151    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23915d38-6b48-48b7-b7c9-05ccf7cd2468" path="/var/lib/kubelet/pods/23915d38-6b48-48b7-b7c9-05ccf7cd2468/volumes"
Aug 04 11:23:51.956747 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:51.956717    2559 generic.go:356] "Generic (PLEG): container finished" podID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" containerID="d4e5d4d8ae2a4c44f64d60f5e170691df7761ea35f218a4c554de3e8b9a9bf66" exitCode=0
Aug 04 11:23:51.957113 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:51.956760    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg" event={"ID":"f93d39a3-a915-491b-a0c7-252b08ab3f0d","Type":"ContainerDied","Data":"d4e5d4d8ae2a4c44f64d60f5e170691df7761ea35f218a4c554de3e8b9a9bf66"}
Aug 04 11:23:51.957113 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:51.957084    2559 scope.go:117] "RemoveContainer" containerID="d4e5d4d8ae2a4c44f64d60f5e170691df7761ea35f218a4c554de3e8b9a9bf66"
Aug 04 11:23:51.958115 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:51.958082    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:23:51.958175 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:51.958156    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:23:51.958215 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:51.958187    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:23:52.880064 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:52.880031    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:52.963247 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:52.963212    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg" event={"ID":"f93d39a3-a915-491b-a0c7-252b08ab3f0d","Type":"ContainerStarted","Data":"d2a54e4e53fa1edc2aaef6592f334dddd397bb48a5b03f7e03740dd40e7fc9a7"}
Aug 04 11:23:53.462136 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:53.462100    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:53.463310 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:53.463283    2559 patch_prober.go:28] interesting pod/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Aug 04 11:23:53.463427 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:53.463345    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg" podUID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Aug 04 11:23:54.461895 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:54.461860    2559 patch_prober.go:28] interesting pod/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Aug 04 11:23:54.462295 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:54.461918    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg" podUID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Aug 04 11:23:55.461905 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:55.461870    2559 patch_prober.go:28] interesting pod/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Aug 04 11:23:55.462287 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:55.461930    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg" podUID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Aug 04 11:23:56.461958 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:56.461919    2559 patch_prober.go:28] interesting pod/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Aug 04 11:23:56.462336 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:56.461975    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg" podUID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Aug 04 11:23:57.461661 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:57.461607    2559 patch_prober.go:28] interesting pod/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Aug 04 11:23:57.461835 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:57.461692    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg" podUID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Aug 04 11:23:58.465687 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:58.465657    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:58.466139 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:58.465968    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:23:58.466682 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:23:58.466667    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:24:04.509408 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.509372    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"]
Aug 04 11:24:04.509786 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.509744    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23915d38-6b48-48b7-b7c9-05ccf7cd2468" containerName="istio-proxy"
Aug 04 11:24:04.509786 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.509756    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="23915d38-6b48-48b7-b7c9-05ccf7cd2468" containerName="istio-proxy"
Aug 04 11:24:04.509786 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.509767    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23915d38-6b48-48b7-b7c9-05ccf7cd2468" containerName="istio-proxy"
Aug 04 11:24:04.509786 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.509773    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="23915d38-6b48-48b7-b7c9-05ccf7cd2468" containerName="istio-proxy"
Aug 04 11:24:04.509919 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.509849    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="23915d38-6b48-48b7-b7c9-05ccf7cd2468" containerName="istio-proxy"
Aug 04 11:24:04.509919 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.509859    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="23915d38-6b48-48b7-b7c9-05ccf7cd2468" containerName="istio-proxy"
Aug 04 11:24:04.512799 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.512783    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.515239 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.515216    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-46695b-openshift-default-dockercfg-8d7x4\""
Aug 04 11:24:04.525136 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.525115    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"]
Aug 04 11:24:04.578573 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.578535    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-istio-envoy\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.578728 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.578595    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39a1193e-77df-49c1-a931-09d463182586-istiod-ca-cert\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.578728 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.578656    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39a1193e-77df-49c1-a931-09d463182586-istio-token\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.578728 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.578690    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-workload-socket\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.578728 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.578707    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-workload-certs\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.578872 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.578733    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-credential-socket\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.578872 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.578768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjkqr\" (UniqueName: \"kubernetes.io/projected/39a1193e-77df-49c1-a931-09d463182586-kube-api-access-pjkqr\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.578872 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.578840    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-istio-data\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.578965 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.578876    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39a1193e-77df-49c1-a931-09d463182586-istio-podinfo\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.679750 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.679718    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39a1193e-77df-49c1-a931-09d463182586-istio-podinfo\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.679910 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.679759    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-istio-envoy\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.679910 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.679811    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39a1193e-77df-49c1-a931-09d463182586-istiod-ca-cert\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.679910 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.679836    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39a1193e-77df-49c1-a931-09d463182586-istio-token\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.679910 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.679874    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-workload-socket\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.680125 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.679960    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-workload-certs\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.680125 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.680017    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-credential-socket\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.680125 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.680050    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjkqr\" (UniqueName: \"kubernetes.io/projected/39a1193e-77df-49c1-a931-09d463182586-kube-api-access-pjkqr\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.680289 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.680123    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-istio-data\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.680289 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.680258    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-workload-socket\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.680417 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.680311    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-workload-certs\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.680417 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.680366    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-credential-socket\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.680519 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.680482    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-istio-data\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.680563 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.680552    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39a1193e-77df-49c1-a931-09d463182586-istiod-ca-cert\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.682294 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.682278    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39a1193e-77df-49c1-a931-09d463182586-istio-podinfo\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.682493 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.682478    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-istio-envoy\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.688118 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.688089    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39a1193e-77df-49c1-a931-09d463182586-istio-token\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.688222 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.688117    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjkqr\" (UniqueName: \"kubernetes.io/projected/39a1193e-77df-49c1-a931-09d463182586-kube-api-access-pjkqr\") pod \"e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") " pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.822392 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.822319    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:04.982472 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.982445    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"]
Aug 04 11:24:04.983355 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:24:04.983323    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a1193e_77df_49c1_a931_09d463182586.slice/crio-1d22637dd84bc8e489389b95db52d1d2a84258fb8901aab63b2973cc239aee71 WatchSource:0}: Error finding container 1d22637dd84bc8e489389b95db52d1d2a84258fb8901aab63b2973cc239aee71: Status 404 returned error can't find the container with id 1d22637dd84bc8e489389b95db52d1d2a84258fb8901aab63b2973cc239aee71
Aug 04 11:24:04.985574 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.985540    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:24:04.985664 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.985606    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:24:04.985664 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:04.985632    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:24:05.015554 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:05.015517    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd" event={"ID":"39a1193e-77df-49c1-a931-09d463182586","Type":"ContainerStarted","Data":"1d22637dd84bc8e489389b95db52d1d2a84258fb8901aab63b2973cc239aee71"}
Aug 04 11:24:06.021619 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:06.021582    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd" event={"ID":"39a1193e-77df-49c1-a931-09d463182586","Type":"ContainerStarted","Data":"b36e9d78a445623278d01d427414b485cb17cc1637e9dde785591ba7be0e5946"}
Aug 04 11:24:06.041916 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:06.041873    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd" podStartSLOduration=2.041859682 podStartE2EDuration="2.041859682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:24:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:24:06.040292488 +0000 UTC m=+2836.766362833" watchObservedRunningTime="2026-08-04 11:24:06.041859682 +0000 UTC m=+2836.767930015"
Aug 04 11:24:06.823512 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:06.823474    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:06.828682 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:06.828652    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:07.025883 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:07.025854    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:07.026594 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:07.026579    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:22.125910 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:22.125856    2559 patch_prober.go:28] interesting pod/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:52572->10.132.0.59:15021: read: connection reset by peer" start-of-body=
Aug 04 11:24:22.126278 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:22.125926    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd" podUID="39a1193e-77df-49c1-a931-09d463182586" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:52572->10.132.0.59:15021: read: connection reset by peer"
Aug 04 11:24:23.105421 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:23.105387    2559 generic.go:356] "Generic (PLEG): container finished" podID="39a1193e-77df-49c1-a931-09d463182586" containerID="b36e9d78a445623278d01d427414b485cb17cc1637e9dde785591ba7be0e5946" exitCode=0
Aug 04 11:24:23.105686 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:23.105456    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd" event={"ID":"39a1193e-77df-49c1-a931-09d463182586","Type":"ContainerDied","Data":"b36e9d78a445623278d01d427414b485cb17cc1637e9dde785591ba7be0e5946"}
Aug 04 11:24:23.105873 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:23.105855    2559 scope.go:117] "RemoveContainer" containerID="b36e9d78a445623278d01d427414b485cb17cc1637e9dde785591ba7be0e5946"
Aug 04 11:24:23.106898 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:23.106874    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:24:23.106965 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:23.106943    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:24:23.107001 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:23.106974    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:24:24.114304 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:24.114260    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd" event={"ID":"39a1193e-77df-49c1-a931-09d463182586","Type":"ContainerStarted","Data":"63e2fcb0f8789757dc6044bbd790b1c28f697d22e40225edfb593485c3346ab8"}
Aug 04 11:24:24.822631 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:24.822588    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:24.823357 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:24.823332    2559 patch_prober.go:28] interesting pod/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Aug 04 11:24:24.823582 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:24.823544    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd" podUID="39a1193e-77df-49c1-a931-09d463182586" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Aug 04 11:24:25.823097 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:25.823056    2559 patch_prober.go:28] interesting pod/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Aug 04 11:24:25.823565 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:25.823119    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd" podUID="39a1193e-77df-49c1-a931-09d463182586" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Aug 04 11:24:26.823117 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:26.823059    2559 patch_prober.go:28] interesting pod/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Aug 04 11:24:26.823614 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:26.823151    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd" podUID="39a1193e-77df-49c1-a931-09d463182586" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Aug 04 11:24:27.823296 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:27.823249    2559 patch_prober.go:28] interesting pod/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Aug 04 11:24:27.823785 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:27.823317    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd" podUID="39a1193e-77df-49c1-a931-09d463182586" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Aug 04 11:24:28.828258 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:28.828229    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:28.828782 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:28.828757    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:28.830387 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:28.830361    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:24:50.090741 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:50.090674    2559 scope.go:117] "RemoveContainer" containerID="5420178098ae1d7f1338ea68eb9893fcc92f664bc7b9ae2a0c2d7790295cf1a1"
Aug 04 11:24:57.674598 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:57.674555    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"]
Aug 04 11:24:57.675197 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:57.674787    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg" podUID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" containerName="istio-proxy" containerID="cri-o://d2a54e4e53fa1edc2aaef6592f334dddd397bb48a5b03f7e03740dd40e7fc9a7" gracePeriod=30
Aug 04 11:24:58.468447 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:58.468411    2559 patch_prober.go:28] interesting pod/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 11:24:58.468615 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:24:58.468474    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg" podUID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 11:25:02.924866 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:02.924839    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:25:03.069831 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.069754    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-workload-socket\") pod \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") "
Aug 04 11:25:03.069831 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.069783    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-envoy\") pod \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") "
Aug 04 11:25:03.069831 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.069805    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-token\") pod \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") "
Aug 04 11:25:03.070096 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.069858    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-podinfo\") pod \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") "
Aug 04 11:25:03.070096 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.069891    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istiod-ca-cert\") pod \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") "
Aug 04 11:25:03.070096 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.069920    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-credential-socket\") pod \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") "
Aug 04 11:25:03.070096 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.070030    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-data\") pod \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") "
Aug 04 11:25:03.070096 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.070054    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f93d39a3-a915-491b-a0c7-252b08ab3f0d" (UID: "f93d39a3-a915-491b-a0c7-252b08ab3f0d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:25:03.070356 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.070122    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-workload-certs\") pod \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") "
Aug 04 11:25:03.070356 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.070152    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6ljn\" (UniqueName: \"kubernetes.io/projected/f93d39a3-a915-491b-a0c7-252b08ab3f0d-kube-api-access-d6ljn\") pod \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\" (UID: \"f93d39a3-a915-491b-a0c7-252b08ab3f0d\") "
Aug 04 11:25:03.070356 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.070315    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-data" (OuterVolumeSpecName: "istio-data") pod "f93d39a3-a915-491b-a0c7-252b08ab3f0d" (UID: "f93d39a3-a915-491b-a0c7-252b08ab3f0d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:25:03.070519 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.070377    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f93d39a3-a915-491b-a0c7-252b08ab3f0d" (UID: "f93d39a3-a915-491b-a0c7-252b08ab3f0d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:25:03.070519 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.070444    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f93d39a3-a915-491b-a0c7-252b08ab3f0d" (UID: "f93d39a3-a915-491b-a0c7-252b08ab3f0d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:25:03.070519 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.070456    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:03.070519 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.070473    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:03.070519 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.070481    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:03.070519 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.070503    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f93d39a3-a915-491b-a0c7-252b08ab3f0d" (UID: "f93d39a3-a915-491b-a0c7-252b08ab3f0d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:25:03.072143 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.072114    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-token" (OuterVolumeSpecName: "istio-token") pod "f93d39a3-a915-491b-a0c7-252b08ab3f0d" (UID: "f93d39a3-a915-491b-a0c7-252b08ab3f0d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:25:03.072562 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.072535    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f93d39a3-a915-491b-a0c7-252b08ab3f0d" (UID: "f93d39a3-a915-491b-a0c7-252b08ab3f0d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:25:03.072676 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.072576    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f93d39a3-a915-491b-a0c7-252b08ab3f0d" (UID: "f93d39a3-a915-491b-a0c7-252b08ab3f0d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 11:25:03.072676 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.072603    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f93d39a3-a915-491b-a0c7-252b08ab3f0d-kube-api-access-d6ljn" (OuterVolumeSpecName: "kube-api-access-d6ljn") pod "f93d39a3-a915-491b-a0c7-252b08ab3f0d" (UID: "f93d39a3-a915-491b-a0c7-252b08ab3f0d"). InnerVolumeSpecName "kube-api-access-d6ljn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:25:03.170961 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.170939    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:03.170961 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.170962    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:03.171107 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.170972    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6ljn\" (UniqueName: \"kubernetes.io/projected/f93d39a3-a915-491b-a0c7-252b08ab3f0d-kube-api-access-d6ljn\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:03.171107 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.170981    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:03.171107 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.170989    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:03.171107 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.170995    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f93d39a3-a915-491b-a0c7-252b08ab3f0d-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:03.306361 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.306333    2559 generic.go:356] "Generic (PLEG): container finished" podID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" containerID="d2a54e4e53fa1edc2aaef6592f334dddd397bb48a5b03f7e03740dd40e7fc9a7" exitCode=0
Aug 04 11:25:03.306473 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.306395    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg" event={"ID":"f93d39a3-a915-491b-a0c7-252b08ab3f0d","Type":"ContainerDied","Data":"d2a54e4e53fa1edc2aaef6592f334dddd397bb48a5b03f7e03740dd40e7fc9a7"}
Aug 04 11:25:03.306473 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.306444    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"
Aug 04 11:25:03.306548 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.306481    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg" event={"ID":"f93d39a3-a915-491b-a0c7-252b08ab3f0d","Type":"ContainerDied","Data":"3aa3d896cb42ec91bb56336bea24b8326596dfc72c5fae0d0a99af3478ec30fe"}
Aug 04 11:25:03.306548 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.306512    2559 scope.go:117] "RemoveContainer" containerID="d2a54e4e53fa1edc2aaef6592f334dddd397bb48a5b03f7e03740dd40e7fc9a7"
Aug 04 11:25:03.315414 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.315398    2559 scope.go:117] "RemoveContainer" containerID="d4e5d4d8ae2a4c44f64d60f5e170691df7761ea35f218a4c554de3e8b9a9bf66"
Aug 04 11:25:03.322898 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.322884    2559 scope.go:117] "RemoveContainer" containerID="d2a54e4e53fa1edc2aaef6592f334dddd397bb48a5b03f7e03740dd40e7fc9a7"
Aug 04 11:25:03.323134 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:25:03.323116    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2a54e4e53fa1edc2aaef6592f334dddd397bb48a5b03f7e03740dd40e7fc9a7\": container with ID starting with d2a54e4e53fa1edc2aaef6592f334dddd397bb48a5b03f7e03740dd40e7fc9a7 not found: ID does not exist" containerID="d2a54e4e53fa1edc2aaef6592f334dddd397bb48a5b03f7e03740dd40e7fc9a7"
Aug 04 11:25:03.323177 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.323141    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a54e4e53fa1edc2aaef6592f334dddd397bb48a5b03f7e03740dd40e7fc9a7"} err="failed to get container status \"d2a54e4e53fa1edc2aaef6592f334dddd397bb48a5b03f7e03740dd40e7fc9a7\": rpc error: code = NotFound desc = could not find container \"d2a54e4e53fa1edc2aaef6592f334dddd397bb48a5b03f7e03740dd40e7fc9a7\": container with ID starting with d2a54e4e53fa1edc2aaef6592f334dddd397bb48a5b03f7e03740dd40e7fc9a7 not found: ID does not exist"
Aug 04 11:25:03.323177 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.323160    2559 scope.go:117] "RemoveContainer" containerID="d4e5d4d8ae2a4c44f64d60f5e170691df7761ea35f218a4c554de3e8b9a9bf66"
Aug 04 11:25:03.323392 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:25:03.323374    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4e5d4d8ae2a4c44f64d60f5e170691df7761ea35f218a4c554de3e8b9a9bf66\": container with ID starting with d4e5d4d8ae2a4c44f64d60f5e170691df7761ea35f218a4c554de3e8b9a9bf66 not found: ID does not exist" containerID="d4e5d4d8ae2a4c44f64d60f5e170691df7761ea35f218a4c554de3e8b9a9bf66"
Aug 04 11:25:03.323445 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.323401    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4e5d4d8ae2a4c44f64d60f5e170691df7761ea35f218a4c554de3e8b9a9bf66"} err="failed to get container status \"d4e5d4d8ae2a4c44f64d60f5e170691df7761ea35f218a4c554de3e8b9a9bf66\": rpc error: code = NotFound desc = could not find container \"d4e5d4d8ae2a4c44f64d60f5e170691df7761ea35f218a4c554de3e8b9a9bf66\": container with ID starting with d4e5d4d8ae2a4c44f64d60f5e170691df7761ea35f218a4c554de3e8b9a9bf66 not found: ID does not exist"
Aug 04 11:25:03.328474 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.328452    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"]
Aug 04 11:25:03.333025 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.333005    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ba3f3c-openshift-default-9c95ccc48-dt8lg"]
Aug 04 11:25:03.780968 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:03.780941    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" path="/var/lib/kubelet/pods/f93d39a3-a915-491b-a0c7-252b08ab3f0d/volumes"
Aug 04 11:25:20.451856 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:20.451808    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"]
Aug 04 11:25:20.452350 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:20.452117    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd" podUID="39a1193e-77df-49c1-a931-09d463182586" containerName="istio-proxy" containerID="cri-o://63e2fcb0f8789757dc6044bbd790b1c28f697d22e40225edfb593485c3346ab8" gracePeriod=30
Aug 04 11:25:21.286946 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.286911    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"]
Aug 04 11:25:21.287281 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.287268    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" containerName="istio-proxy"
Aug 04 11:25:21.287281 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.287282    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" containerName="istio-proxy"
Aug 04 11:25:21.287356 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.287341    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" containerName="istio-proxy"
Aug 04 11:25:21.287356 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.287350    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" containerName="istio-proxy"
Aug 04 11:25:21.291979 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.291955    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.294222 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.294201    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-ed8ca8-openshift-default-dockercfg-xpkct\""
Aug 04 11:25:21.303968 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.303941    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"]
Aug 04 11:25:21.326659 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.326612    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-istio-envoy\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.326774 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.326665    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d699dd9-29ae-423e-a74e-1cb055498160-istio-token\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.326774 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.326723    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d699dd9-29ae-423e-a74e-1cb055498160-istio-podinfo\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.326844 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.326769    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj2z8\" (UniqueName: \"kubernetes.io/projected/7d699dd9-29ae-423e-a74e-1cb055498160-kube-api-access-wj2z8\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.326844 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.326810    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-credential-socket\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.326844 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.326837    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d699dd9-29ae-423e-a74e-1cb055498160-istiod-ca-cert\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.326938 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.326869    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-istio-data\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.326938 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.326912    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-workload-socket\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.326938 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.326931    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-workload-certs\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.427401 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.427364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-workload-socket\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.427401 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.427402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-workload-certs\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.427723 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.427528    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-istio-envoy\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.427723 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.427561    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d699dd9-29ae-423e-a74e-1cb055498160-istio-token\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.427723 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.427706    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d699dd9-29ae-423e-a74e-1cb055498160-istio-podinfo\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.427885 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.427747    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj2z8\" (UniqueName: \"kubernetes.io/projected/7d699dd9-29ae-423e-a74e-1cb055498160-kube-api-access-wj2z8\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.427885 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.427785    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-credential-socket\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.427885 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.427786    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-workload-certs\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.427885 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.427838    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-workload-socket\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.427885 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.427853    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d699dd9-29ae-423e-a74e-1cb055498160-istiod-ca-cert\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.428141 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.427915    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-istio-data\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.428141 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.428086    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-credential-socket\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.428234 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.428199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-istio-data\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.428807 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.428782    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d699dd9-29ae-423e-a74e-1cb055498160-istiod-ca-cert\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.430057 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.430021    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-istio-envoy\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.430328 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.430306    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d699dd9-29ae-423e-a74e-1cb055498160-istio-podinfo\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.445898 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.445872    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d699dd9-29ae-423e-a74e-1cb055498160-istio-token\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.446006 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.445988    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj2z8\" (UniqueName: \"kubernetes.io/projected/7d699dd9-29ae-423e-a74e-1cb055498160-kube-api-access-wj2z8\") pod \"e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") " pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.601981 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.601950    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:21.738862 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.738788    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"]
Aug 04 11:25:21.741043 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:25:21.741015    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d699dd9_29ae_423e_a74e_1cb055498160.slice/crio-15aaa112c2a738742de51124f8ab8034fd41e288cff2a3c688729b4e636b6aeb WatchSource:0}: Error finding container 15aaa112c2a738742de51124f8ab8034fd41e288cff2a3c688729b4e636b6aeb: Status 404 returned error can't find the container with id 15aaa112c2a738742de51124f8ab8034fd41e288cff2a3c688729b4e636b6aeb
Aug 04 11:25:21.743195 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.743167    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:25:21.743257 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.743230    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:25:21.743294 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:21.743259    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:25:22.399291 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:22.399249    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds" event={"ID":"7d699dd9-29ae-423e-a74e-1cb055498160","Type":"ContainerStarted","Data":"efb3035bd47ebb80c4afa51048365664b2e6150598b85b40830209319ea0205c"}
Aug 04 11:25:22.399486 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:22.399310    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds" event={"ID":"7d699dd9-29ae-423e-a74e-1cb055498160","Type":"ContainerStarted","Data":"15aaa112c2a738742de51124f8ab8034fd41e288cff2a3c688729b4e636b6aeb"}
Aug 04 11:25:22.421187 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:22.421128    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds" podStartSLOduration=1.421111509 podStartE2EDuration="1.421111509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:25:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:25:22.419811867 +0000 UTC m=+2913.145882201" watchObservedRunningTime="2026-08-04 11:25:22.421111509 +0000 UTC m=+2913.147181899"
Aug 04 11:25:22.602929 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:22.602897    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:22.607749 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:22.607725    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:23.404194 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:23.404161    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:23.405039 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:23.405021    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:25.696465 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.696439    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:25:25.763379 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.763307    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39a1193e-77df-49c1-a931-09d463182586-istio-token\") pod \"39a1193e-77df-49c1-a931-09d463182586\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") "
Aug 04 11:25:25.763379 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.763335    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjkqr\" (UniqueName: \"kubernetes.io/projected/39a1193e-77df-49c1-a931-09d463182586-kube-api-access-pjkqr\") pod \"39a1193e-77df-49c1-a931-09d463182586\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") "
Aug 04 11:25:25.763379 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.763365    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-istio-envoy\") pod \"39a1193e-77df-49c1-a931-09d463182586\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") "
Aug 04 11:25:25.763680 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.763391    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-workload-socket\") pod \"39a1193e-77df-49c1-a931-09d463182586\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") "
Aug 04 11:25:25.763680 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.763409    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39a1193e-77df-49c1-a931-09d463182586-istio-podinfo\") pod \"39a1193e-77df-49c1-a931-09d463182586\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") "
Aug 04 11:25:25.763680 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.763443    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-istio-data\") pod \"39a1193e-77df-49c1-a931-09d463182586\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") "
Aug 04 11:25:25.763680 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.763470    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-credential-socket\") pod \"39a1193e-77df-49c1-a931-09d463182586\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") "
Aug 04 11:25:25.763680 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.763509    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-workload-certs\") pod \"39a1193e-77df-49c1-a931-09d463182586\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") "
Aug 04 11:25:25.763680 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.763565    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39a1193e-77df-49c1-a931-09d463182586-istiod-ca-cert\") pod \"39a1193e-77df-49c1-a931-09d463182586\" (UID: \"39a1193e-77df-49c1-a931-09d463182586\") "
Aug 04 11:25:25.763975 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.763728    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "39a1193e-77df-49c1-a931-09d463182586" (UID: "39a1193e-77df-49c1-a931-09d463182586"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:25:25.763975 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.763743    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-istio-data" (OuterVolumeSpecName: "istio-data") pod "39a1193e-77df-49c1-a931-09d463182586" (UID: "39a1193e-77df-49c1-a931-09d463182586"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:25:25.763975 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.763942    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "39a1193e-77df-49c1-a931-09d463182586" (UID: "39a1193e-77df-49c1-a931-09d463182586"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:25:25.763975 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.763950    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:25.763975 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.763970    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:25.764379 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.764019    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39a1193e-77df-49c1-a931-09d463182586-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "39a1193e-77df-49c1-a931-09d463182586" (UID: "39a1193e-77df-49c1-a931-09d463182586"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:25:25.764379 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.764159    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "39a1193e-77df-49c1-a931-09d463182586" (UID: "39a1193e-77df-49c1-a931-09d463182586"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:25:25.765837 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.765811    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39a1193e-77df-49c1-a931-09d463182586-istio-token" (OuterVolumeSpecName: "istio-token") pod "39a1193e-77df-49c1-a931-09d463182586" (UID: "39a1193e-77df-49c1-a931-09d463182586"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:25:25.765955 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.765915    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39a1193e-77df-49c1-a931-09d463182586-kube-api-access-pjkqr" (OuterVolumeSpecName: "kube-api-access-pjkqr") pod "39a1193e-77df-49c1-a931-09d463182586" (UID: "39a1193e-77df-49c1-a931-09d463182586"). InnerVolumeSpecName "kube-api-access-pjkqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:25:25.765955 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.765919    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/39a1193e-77df-49c1-a931-09d463182586-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "39a1193e-77df-49c1-a931-09d463182586" (UID: "39a1193e-77df-49c1-a931-09d463182586"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 11:25:25.766212 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.766187    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "39a1193e-77df-49c1-a931-09d463182586" (UID: "39a1193e-77df-49c1-a931-09d463182586"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:25:25.864854 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.864828    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39a1193e-77df-49c1-a931-09d463182586-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:25.864854 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.864852    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjkqr\" (UniqueName: \"kubernetes.io/projected/39a1193e-77df-49c1-a931-09d463182586-kube-api-access-pjkqr\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:25.864854 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.864862    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:25.865101 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.864871    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39a1193e-77df-49c1-a931-09d463182586-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:25.865101 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.864878    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:25.865101 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.864886    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39a1193e-77df-49c1-a931-09d463182586-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:25.865101 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:25.864898    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39a1193e-77df-49c1-a931-09d463182586-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:25:26.419347 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:26.419319    2559 generic.go:356] "Generic (PLEG): container finished" podID="39a1193e-77df-49c1-a931-09d463182586" containerID="63e2fcb0f8789757dc6044bbd790b1c28f697d22e40225edfb593485c3346ab8" exitCode=0
Aug 04 11:25:26.419489 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:26.419356    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd" event={"ID":"39a1193e-77df-49c1-a931-09d463182586","Type":"ContainerDied","Data":"63e2fcb0f8789757dc6044bbd790b1c28f697d22e40225edfb593485c3346ab8"}
Aug 04 11:25:26.419489 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:26.419366    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"
Aug 04 11:25:26.419489 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:26.419396    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd" event={"ID":"39a1193e-77df-49c1-a931-09d463182586","Type":"ContainerDied","Data":"1d22637dd84bc8e489389b95db52d1d2a84258fb8901aab63b2973cc239aee71"}
Aug 04 11:25:26.419489 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:26.419417    2559 scope.go:117] "RemoveContainer" containerID="63e2fcb0f8789757dc6044bbd790b1c28f697d22e40225edfb593485c3346ab8"
Aug 04 11:25:26.427961 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:26.427942    2559 scope.go:117] "RemoveContainer" containerID="b36e9d78a445623278d01d427414b485cb17cc1637e9dde785591ba7be0e5946"
Aug 04 11:25:26.435511 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:26.435491    2559 scope.go:117] "RemoveContainer" containerID="63e2fcb0f8789757dc6044bbd790b1c28f697d22e40225edfb593485c3346ab8"
Aug 04 11:25:26.435802 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:25:26.435779    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63e2fcb0f8789757dc6044bbd790b1c28f697d22e40225edfb593485c3346ab8\": container with ID starting with 63e2fcb0f8789757dc6044bbd790b1c28f697d22e40225edfb593485c3346ab8 not found: ID does not exist" containerID="63e2fcb0f8789757dc6044bbd790b1c28f697d22e40225edfb593485c3346ab8"
Aug 04 11:25:26.435878 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:26.435813    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e2fcb0f8789757dc6044bbd790b1c28f697d22e40225edfb593485c3346ab8"} err="failed to get container status \"63e2fcb0f8789757dc6044bbd790b1c28f697d22e40225edfb593485c3346ab8\": rpc error: code = NotFound desc = could not find container \"63e2fcb0f8789757dc6044bbd790b1c28f697d22e40225edfb593485c3346ab8\": container with ID starting with 63e2fcb0f8789757dc6044bbd790b1c28f697d22e40225edfb593485c3346ab8 not found: ID does not exist"
Aug 04 11:25:26.435878 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:26.435835    2559 scope.go:117] "RemoveContainer" containerID="b36e9d78a445623278d01d427414b485cb17cc1637e9dde785591ba7be0e5946"
Aug 04 11:25:26.436098 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:25:26.436079    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b36e9d78a445623278d01d427414b485cb17cc1637e9dde785591ba7be0e5946\": container with ID starting with b36e9d78a445623278d01d427414b485cb17cc1637e9dde785591ba7be0e5946 not found: ID does not exist" containerID="b36e9d78a445623278d01d427414b485cb17cc1637e9dde785591ba7be0e5946"
Aug 04 11:25:26.436150 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:26.436104    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b36e9d78a445623278d01d427414b485cb17cc1637e9dde785591ba7be0e5946"} err="failed to get container status \"b36e9d78a445623278d01d427414b485cb17cc1637e9dde785591ba7be0e5946\": rpc error: code = NotFound desc = could not find container \"b36e9d78a445623278d01d427414b485cb17cc1637e9dde785591ba7be0e5946\": container with ID starting with b36e9d78a445623278d01d427414b485cb17cc1637e9dde785591ba7be0e5946 not found: ID does not exist"
Aug 04 11:25:26.436821 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:26.436803    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"]
Aug 04 11:25:26.440456 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:26.440431    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-46695b-openshift-default-659cf9d846-cdcrd"]
Aug 04 11:25:27.781346 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:27.781304    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39a1193e-77df-49c1-a931-09d463182586" path="/var/lib/kubelet/pods/39a1193e-77df-49c1-a931-09d463182586/volumes"
Aug 04 11:25:37.472990 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:37.472911    2559 generic.go:356] "Generic (PLEG): container finished" podID="7d699dd9-29ae-423e-a74e-1cb055498160" containerID="efb3035bd47ebb80c4afa51048365664b2e6150598b85b40830209319ea0205c" exitCode=0
Aug 04 11:25:37.472990 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:37.472968    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds" event={"ID":"7d699dd9-29ae-423e-a74e-1cb055498160","Type":"ContainerDied","Data":"efb3035bd47ebb80c4afa51048365664b2e6150598b85b40830209319ea0205c"}
Aug 04 11:25:37.473478 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:37.473439    2559 scope.go:117] "RemoveContainer" containerID="efb3035bd47ebb80c4afa51048365664b2e6150598b85b40830209319ea0205c"
Aug 04 11:25:37.474473 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:37.474447    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:25:37.474574 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:37.474510    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:25:37.474574 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:37.474542    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:25:38.404668 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:38.404617    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:38.478620 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:38.478588    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds" event={"ID":"7d699dd9-29ae-423e-a74e-1cb055498160","Type":"ContainerStarted","Data":"26037294622a2965a0651be8eeda43b52144e9a1a3104debe6038fdfc7ef3298"}
Aug 04 11:25:38.602894 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:38.602856    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:38.604039 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:38.604013    2559 patch_prober.go:28] interesting pod/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Aug 04 11:25:38.604154 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:38.604060    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds" podUID="7d699dd9-29ae-423e-a74e-1cb055498160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Aug 04 11:25:39.602817 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:39.602778    2559 patch_prober.go:28] interesting pod/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Aug 04 11:25:39.603208 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:39.602838    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds" podUID="7d699dd9-29ae-423e-a74e-1cb055498160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Aug 04 11:25:40.602893 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:40.602863    2559 patch_prober.go:28] interesting pod/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Aug 04 11:25:40.603253 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:40.602913    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds" podUID="7d699dd9-29ae-423e-a74e-1cb055498160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Aug 04 11:25:41.602936 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:41.602902    2559 patch_prober.go:28] interesting pod/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Aug 04 11:25:41.603349 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:41.602955    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds" podUID="7d699dd9-29ae-423e-a74e-1cb055498160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Aug 04 11:25:42.602681 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:42.602625    2559 patch_prober.go:28] interesting pod/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Aug 04 11:25:42.602851 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:42.602701    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds" podUID="7d699dd9-29ae-423e-a74e-1cb055498160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Aug 04 11:25:43.606255 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:43.606227    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:43.606679 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:43.606665    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:43.607257 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:43.607237    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:25:49.893369 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:49.893331    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"]
Aug 04 11:25:49.893851 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:49.893668    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39a1193e-77df-49c1-a931-09d463182586" containerName="istio-proxy"
Aug 04 11:25:49.893851 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:49.893679    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="39a1193e-77df-49c1-a931-09d463182586" containerName="istio-proxy"
Aug 04 11:25:49.893851 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:49.893690    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39a1193e-77df-49c1-a931-09d463182586" containerName="istio-proxy"
Aug 04 11:25:49.893851 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:49.893695    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="39a1193e-77df-49c1-a931-09d463182586" containerName="istio-proxy"
Aug 04 11:25:49.893851 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:49.893712    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" containerName="istio-proxy"
Aug 04 11:25:49.893851 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:49.893718    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f93d39a3-a915-491b-a0c7-252b08ab3f0d" containerName="istio-proxy"
Aug 04 11:25:49.893851 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:49.893771    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="39a1193e-77df-49c1-a931-09d463182586" containerName="istio-proxy"
Aug 04 11:25:49.893851 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:49.893778    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="39a1193e-77df-49c1-a931-09d463182586" containerName="istio-proxy"
Aug 04 11:25:49.895824 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:49.895793    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:49.898866 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:49.898846    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-c74755-openshift-default-dockercfg-hpptf\""
Aug 04 11:25:49.914943 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:49.914923    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"]
Aug 04 11:25:50.013466 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.013417    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-workload-socket\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.013466 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.013470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-podinfo\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.013753 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.013498    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90dbd07a-e51f-4456-a172-356b2c8aeadf-istiod-ca-cert\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.013753 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.013536    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-token\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.013753 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.013576    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-data\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.013753 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.013602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-workload-certs\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.013753 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.013621    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-envoy\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.013753 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.013674    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-credential-socket\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.013753 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.013733    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d4l8\" (UniqueName: \"kubernetes.io/projected/90dbd07a-e51f-4456-a172-356b2c8aeadf-kube-api-access-4d4l8\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.114460 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.114435    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-data\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.114460 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.114465    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-workload-certs\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.114633 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.114480    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-envoy\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.114633 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.114509    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-credential-socket\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.114633 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.114548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d4l8\" (UniqueName: \"kubernetes.io/projected/90dbd07a-e51f-4456-a172-356b2c8aeadf-kube-api-access-4d4l8\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.114633 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.114594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-workload-socket\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.114633 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.114626    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-podinfo\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.114907 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.114667    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90dbd07a-e51f-4456-a172-356b2c8aeadf-istiod-ca-cert\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.114907 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.114706    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-token\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.115005 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.114943    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-data\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.115159 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.115133    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-workload-socket\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.115469 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.115447    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-credential-socket\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.115572 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.115458    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-workload-certs\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.115807 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.115757    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90dbd07a-e51f-4456-a172-356b2c8aeadf-istiod-ca-cert\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.117327 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.117303    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-envoy\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.117505 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.117486    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-podinfo\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.123292 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.123266    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-token\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.124605 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.124584    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d4l8\" (UniqueName: \"kubernetes.io/projected/90dbd07a-e51f-4456-a172-356b2c8aeadf-kube-api-access-4d4l8\") pod \"e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") " pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.206027 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.205971    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:50.346030 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.346005    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"]
Aug 04 11:25:50.347931 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:25:50.347900    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90dbd07a_e51f_4456_a172_356b2c8aeadf.slice/crio-1ca1bc6d40d1998870d5a5c43f8ef9205a79a42873cdcfb6f1f99d8c28af28c4 WatchSource:0}: Error finding container 1ca1bc6d40d1998870d5a5c43f8ef9205a79a42873cdcfb6f1f99d8c28af28c4: Status 404 returned error can't find the container with id 1ca1bc6d40d1998870d5a5c43f8ef9205a79a42873cdcfb6f1f99d8c28af28c4
Aug 04 11:25:50.350103 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.350068    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:25:50.350210 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.350145    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:25:50.350210 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.350176    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:25:50.532548 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.532463    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss" event={"ID":"90dbd07a-e51f-4456-a172-356b2c8aeadf","Type":"ContainerStarted","Data":"1cdee45b0592d4926760971935ea1f282a9425b6311043c8ab5751e3eee210b1"}
Aug 04 11:25:50.532548 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.532521    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss" event={"ID":"90dbd07a-e51f-4456-a172-356b2c8aeadf","Type":"ContainerStarted","Data":"1ca1bc6d40d1998870d5a5c43f8ef9205a79a42873cdcfb6f1f99d8c28af28c4"}
Aug 04 11:25:50.553740 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:50.553695    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss" podStartSLOduration=1.553681209 podStartE2EDuration="1.553681209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:25:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:25:50.552674349 +0000 UTC m=+2941.278744682" watchObservedRunningTime="2026-08-04 11:25:50.553681209 +0000 UTC m=+2941.279751542"
Aug 04 11:25:51.206466 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:51.206434    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:51.211344 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:51.211313    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:51.537690 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:51.537585    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:25:51.538482 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:25:51.538462    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:26:06.539625 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:06.539536    2559 patch_prober.go:28] interesting pod/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 04 11:26:06.539625 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:06.539590    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss" podUID="90dbd07a-e51f-4456-a172-356b2c8aeadf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 04 11:26:06.610056 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:06.610022    2559 generic.go:356] "Generic (PLEG): container finished" podID="90dbd07a-e51f-4456-a172-356b2c8aeadf" containerID="1cdee45b0592d4926760971935ea1f282a9425b6311043c8ab5751e3eee210b1" exitCode=0
Aug 04 11:26:06.610196 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:06.610102    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss" event={"ID":"90dbd07a-e51f-4456-a172-356b2c8aeadf","Type":"ContainerDied","Data":"1cdee45b0592d4926760971935ea1f282a9425b6311043c8ab5751e3eee210b1"}
Aug 04 11:26:06.610517 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:06.610502    2559 scope.go:117] "RemoveContainer" containerID="1cdee45b0592d4926760971935ea1f282a9425b6311043c8ab5751e3eee210b1"
Aug 04 11:26:06.611505 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:06.611480    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:26:06.611589 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:06.611576    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:26:06.611629 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:06.611617    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:26:07.619881 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:07.619834    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss" event={"ID":"90dbd07a-e51f-4456-a172-356b2c8aeadf","Type":"ContainerStarted","Data":"14fe7155a101c75dd1d826ecb1c487baa3c2e98e73bb0e91c3fa8b224fbf9628"}
Aug 04 11:26:08.206457 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:08.206428    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:26:08.206632 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:08.206609    2559 patch_prober.go:28] interesting pod/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 04 11:26:08.206705 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:08.206685    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss" podUID="90dbd07a-e51f-4456-a172-356b2c8aeadf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 04 11:26:09.206319 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:09.206285    2559 patch_prober.go:28] interesting pod/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 04 11:26:09.206739 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:09.206337    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss" podUID="90dbd07a-e51f-4456-a172-356b2c8aeadf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 04 11:26:10.207145 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:10.207113    2559 patch_prober.go:28] interesting pod/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 04 11:26:10.207543 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:10.207169    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss" podUID="90dbd07a-e51f-4456-a172-356b2c8aeadf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 04 11:26:11.206995 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:11.206915    2559 patch_prober.go:28] interesting pod/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 04 11:26:11.206995 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:11.206971    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss" podUID="90dbd07a-e51f-4456-a172-356b2c8aeadf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 04 11:26:12.207158 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:12.207123    2559 patch_prober.go:28] interesting pod/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 04 11:26:12.207576 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:12.207183    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss" podUID="90dbd07a-e51f-4456-a172-356b2c8aeadf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 04 11:26:13.210121 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:13.210082    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:26:13.210509 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:13.210362    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:26:13.210990 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:13.210972    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:26:20.666995 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.666957    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"]
Aug 04 11:26:20.669476 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.669454    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.672369 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.672349    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ed8ca8\"/\"auth-test-model-ed8ca8-kserve-self-signed-certs\""
Aug 04 11:26:20.673307 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.673289    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ed8ca8\"/\"kube-root-ca.crt\""
Aug 04 11:26:20.673570 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.673555    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ed8ca8\"/\"default-dockercfg-855th\""
Aug 04 11:26:20.673676 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.673561    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ed8ca8\"/\"openshift-service-ca.crt\""
Aug 04 11:26:20.682486 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.682467    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"]
Aug 04 11:26:20.768660 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.768609    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-dshm\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.768810 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.768674    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-model-cache\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.768810 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.768699    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6daa8654-ed6d-4668-86b4-4b46695e370e-tls-certs\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.768810 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.768747    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-tmp-dir\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.768810 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.768810    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4cgt\" (UniqueName: \"kubernetes.io/projected/6daa8654-ed6d-4668-86b4-4b46695e370e-kube-api-access-t4cgt\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.768963 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.768827    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-home\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.870114 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.870070    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4cgt\" (UniqueName: \"kubernetes.io/projected/6daa8654-ed6d-4668-86b4-4b46695e370e-kube-api-access-t4cgt\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.870289 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.870118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-home\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.870289 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.870156    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-dshm\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.870289 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.870172    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-model-cache\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.870289 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.870189    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6daa8654-ed6d-4668-86b4-4b46695e370e-tls-certs\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.870289 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.870243    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-tmp-dir\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.870702 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.870680    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-home\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.870803 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.870726    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-model-cache\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.870844 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.870826    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-tmp-dir\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.872599 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.872568    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-dshm\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.872905 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.872884    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6daa8654-ed6d-4668-86b4-4b46695e370e-tls-certs\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.880103 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.880082    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4cgt\" (UniqueName: \"kubernetes.io/projected/6daa8654-ed6d-4668-86b4-4b46695e370e-kube-api-access-t4cgt\") pod \"auth-test-model-ed8ca8-kserve-556f96f79-jzdlp\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") " pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:20.978967 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:20.978907    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:21.111281 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:21.111245    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"]
Aug 04 11:26:21.114253 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:26:21.114216    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6daa8654_ed6d_4668_86b4_4b46695e370e.slice/crio-8a0d0520a66fe64cc7e5fc21be5cbb3841632f04b36b02e373aed60e5af05fb1 WatchSource:0}: Error finding container 8a0d0520a66fe64cc7e5fc21be5cbb3841632f04b36b02e373aed60e5af05fb1: Status 404 returned error can't find the container with id 8a0d0520a66fe64cc7e5fc21be5cbb3841632f04b36b02e373aed60e5af05fb1
Aug 04 11:26:21.696555 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:21.696519    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp" event={"ID":"6daa8654-ed6d-4668-86b4-4b46695e370e","Type":"ContainerStarted","Data":"f280529898691e348b78ae435e620ea81d4cda2602183533afb224272624e419"}
Aug 04 11:26:21.696555 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:21.696556    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp" event={"ID":"6daa8654-ed6d-4668-86b4-4b46695e370e","Type":"ContainerStarted","Data":"8a0d0520a66fe64cc7e5fc21be5cbb3841632f04b36b02e373aed60e5af05fb1"}
Aug 04 11:26:21.720412 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:21.720364    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp" podStartSLOduration=1.7203499789999999 podStartE2EDuration="1.720349979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:26:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:26:21.717967878 +0000 UTC m=+2972.444038211" watchObservedRunningTime="2026-08-04 11:26:21.720349979 +0000 UTC m=+2972.446420356"
Aug 04 11:26:30.979605 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:30.979571    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:30.979987 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:30.979617    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:30.991671 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:30.991632    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:31.752064 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:31.752029    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:26:42.475603 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.475571    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"]
Aug 04 11:26:42.478306 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.478289    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.481511 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.481487    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c74755\"/\"openshift-service-ca.crt\""
Aug 04 11:26:42.481666 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.481487    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c74755\"/\"kube-root-ca.crt\""
Aug 04 11:26:42.481737 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.481673    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c74755\"/\"default-dockercfg-db5hm\""
Aug 04 11:26:42.481737 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.481704    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c74755\"/\"auth-test-model-c74755-kserve-self-signed-certs\""
Aug 04 11:26:42.488310 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.488289    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"]
Aug 04 11:26:42.545555 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.545528    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-home\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.545714 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.545572    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-dshm\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.545783 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.545764    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gv8s\" (UniqueName: \"kubernetes.io/projected/a2cd7d70-ee64-4417-8fa7-7772499e9660-kube-api-access-9gv8s\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.545843 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.545829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-model-cache\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.545881 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.545851    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-tmp-dir\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.545881 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.545869    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2cd7d70-ee64-4417-8fa7-7772499e9660-tls-certs\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.647791 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.647745    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-model-cache\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.647986 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.647833    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-tmp-dir\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.647986 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.647872    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2cd7d70-ee64-4417-8fa7-7772499e9660-tls-certs\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.647986 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.647933    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-home\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.647986 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.647973    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-dshm\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.648210 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.648022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gv8s\" (UniqueName: \"kubernetes.io/projected/a2cd7d70-ee64-4417-8fa7-7772499e9660-kube-api-access-9gv8s\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.648269 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.648249    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-model-cache\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.648359 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.648309    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-tmp-dir\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.648782 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.648762    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-home\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.651092 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.651062    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-dshm\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.651450 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.651428    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2cd7d70-ee64-4417-8fa7-7772499e9660-tls-certs\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.656288 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.656266    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gv8s\" (UniqueName: \"kubernetes.io/projected/a2cd7d70-ee64-4417-8fa7-7772499e9660-kube-api-access-9gv8s\") pod \"auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") " pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.788295 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.788222    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:42.916759 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:42.916728    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"]
Aug 04 11:26:42.919738 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:26:42.919716    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2cd7d70_ee64_4417_8fa7_7772499e9660.slice/crio-6240762ca0fb9ccd71211b91d835eb7127da0c890d93e6784d7758acbbb7e205 WatchSource:0}: Error finding container 6240762ca0fb9ccd71211b91d835eb7127da0c890d93e6784d7758acbbb7e205: Status 404 returned error can't find the container with id 6240762ca0fb9ccd71211b91d835eb7127da0c890d93e6784d7758acbbb7e205
Aug 04 11:26:43.794801 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:43.794762    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6" event={"ID":"a2cd7d70-ee64-4417-8fa7-7772499e9660","Type":"ContainerStarted","Data":"400745b86014c3006f1ffb9236eba042e42fabbf5412a73fdf57be1a0910f738"}
Aug 04 11:26:43.794801 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:43.794805    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6" event={"ID":"a2cd7d70-ee64-4417-8fa7-7772499e9660","Type":"ContainerStarted","Data":"6240762ca0fb9ccd71211b91d835eb7127da0c890d93e6784d7758acbbb7e205"}
Aug 04 11:26:43.818582 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:43.818537    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6" podStartSLOduration=1.818522687 podStartE2EDuration="1.818522687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:26:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:26:43.81721714 +0000 UTC m=+2994.543287474" watchObservedRunningTime="2026-08-04 11:26:43.818522687 +0000 UTC m=+2994.544593021"
Aug 04 11:26:52.788496 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:52.788458    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:52.789026 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:52.788514    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:52.800135 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:52.800113    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:26:52.844627 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:26:52.844598    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:30:55.935318 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:30:55.935243    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"]
Aug 04 11:30:56.683479 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:30:56.683448    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"]
Aug 04 11:31:10.954257 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:10.954212    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp" podUID="6daa8654-ed6d-4668-86b4-4b46695e370e" containerName="main" containerID="cri-o://f280529898691e348b78ae435e620ea81d4cda2602183533afb224272624e419" gracePeriod=45
Aug 04 11:31:11.204760 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.204704    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:31:11.268335 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.268307    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6daa8654-ed6d-4668-86b4-4b46695e370e-tls-certs\") pod \"6daa8654-ed6d-4668-86b4-4b46695e370e\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") "
Aug 04 11:31:11.268473 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.268385    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-tmp-dir\") pod \"6daa8654-ed6d-4668-86b4-4b46695e370e\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") "
Aug 04 11:31:11.268473 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.268429    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-dshm\") pod \"6daa8654-ed6d-4668-86b4-4b46695e370e\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") "
Aug 04 11:31:11.268473 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.268451    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-home\") pod \"6daa8654-ed6d-4668-86b4-4b46695e370e\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") "
Aug 04 11:31:11.268661 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.268483    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-model-cache\") pod \"6daa8654-ed6d-4668-86b4-4b46695e370e\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") "
Aug 04 11:31:11.268661 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.268546    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4cgt\" (UniqueName: \"kubernetes.io/projected/6daa8654-ed6d-4668-86b4-4b46695e370e-kube-api-access-t4cgt\") pod \"6daa8654-ed6d-4668-86b4-4b46695e370e\" (UID: \"6daa8654-ed6d-4668-86b4-4b46695e370e\") "
Aug 04 11:31:11.268782 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.268713    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6daa8654-ed6d-4668-86b4-4b46695e370e" (UID: "6daa8654-ed6d-4668-86b4-4b46695e370e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:31:11.268782 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.268728    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-home" (OuterVolumeSpecName: "home") pod "6daa8654-ed6d-4668-86b4-4b46695e370e" (UID: "6daa8654-ed6d-4668-86b4-4b46695e370e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:31:11.268878 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.268798    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-model-cache" (OuterVolumeSpecName: "model-cache") pod "6daa8654-ed6d-4668-86b4-4b46695e370e" (UID: "6daa8654-ed6d-4668-86b4-4b46695e370e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:31:11.268963 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.268944    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-tmp-dir\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:31:11.269013 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.268968    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-home\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:31:11.269013 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.268983    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-model-cache\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:31:11.270604 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.270569    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6daa8654-ed6d-4668-86b4-4b46695e370e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6daa8654-ed6d-4668-86b4-4b46695e370e" (UID: "6daa8654-ed6d-4668-86b4-4b46695e370e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:31:11.270604 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.270591    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-dshm" (OuterVolumeSpecName: "dshm") pod "6daa8654-ed6d-4668-86b4-4b46695e370e" (UID: "6daa8654-ed6d-4668-86b4-4b46695e370e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:31:11.270873 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.270852    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6daa8654-ed6d-4668-86b4-4b46695e370e-kube-api-access-t4cgt" (OuterVolumeSpecName: "kube-api-access-t4cgt") pod "6daa8654-ed6d-4668-86b4-4b46695e370e" (UID: "6daa8654-ed6d-4668-86b4-4b46695e370e"). InnerVolumeSpecName "kube-api-access-t4cgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:31:11.370056 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.370022    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6daa8654-ed6d-4668-86b4-4b46695e370e-dshm\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:31:11.370056 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.370054    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4cgt\" (UniqueName: \"kubernetes.io/projected/6daa8654-ed6d-4668-86b4-4b46695e370e-kube-api-access-t4cgt\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:31:11.370242 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.370068    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6daa8654-ed6d-4668-86b4-4b46695e370e-tls-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:31:11.702167 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.702115    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6" podUID="a2cd7d70-ee64-4417-8fa7-7772499e9660" containerName="main" containerID="cri-o://400745b86014c3006f1ffb9236eba042e42fabbf5412a73fdf57be1a0910f738" gracePeriod=45
Aug 04 11:31:11.942822 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.942793    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:31:11.975445 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.975339    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-dshm\") pod \"a2cd7d70-ee64-4417-8fa7-7772499e9660\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") "
Aug 04 11:31:11.975445 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.975410    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gv8s\" (UniqueName: \"kubernetes.io/projected/a2cd7d70-ee64-4417-8fa7-7772499e9660-kube-api-access-9gv8s\") pod \"a2cd7d70-ee64-4417-8fa7-7772499e9660\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") "
Aug 04 11:31:11.976016 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.975483    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-model-cache\") pod \"a2cd7d70-ee64-4417-8fa7-7772499e9660\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") "
Aug 04 11:31:11.976016 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.975542    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-tmp-dir\") pod \"a2cd7d70-ee64-4417-8fa7-7772499e9660\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") "
Aug 04 11:31:11.976016 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.975568    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-home\") pod \"a2cd7d70-ee64-4417-8fa7-7772499e9660\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") "
Aug 04 11:31:11.976016 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.975614    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2cd7d70-ee64-4417-8fa7-7772499e9660-tls-certs\") pod \"a2cd7d70-ee64-4417-8fa7-7772499e9660\" (UID: \"a2cd7d70-ee64-4417-8fa7-7772499e9660\") "
Aug 04 11:31:11.976016 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.975959    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-model-cache" (OuterVolumeSpecName: "model-cache") pod "a2cd7d70-ee64-4417-8fa7-7772499e9660" (UID: "a2cd7d70-ee64-4417-8fa7-7772499e9660"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:31:11.976556 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.976394    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a2cd7d70-ee64-4417-8fa7-7772499e9660" (UID: "a2cd7d70-ee64-4417-8fa7-7772499e9660"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:31:11.976816 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.976770    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-home" (OuterVolumeSpecName: "home") pod "a2cd7d70-ee64-4417-8fa7-7772499e9660" (UID: "a2cd7d70-ee64-4417-8fa7-7772499e9660"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:31:11.979153 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.979127    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2cd7d70-ee64-4417-8fa7-7772499e9660-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a2cd7d70-ee64-4417-8fa7-7772499e9660" (UID: "a2cd7d70-ee64-4417-8fa7-7772499e9660"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:31:11.980099 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.980073    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2cd7d70-ee64-4417-8fa7-7772499e9660-kube-api-access-9gv8s" (OuterVolumeSpecName: "kube-api-access-9gv8s") pod "a2cd7d70-ee64-4417-8fa7-7772499e9660" (UID: "a2cd7d70-ee64-4417-8fa7-7772499e9660"). InnerVolumeSpecName "kube-api-access-9gv8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:31:11.980322 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:11.980294    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-dshm" (OuterVolumeSpecName: "dshm") pod "a2cd7d70-ee64-4417-8fa7-7772499e9660" (UID: "a2cd7d70-ee64-4417-8fa7-7772499e9660"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:31:12.008735 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.008691    2559 generic.go:356] "Generic (PLEG): container finished" podID="6daa8654-ed6d-4668-86b4-4b46695e370e" containerID="f280529898691e348b78ae435e620ea81d4cda2602183533afb224272624e419" exitCode=0
Aug 04 11:31:12.008882 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.008741    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp" event={"ID":"6daa8654-ed6d-4668-86b4-4b46695e370e","Type":"ContainerDied","Data":"f280529898691e348b78ae435e620ea81d4cda2602183533afb224272624e419"}
Aug 04 11:31:12.008882 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.008797    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp" event={"ID":"6daa8654-ed6d-4668-86b4-4b46695e370e","Type":"ContainerDied","Data":"8a0d0520a66fe64cc7e5fc21be5cbb3841632f04b36b02e373aed60e5af05fb1"}
Aug 04 11:31:12.008882 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.008755    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"
Aug 04 11:31:12.008882 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.008816    2559 scope.go:117] "RemoveContainer" containerID="f280529898691e348b78ae435e620ea81d4cda2602183533afb224272624e419"
Aug 04 11:31:12.010723 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.010692    2559 generic.go:356] "Generic (PLEG): container finished" podID="a2cd7d70-ee64-4417-8fa7-7772499e9660" containerID="400745b86014c3006f1ffb9236eba042e42fabbf5412a73fdf57be1a0910f738" exitCode=0
Aug 04 11:31:12.010845 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.010734    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6" event={"ID":"a2cd7d70-ee64-4417-8fa7-7772499e9660","Type":"ContainerDied","Data":"400745b86014c3006f1ffb9236eba042e42fabbf5412a73fdf57be1a0910f738"}
Aug 04 11:31:12.010845 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.010751    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"
Aug 04 11:31:12.010845 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.010765    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6" event={"ID":"a2cd7d70-ee64-4417-8fa7-7772499e9660","Type":"ContainerDied","Data":"6240762ca0fb9ccd71211b91d835eb7127da0c890d93e6784d7758acbbb7e205"}
Aug 04 11:31:12.017920 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.017814    2559 scope.go:117] "RemoveContainer" containerID="f280529898691e348b78ae435e620ea81d4cda2602183533afb224272624e419"
Aug 04 11:31:12.018267 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:31:12.018238    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f280529898691e348b78ae435e620ea81d4cda2602183533afb224272624e419\": container with ID starting with f280529898691e348b78ae435e620ea81d4cda2602183533afb224272624e419 not found: ID does not exist" containerID="f280529898691e348b78ae435e620ea81d4cda2602183533afb224272624e419"
Aug 04 11:31:12.018347 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.018280    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f280529898691e348b78ae435e620ea81d4cda2602183533afb224272624e419"} err="failed to get container status \"f280529898691e348b78ae435e620ea81d4cda2602183533afb224272624e419\": rpc error: code = NotFound desc = could not find container \"f280529898691e348b78ae435e620ea81d4cda2602183533afb224272624e419\": container with ID starting with f280529898691e348b78ae435e620ea81d4cda2602183533afb224272624e419 not found: ID does not exist"
Aug 04 11:31:12.018347 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.018297    2559 scope.go:117] "RemoveContainer" containerID="400745b86014c3006f1ffb9236eba042e42fabbf5412a73fdf57be1a0910f738"
Aug 04 11:31:12.025512 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.025498    2559 scope.go:117] "RemoveContainer" containerID="400745b86014c3006f1ffb9236eba042e42fabbf5412a73fdf57be1a0910f738"
Aug 04 11:31:12.025751 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:31:12.025732    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"400745b86014c3006f1ffb9236eba042e42fabbf5412a73fdf57be1a0910f738\": container with ID starting with 400745b86014c3006f1ffb9236eba042e42fabbf5412a73fdf57be1a0910f738 not found: ID does not exist" containerID="400745b86014c3006f1ffb9236eba042e42fabbf5412a73fdf57be1a0910f738"
Aug 04 11:31:12.025821 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.025761    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"400745b86014c3006f1ffb9236eba042e42fabbf5412a73fdf57be1a0910f738"} err="failed to get container status \"400745b86014c3006f1ffb9236eba042e42fabbf5412a73fdf57be1a0910f738\": rpc error: code = NotFound desc = could not find container \"400745b86014c3006f1ffb9236eba042e42fabbf5412a73fdf57be1a0910f738\": container with ID starting with 400745b86014c3006f1ffb9236eba042e42fabbf5412a73fdf57be1a0910f738 not found: ID does not exist"
Aug 04 11:31:12.028343 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.028322    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"]
Aug 04 11:31:12.032458 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.032439    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ed8ca8/auth-test-model-ed8ca8-kserve-556f96f79-jzdlp"]
Aug 04 11:31:12.041288 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.041258    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"]
Aug 04 11:31:12.042874 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.042854    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c74755/auth-test-model-c74755-kserve-7b6cd9c5f9-5nts6"]
Aug 04 11:31:12.076739 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.076720    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-model-cache\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:31:12.076739 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.076738    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-tmp-dir\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:31:12.076845 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.076746    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-home\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:31:12.076845 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.076754    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2cd7d70-ee64-4417-8fa7-7772499e9660-tls-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:31:12.076845 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.076764    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2cd7d70-ee64-4417-8fa7-7772499e9660-dshm\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:31:12.076845 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:12.076771    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gv8s\" (UniqueName: \"kubernetes.io/projected/a2cd7d70-ee64-4417-8fa7-7772499e9660-kube-api-access-9gv8s\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:31:13.780634 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:13.780596    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6daa8654-ed6d-4668-86b4-4b46695e370e" path="/var/lib/kubelet/pods/6daa8654-ed6d-4668-86b4-4b46695e370e/volumes"
Aug 04 11:31:13.781043 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:13.780986    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2cd7d70-ee64-4417-8fa7-7772499e9660" path="/var/lib/kubelet/pods/a2cd7d70-ee64-4417-8fa7-7772499e9660/volumes"
Aug 04 11:31:50.066258 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.066214    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"]
Aug 04 11:31:50.066749 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.066563    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6daa8654-ed6d-4668-86b4-4b46695e370e" containerName="main"
Aug 04 11:31:50.066749 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.066575    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6daa8654-ed6d-4668-86b4-4b46695e370e" containerName="main"
Aug 04 11:31:50.066749 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.066583    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2cd7d70-ee64-4417-8fa7-7772499e9660" containerName="main"
Aug 04 11:31:50.066749 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.066589    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2cd7d70-ee64-4417-8fa7-7772499e9660" containerName="main"
Aug 04 11:31:50.066749 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.066662    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2cd7d70-ee64-4417-8fa7-7772499e9660" containerName="main"
Aug 04 11:31:50.066749 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.066670    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6daa8654-ed6d-4668-86b4-4b46695e370e" containerName="main"
Aug 04 11:31:50.069441 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.069426    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.072782 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.072760    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c74755\"/\"default-dockercfg-db5hm\""
Aug 04 11:31:50.072908 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.072780    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c74755\"/\"sub-test-model-c74755-kserve-self-signed-certs\""
Aug 04 11:31:50.072908 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.072789    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c74755\"/\"openshift-service-ca.crt\""
Aug 04 11:31:50.072908 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.072793    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c74755\"/\"kube-root-ca.crt\""
Aug 04 11:31:50.078050 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.078026    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"]
Aug 04 11:31:50.197944 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.197922    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-tmp-dir\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.198077 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.197956    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-dshm\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.198077 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.197976    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-home\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.198077 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.197998    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpkls\" (UniqueName: \"kubernetes.io/projected/6d057b04-7c38-4195-9891-cb7a9b06e732-kube-api-access-rpkls\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.198247 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.198145    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-model-cache\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.198247 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.198179    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d057b04-7c38-4195-9891-cb7a9b06e732-tls-certs\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.298856 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.298820    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-model-cache\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.298856 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.298856    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d057b04-7c38-4195-9891-cb7a9b06e732-tls-certs\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.299081 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.298895    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-tmp-dir\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.299081 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.298917    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-dshm\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.299081 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.298933    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-home\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.299081 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.298953    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpkls\" (UniqueName: \"kubernetes.io/projected/6d057b04-7c38-4195-9891-cb7a9b06e732-kube-api-access-rpkls\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.299287 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.299232    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-model-cache\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.299343 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.299277    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-tmp-dir\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.299343 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.299313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-home\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.301263 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.301244    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-dshm\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.301628 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.301606    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d057b04-7c38-4195-9891-cb7a9b06e732-tls-certs\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.307444 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.307426    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpkls\" (UniqueName: \"kubernetes.io/projected/6d057b04-7c38-4195-9891-cb7a9b06e732-kube-api-access-rpkls\") pod \"sub-test-model-c74755-kserve-7f476c9945-748hh\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") " pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.379151 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.379125    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:31:50.513395 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:50.513334    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"]
Aug 04 11:31:50.516011 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:31:50.515982    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d057b04_7c38_4195_9891_cb7a9b06e732.slice/crio-7cadb001f6ed8835b30bee0507d216e70bb3ea3e424dc904d5427a41dd31c9f2 WatchSource:0}: Error finding container 7cadb001f6ed8835b30bee0507d216e70bb3ea3e424dc904d5427a41dd31c9f2: Status 404 returned error can't find the container with id 7cadb001f6ed8835b30bee0507d216e70bb3ea3e424dc904d5427a41dd31c9f2
Aug 04 11:31:51.189246 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:51.189209    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh" event={"ID":"6d057b04-7c38-4195-9891-cb7a9b06e732","Type":"ContainerStarted","Data":"f8025c2ced7a088375c4f44a52f383b072cdc2cea746442d5ff1630384b2c8ec"}
Aug 04 11:31:51.189676 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:51.189255    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh" event={"ID":"6d057b04-7c38-4195-9891-cb7a9b06e732","Type":"ContainerStarted","Data":"7cadb001f6ed8835b30bee0507d216e70bb3ea3e424dc904d5427a41dd31c9f2"}
Aug 04 11:31:51.204501 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:31:51.204446    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh" podStartSLOduration=1.204429881 podStartE2EDuration="1.204429881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:31:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:31:51.203024723 +0000 UTC m=+3301.929095056" watchObservedRunningTime="2026-08-04 11:31:51.204429881 +0000 UTC m=+3301.930500215"
Aug 04 11:32:00.380092 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:32:00.380060    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:32:00.380523 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:32:00.380118    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:32:00.392266 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:32:00.392245    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:32:01.250499 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:32:01.250472    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:32:58.380886 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:32:58.380852    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"]
Aug 04 11:33:10.778068 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.778027    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"]
Aug 04 11:33:10.781046 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.781029    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.784425 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.784402    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ed8ca8\"/\"default-dockercfg-855th\""
Aug 04 11:33:10.784539 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.784439    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ed8ca8\"/\"openshift-service-ca.crt\""
Aug 04 11:33:10.784539 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.784487    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ed8ca8\"/\"rate-test-model-ed8ca8-kserve-self-signed-certs\""
Aug 04 11:33:10.784655 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.784540    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ed8ca8\"/\"kube-root-ca.crt\""
Aug 04 11:33:10.791367 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.791346    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"]
Aug 04 11:33:10.863628 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.863596    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ef47e97-2213-401c-bf47-2dc343b56c2d-tls-certs\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.863792 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.863659    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-tmp-dir\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.863792 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.863676    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp2j4\" (UniqueName: \"kubernetes.io/projected/4ef47e97-2213-401c-bf47-2dc343b56c2d-kube-api-access-wp2j4\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.863792 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.863731    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-model-cache\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.863918 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.863814    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-dshm\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.863918 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.863856    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-home\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.964991 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.964956    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ef47e97-2213-401c-bf47-2dc343b56c2d-tls-certs\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.965191 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.965008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-tmp-dir\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.965191 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.965033    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp2j4\" (UniqueName: \"kubernetes.io/projected/4ef47e97-2213-401c-bf47-2dc343b56c2d-kube-api-access-wp2j4\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.965191 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.965069    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-model-cache\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.965191 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.965133    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-dshm\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.965191 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.965173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-home\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.965476 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.965455    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-tmp-dir\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.965545 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.965531    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-model-cache\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.965652 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.965619    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-home\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.967423 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.967403    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-dshm\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.967571 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.967554    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ef47e97-2213-401c-bf47-2dc343b56c2d-tls-certs\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:10.974223 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:10.974200    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp2j4\" (UniqueName: \"kubernetes.io/projected/4ef47e97-2213-401c-bf47-2dc343b56c2d-kube-api-access-wp2j4\") pod \"rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") " pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:11.090405 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:11.090334    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:11.235100 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:11.235070    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"]
Aug 04 11:33:11.238403 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:33:11.238377    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ef47e97_2213_401c_bf47_2dc343b56c2d.slice/crio-08e47c55c65a2dc2463ee908f615aecc29694d601ee4789aa9b52956edad3297 WatchSource:0}: Error finding container 08e47c55c65a2dc2463ee908f615aecc29694d601ee4789aa9b52956edad3297: Status 404 returned error can't find the container with id 08e47c55c65a2dc2463ee908f615aecc29694d601ee4789aa9b52956edad3297
Aug 04 11:33:11.563298 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:11.563264    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m" event={"ID":"4ef47e97-2213-401c-bf47-2dc343b56c2d","Type":"ContainerStarted","Data":"6aaac2f3417801bd287e4246889ecb94a5ace46ca1cc9a4c826f13255dc17585"}
Aug 04 11:33:11.563298 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:11.563303    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m" event={"ID":"4ef47e97-2213-401c-bf47-2dc343b56c2d","Type":"ContainerStarted","Data":"08e47c55c65a2dc2463ee908f615aecc29694d601ee4789aa9b52956edad3297"}
Aug 04 11:33:11.582042 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:11.581997    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m" podStartSLOduration=1.581982499 podStartE2EDuration="1.581982499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:33:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:11.580956028 +0000 UTC m=+3382.307026362" watchObservedRunningTime="2026-08-04 11:33:11.581982499 +0000 UTC m=+3382.308052832"
Aug 04 11:33:13.399564 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.399516    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh" podUID="6d057b04-7c38-4195-9891-cb7a9b06e732" containerName="main" containerID="cri-o://f8025c2ced7a088375c4f44a52f383b072cdc2cea746442d5ff1630384b2c8ec" gracePeriod=45
Aug 04 11:33:13.575965 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.575937    2559 generic.go:356] "Generic (PLEG): container finished" podID="6d057b04-7c38-4195-9891-cb7a9b06e732" containerID="f8025c2ced7a088375c4f44a52f383b072cdc2cea746442d5ff1630384b2c8ec" exitCode=0
Aug 04 11:33:13.576098 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.576004    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh" event={"ID":"6d057b04-7c38-4195-9891-cb7a9b06e732","Type":"ContainerDied","Data":"f8025c2ced7a088375c4f44a52f383b072cdc2cea746442d5ff1630384b2c8ec"}
Aug 04 11:33:13.651344 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.651267    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:33:13.689323 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.689286    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-tmp-dir\") pod \"6d057b04-7c38-4195-9891-cb7a9b06e732\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") "
Aug 04 11:33:13.689483 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.689428    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d057b04-7c38-4195-9891-cb7a9b06e732-tls-certs\") pod \"6d057b04-7c38-4195-9891-cb7a9b06e732\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") "
Aug 04 11:33:13.689483 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.689458    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-home\") pod \"6d057b04-7c38-4195-9891-cb7a9b06e732\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") "
Aug 04 11:33:13.689595 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.689484    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-dshm\") pod \"6d057b04-7c38-4195-9891-cb7a9b06e732\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") "
Aug 04 11:33:13.689595 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.689517    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-model-cache\") pod \"6d057b04-7c38-4195-9891-cb7a9b06e732\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") "
Aug 04 11:33:13.689595 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.689531    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6d057b04-7c38-4195-9891-cb7a9b06e732" (UID: "6d057b04-7c38-4195-9891-cb7a9b06e732"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:33:13.689595 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.689567    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpkls\" (UniqueName: \"kubernetes.io/projected/6d057b04-7c38-4195-9891-cb7a9b06e732-kube-api-access-rpkls\") pod \"6d057b04-7c38-4195-9891-cb7a9b06e732\" (UID: \"6d057b04-7c38-4195-9891-cb7a9b06e732\") "
Aug 04 11:33:13.689862 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.689839    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-home" (OuterVolumeSpecName: "home") pod "6d057b04-7c38-4195-9891-cb7a9b06e732" (UID: "6d057b04-7c38-4195-9891-cb7a9b06e732"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:33:13.689935 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.689861    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-tmp-dir\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:33:13.689935 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.689800    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-model-cache" (OuterVolumeSpecName: "model-cache") pod "6d057b04-7c38-4195-9891-cb7a9b06e732" (UID: "6d057b04-7c38-4195-9891-cb7a9b06e732"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:33:13.691731 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.691699    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-dshm" (OuterVolumeSpecName: "dshm") pod "6d057b04-7c38-4195-9891-cb7a9b06e732" (UID: "6d057b04-7c38-4195-9891-cb7a9b06e732"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:33:13.691843 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.691783    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d057b04-7c38-4195-9891-cb7a9b06e732-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6d057b04-7c38-4195-9891-cb7a9b06e732" (UID: "6d057b04-7c38-4195-9891-cb7a9b06e732"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:33:13.691896 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.691875    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d057b04-7c38-4195-9891-cb7a9b06e732-kube-api-access-rpkls" (OuterVolumeSpecName: "kube-api-access-rpkls") pod "6d057b04-7c38-4195-9891-cb7a9b06e732" (UID: "6d057b04-7c38-4195-9891-cb7a9b06e732"). InnerVolumeSpecName "kube-api-access-rpkls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:33:13.790481 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.790457    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpkls\" (UniqueName: \"kubernetes.io/projected/6d057b04-7c38-4195-9891-cb7a9b06e732-kube-api-access-rpkls\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:33:13.790481 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.790482    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d057b04-7c38-4195-9891-cb7a9b06e732-tls-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:33:13.790655 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.790492    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-home\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:33:13.790655 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.790499    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-dshm\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:33:13.790655 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:13.790509    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d057b04-7c38-4195-9891-cb7a9b06e732-model-cache\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:33:14.582742 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:14.582706    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh" event={"ID":"6d057b04-7c38-4195-9891-cb7a9b06e732","Type":"ContainerDied","Data":"7cadb001f6ed8835b30bee0507d216e70bb3ea3e424dc904d5427a41dd31c9f2"}
Aug 04 11:33:14.582742 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:14.582729    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"
Aug 04 11:33:14.583296 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:14.582758    2559 scope.go:117] "RemoveContainer" containerID="f8025c2ced7a088375c4f44a52f383b072cdc2cea746442d5ff1630384b2c8ec"
Aug 04 11:33:14.600935 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:14.600909    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"]
Aug 04 11:33:14.605490 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:14.605464    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c74755/sub-test-model-c74755-kserve-7f476c9945-748hh"]
Aug 04 11:33:15.781136 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:15.781100    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d057b04-7c38-4195-9891-cb7a9b06e732" path="/var/lib/kubelet/pods/6d057b04-7c38-4195-9891-cb7a9b06e732/volumes"
Aug 04 11:33:21.091491 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:21.091455    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:21.091491 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:21.091499    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:21.104041 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:21.104018    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:21.627069 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:21.627032    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:33:48.877598 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.877509    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"]
Aug 04 11:33:48.878055 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.877874    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d057b04-7c38-4195-9891-cb7a9b06e732" containerName="main"
Aug 04 11:33:48.878055 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.877887    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d057b04-7c38-4195-9891-cb7a9b06e732" containerName="main"
Aug 04 11:33:48.878055 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.877952    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d057b04-7c38-4195-9891-cb7a9b06e732" containerName="main"
Aug 04 11:33:48.880457 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.880441    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:48.882826 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.882808    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c74755\"/\"kube-root-ca.crt\""
Aug 04 11:33:48.883546 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.883527    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c74755\"/\"openshift-service-ca.crt\""
Aug 04 11:33:48.883633 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.883588    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c74755\"/\"default-dockercfg-db5hm\""
Aug 04 11:33:48.883633 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.883588    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c74755\"/\"rate-test-model-c74755-kserve-self-signed-certs\""
Aug 04 11:33:48.891163 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.891144    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"]
Aug 04 11:33:48.978890 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.978861    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-model-cache\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:48.979009 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.978904    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-tmp-dir\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:48.979009 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.978925    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f737475-aadc-405a-a7b8-cc47730f0c88-tls-certs\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:48.979087 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.979004    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-home\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:48.979087 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.979033    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-dshm\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:48.979087 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:48.979065    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gbfh\" (UniqueName: \"kubernetes.io/projected/1f737475-aadc-405a-a7b8-cc47730f0c88-kube-api-access-4gbfh\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:49.080541 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.080474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-model-cache\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:49.080541 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.080545    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-tmp-dir\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:49.080929 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.080581    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f737475-aadc-405a-a7b8-cc47730f0c88-tls-certs\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:49.080929 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.080621    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-home\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:49.080929 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.080662    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-dshm\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:49.080929 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.080699    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gbfh\" (UniqueName: \"kubernetes.io/projected/1f737475-aadc-405a-a7b8-cc47730f0c88-kube-api-access-4gbfh\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:49.081459 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.081433    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-home\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:49.081739 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.081716    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-model-cache\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:49.082043 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.081802    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-tmp-dir\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:49.084052 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.084030    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f737475-aadc-405a-a7b8-cc47730f0c88-tls-certs\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:49.084237 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.084220    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-dshm\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:49.089374 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.089354    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gbfh\" (UniqueName: \"kubernetes.io/projected/1f737475-aadc-405a-a7b8-cc47730f0c88-kube-api-access-4gbfh\") pod \"rate-test-model-c74755-kserve-6f9d8f8c99-9rlss\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") " pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:49.189838 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.189765    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:49.318804 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.318778    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"]
Aug 04 11:33:49.321310 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:33:49.321281    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f737475_aadc_405a_a7b8_cc47730f0c88.slice/crio-59652d65ff647183b0b7ea956af1bcf0401fba4f3d1457679d149b99393953f1 WatchSource:0}: Error finding container 59652d65ff647183b0b7ea956af1bcf0401fba4f3d1457679d149b99393953f1: Status 404 returned error can't find the container with id 59652d65ff647183b0b7ea956af1bcf0401fba4f3d1457679d149b99393953f1
Aug 04 11:33:49.743397 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.743367    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss" event={"ID":"1f737475-aadc-405a-a7b8-cc47730f0c88","Type":"ContainerStarted","Data":"9be5d5123c5af838861299c7269d6492faf6a59066aaddce347926eeda6292f8"}
Aug 04 11:33:49.743559 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.743405    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss" event={"ID":"1f737475-aadc-405a-a7b8-cc47730f0c88","Type":"ContainerStarted","Data":"59652d65ff647183b0b7ea956af1bcf0401fba4f3d1457679d149b99393953f1"}
Aug 04 11:33:49.762758 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:49.762714    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss" podStartSLOduration=1.76269998 podStartE2EDuration="1.76269998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:33:49.760307342 +0000 UTC m=+3420.486377675" watchObservedRunningTime="2026-08-04 11:33:49.76269998 +0000 UTC m=+3420.488770312"
Aug 04 11:33:59.190773 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:59.190737    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:59.191252 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:59.190792    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:59.203034 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:59.203010    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:33:59.795723 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:33:59.795694    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:35:21.299314 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:21.299219    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"]
Aug 04 11:35:22.050724 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:22.050693    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"]
Aug 04 11:35:36.317550 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.317495    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m" podUID="4ef47e97-2213-401c-bf47-2dc343b56c2d" containerName="main" containerID="cri-o://6aaac2f3417801bd287e4246889ecb94a5ace46ca1cc9a4c826f13255dc17585" gracePeriod=45
Aug 04 11:35:36.571035 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.570980    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:35:36.696450 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.696422    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-home\") pod \"4ef47e97-2213-401c-bf47-2dc343b56c2d\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") "
Aug 04 11:35:36.696608 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.696490    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp2j4\" (UniqueName: \"kubernetes.io/projected/4ef47e97-2213-401c-bf47-2dc343b56c2d-kube-api-access-wp2j4\") pod \"4ef47e97-2213-401c-bf47-2dc343b56c2d\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") "
Aug 04 11:35:36.696608 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.696514    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-model-cache\") pod \"4ef47e97-2213-401c-bf47-2dc343b56c2d\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") "
Aug 04 11:35:36.696608 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.696532    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-tmp-dir\") pod \"4ef47e97-2213-401c-bf47-2dc343b56c2d\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") "
Aug 04 11:35:36.696608 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.696556    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-dshm\") pod \"4ef47e97-2213-401c-bf47-2dc343b56c2d\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") "
Aug 04 11:35:36.696608 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.696587    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ef47e97-2213-401c-bf47-2dc343b56c2d-tls-certs\") pod \"4ef47e97-2213-401c-bf47-2dc343b56c2d\" (UID: \"4ef47e97-2213-401c-bf47-2dc343b56c2d\") "
Aug 04 11:35:36.696900 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.696712    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-home" (OuterVolumeSpecName: "home") pod "4ef47e97-2213-401c-bf47-2dc343b56c2d" (UID: "4ef47e97-2213-401c-bf47-2dc343b56c2d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:35:36.696900 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.696824    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-model-cache" (OuterVolumeSpecName: "model-cache") pod "4ef47e97-2213-401c-bf47-2dc343b56c2d" (UID: "4ef47e97-2213-401c-bf47-2dc343b56c2d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:35:36.696900 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.696846    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4ef47e97-2213-401c-bf47-2dc343b56c2d" (UID: "4ef47e97-2213-401c-bf47-2dc343b56c2d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:35:36.697025 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.696913    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-home\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:35:36.697025 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.696931    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-model-cache\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:35:36.698860 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.698838    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ef47e97-2213-401c-bf47-2dc343b56c2d-kube-api-access-wp2j4" (OuterVolumeSpecName: "kube-api-access-wp2j4") pod "4ef47e97-2213-401c-bf47-2dc343b56c2d" (UID: "4ef47e97-2213-401c-bf47-2dc343b56c2d"). InnerVolumeSpecName "kube-api-access-wp2j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:35:36.698947 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.698864    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-dshm" (OuterVolumeSpecName: "dshm") pod "4ef47e97-2213-401c-bf47-2dc343b56c2d" (UID: "4ef47e97-2213-401c-bf47-2dc343b56c2d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:35:36.698947 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.698921    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef47e97-2213-401c-bf47-2dc343b56c2d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4ef47e97-2213-401c-bf47-2dc343b56c2d" (UID: "4ef47e97-2213-401c-bf47-2dc343b56c2d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:35:36.798047 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.798014    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp2j4\" (UniqueName: \"kubernetes.io/projected/4ef47e97-2213-401c-bf47-2dc343b56c2d-kube-api-access-wp2j4\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:35:36.798047 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.798047    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-tmp-dir\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:35:36.798047 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.798056    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ef47e97-2213-401c-bf47-2dc343b56c2d-dshm\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:35:36.798217 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:36.798064    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ef47e97-2213-401c-bf47-2dc343b56c2d-tls-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:35:37.069312 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.069259    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss" podUID="1f737475-aadc-405a-a7b8-cc47730f0c88" containerName="main" containerID="cri-o://9be5d5123c5af838861299c7269d6492faf6a59066aaddce347926eeda6292f8" gracePeriod=45
Aug 04 11:35:37.228975 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.228943    2559 generic.go:356] "Generic (PLEG): container finished" podID="1f737475-aadc-405a-a7b8-cc47730f0c88" containerID="9be5d5123c5af838861299c7269d6492faf6a59066aaddce347926eeda6292f8" exitCode=0
Aug 04 11:35:37.229151 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.229014    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss" event={"ID":"1f737475-aadc-405a-a7b8-cc47730f0c88","Type":"ContainerDied","Data":"9be5d5123c5af838861299c7269d6492faf6a59066aaddce347926eeda6292f8"}
Aug 04 11:35:37.230408 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.230383    2559 generic.go:356] "Generic (PLEG): container finished" podID="4ef47e97-2213-401c-bf47-2dc343b56c2d" containerID="6aaac2f3417801bd287e4246889ecb94a5ace46ca1cc9a4c826f13255dc17585" exitCode=0
Aug 04 11:35:37.230533 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.230444    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"
Aug 04 11:35:37.230533 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.230475    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m" event={"ID":"4ef47e97-2213-401c-bf47-2dc343b56c2d","Type":"ContainerDied","Data":"6aaac2f3417801bd287e4246889ecb94a5ace46ca1cc9a4c826f13255dc17585"}
Aug 04 11:35:37.230533 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.230522    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m" event={"ID":"4ef47e97-2213-401c-bf47-2dc343b56c2d","Type":"ContainerDied","Data":"08e47c55c65a2dc2463ee908f615aecc29694d601ee4789aa9b52956edad3297"}
Aug 04 11:35:37.230717 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.230546    2559 scope.go:117] "RemoveContainer" containerID="6aaac2f3417801bd287e4246889ecb94a5ace46ca1cc9a4c826f13255dc17585"
Aug 04 11:35:37.241679 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.241626    2559 scope.go:117] "RemoveContainer" containerID="6aaac2f3417801bd287e4246889ecb94a5ace46ca1cc9a4c826f13255dc17585"
Aug 04 11:35:37.242258 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:35:37.242160    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aaac2f3417801bd287e4246889ecb94a5ace46ca1cc9a4c826f13255dc17585\": container with ID starting with 6aaac2f3417801bd287e4246889ecb94a5ace46ca1cc9a4c826f13255dc17585 not found: ID does not exist" containerID="6aaac2f3417801bd287e4246889ecb94a5ace46ca1cc9a4c826f13255dc17585"
Aug 04 11:35:37.242258 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.242196    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aaac2f3417801bd287e4246889ecb94a5ace46ca1cc9a4c826f13255dc17585"} err="failed to get container status \"6aaac2f3417801bd287e4246889ecb94a5ace46ca1cc9a4c826f13255dc17585\": rpc error: code = NotFound desc = could not find container \"6aaac2f3417801bd287e4246889ecb94a5ace46ca1cc9a4c826f13255dc17585\": container with ID starting with 6aaac2f3417801bd287e4246889ecb94a5ace46ca1cc9a4c826f13255dc17585 not found: ID does not exist"
Aug 04 11:35:37.257465 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.257441    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"]
Aug 04 11:35:37.261567 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.261546    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ed8ca8/rate-test-model-ed8ca8-kserve-59ccbc6f95-fh28m"]
Aug 04 11:35:37.303553 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.303532    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:35:37.404500 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.404476    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-tmp-dir\") pod \"1f737475-aadc-405a-a7b8-cc47730f0c88\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") "
Aug 04 11:35:37.404901 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.404545    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-model-cache\") pod \"1f737475-aadc-405a-a7b8-cc47730f0c88\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") "
Aug 04 11:35:37.404901 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.404586    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gbfh\" (UniqueName: \"kubernetes.io/projected/1f737475-aadc-405a-a7b8-cc47730f0c88-kube-api-access-4gbfh\") pod \"1f737475-aadc-405a-a7b8-cc47730f0c88\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") "
Aug 04 11:35:37.404901 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.404608    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-dshm\") pod \"1f737475-aadc-405a-a7b8-cc47730f0c88\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") "
Aug 04 11:35:37.404901 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.404687    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f737475-aadc-405a-a7b8-cc47730f0c88-tls-certs\") pod \"1f737475-aadc-405a-a7b8-cc47730f0c88\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") "
Aug 04 11:35:37.404901 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.404704    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-home\") pod \"1f737475-aadc-405a-a7b8-cc47730f0c88\" (UID: \"1f737475-aadc-405a-a7b8-cc47730f0c88\") "
Aug 04 11:35:37.404901 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.404806    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1f737475-aadc-405a-a7b8-cc47730f0c88" (UID: "1f737475-aadc-405a-a7b8-cc47730f0c88"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:35:37.404901 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.404870    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-model-cache" (OuterVolumeSpecName: "model-cache") pod "1f737475-aadc-405a-a7b8-cc47730f0c88" (UID: "1f737475-aadc-405a-a7b8-cc47730f0c88"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:35:37.405212 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.404962    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-tmp-dir\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:35:37.405212 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.404981    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-model-cache\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:35:37.405212 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.405004    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-home" (OuterVolumeSpecName: "home") pod "1f737475-aadc-405a-a7b8-cc47730f0c88" (UID: "1f737475-aadc-405a-a7b8-cc47730f0c88"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:35:37.406833 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.406803    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-dshm" (OuterVolumeSpecName: "dshm") pod "1f737475-aadc-405a-a7b8-cc47730f0c88" (UID: "1f737475-aadc-405a-a7b8-cc47730f0c88"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:35:37.406947 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.406833    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f737475-aadc-405a-a7b8-cc47730f0c88-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1f737475-aadc-405a-a7b8-cc47730f0c88" (UID: "1f737475-aadc-405a-a7b8-cc47730f0c88"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 11:35:37.406947 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.406884    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f737475-aadc-405a-a7b8-cc47730f0c88-kube-api-access-4gbfh" (OuterVolumeSpecName: "kube-api-access-4gbfh") pod "1f737475-aadc-405a-a7b8-cc47730f0c88" (UID: "1f737475-aadc-405a-a7b8-cc47730f0c88"). InnerVolumeSpecName "kube-api-access-4gbfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:35:37.505454 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.505430    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f737475-aadc-405a-a7b8-cc47730f0c88-tls-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:35:37.505454 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.505450    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-home\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:35:37.505590 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.505459    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gbfh\" (UniqueName: \"kubernetes.io/projected/1f737475-aadc-405a-a7b8-cc47730f0c88-kube-api-access-4gbfh\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:35:37.505590 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.505467    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f737475-aadc-405a-a7b8-cc47730f0c88-dshm\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:35:37.780595 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:37.780570    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ef47e97-2213-401c-bf47-2dc343b56c2d" path="/var/lib/kubelet/pods/4ef47e97-2213-401c-bf47-2dc343b56c2d/volumes"
Aug 04 11:35:38.236696 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:38.236664    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss" event={"ID":"1f737475-aadc-405a-a7b8-cc47730f0c88","Type":"ContainerDied","Data":"59652d65ff647183b0b7ea956af1bcf0401fba4f3d1457679d149b99393953f1"}
Aug 04 11:35:38.236696 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:38.236684    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"
Aug 04 11:35:38.236950 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:38.236712    2559 scope.go:117] "RemoveContainer" containerID="9be5d5123c5af838861299c7269d6492faf6a59066aaddce347926eeda6292f8"
Aug 04 11:35:38.253227 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:38.253200    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"]
Aug 04 11:35:38.257595 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:38.257573    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c74755/rate-test-model-c74755-kserve-6f9d8f8c99-9rlss"]
Aug 04 11:35:39.786285 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:39.786244    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f737475-aadc-405a-a7b8-cc47730f0c88" path="/var/lib/kubelet/pods/1f737475-aadc-405a-a7b8-cc47730f0c88/volumes"
Aug 04 11:35:41.892907 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.892877    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"]
Aug 04 11:35:41.893293 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.893203    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f737475-aadc-405a-a7b8-cc47730f0c88" containerName="main"
Aug 04 11:35:41.893293 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.893215    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f737475-aadc-405a-a7b8-cc47730f0c88" containerName="main"
Aug 04 11:35:41.893293 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.893238    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef47e97-2213-401c-bf47-2dc343b56c2d" containerName="main"
Aug 04 11:35:41.893293 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.893243    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef47e97-2213-401c-bf47-2dc343b56c2d" containerName="main"
Aug 04 11:35:41.893293 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.893296    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f737475-aadc-405a-a7b8-cc47730f0c88" containerName="main"
Aug 04 11:35:41.893467 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.893304    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef47e97-2213-401c-bf47-2dc343b56c2d" containerName="main"
Aug 04 11:35:41.897471 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.897456    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:41.900164 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.900146    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-e44431-openshift-default-dockercfg-lvdzt\""
Aug 04 11:35:41.935882 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.935852    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc9b21ad-14c4-464d-9581-3c116e823163-istiod-ca-cert\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:41.936046 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.935893    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvtgc\" (UniqueName: \"kubernetes.io/projected/bc9b21ad-14c4-464d-9581-3c116e823163-kube-api-access-vvtgc\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:41.936046 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.935954    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-istio-envoy\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:41.936046 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.935995    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc9b21ad-14c4-464d-9581-3c116e823163-istio-podinfo\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:41.936046 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.936023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc9b21ad-14c4-464d-9581-3c116e823163-istio-token\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:41.936265 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.936048    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-istio-data\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:41.936265 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.936096    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-workload-certs\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:41.936265 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.936138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-workload-socket\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:41.936265 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.936183    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-credential-socket\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:41.937234 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:41.937212    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"]
Aug 04 11:35:42.036902 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.036868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc9b21ad-14c4-464d-9581-3c116e823163-istiod-ca-cert\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.036902 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.036909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvtgc\" (UniqueName: \"kubernetes.io/projected/bc9b21ad-14c4-464d-9581-3c116e823163-kube-api-access-vvtgc\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.037182 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.036968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-istio-envoy\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.037182 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.037075    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc9b21ad-14c4-464d-9581-3c116e823163-istio-podinfo\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.037182 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.037114    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc9b21ad-14c4-464d-9581-3c116e823163-istio-token\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.037182 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.037136    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-istio-data\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.037182 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.037179    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-workload-certs\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.037452 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.037209    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-workload-socket\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.037452 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.037246    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-credential-socket\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.037551 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.037519    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-istio-data\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.037600 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.037555    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-workload-certs\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.037600 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.037591    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-workload-socket\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.037890 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.037628    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-credential-socket\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.037890 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.037691    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc9b21ad-14c4-464d-9581-3c116e823163-istiod-ca-cert\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.039391 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.039370    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-istio-envoy\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.039730 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.039708    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc9b21ad-14c4-464d-9581-3c116e823163-istio-podinfo\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.058136 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.058109    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc9b21ad-14c4-464d-9581-3c116e823163-istio-token\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.058473 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.058451    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvtgc\" (UniqueName: \"kubernetes.io/projected/bc9b21ad-14c4-464d-9581-3c116e823163-kube-api-access-vvtgc\") pod \"e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") " pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.207856 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.207780    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:42.348266 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.348243    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"]
Aug 04 11:35:42.349954 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:35:42.349922    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc9b21ad_14c4_464d_9581_3c116e823163.slice/crio-b59dc5b9c5c745a84f2611f47cbba25be78364fe1b3986e2ef064cbe200d94d2 WatchSource:0}: Error finding container b59dc5b9c5c745a84f2611f47cbba25be78364fe1b3986e2ef064cbe200d94d2: Status 404 returned error can't find the container with id b59dc5b9c5c745a84f2611f47cbba25be78364fe1b3986e2ef064cbe200d94d2
Aug 04 11:35:42.351972 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.351944    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:35:42.352038 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.352007    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:35:42.352073 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:42.352036    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:35:43.261881 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:43.261842    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck" event={"ID":"bc9b21ad-14c4-464d-9581-3c116e823163","Type":"ContainerStarted","Data":"fbff9e3fc06615ebcaeb2933973113b729d2a391c9ff156a20b48727550b86ab"}
Aug 04 11:35:43.262260 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:43.261906    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck" event={"ID":"bc9b21ad-14c4-464d-9581-3c116e823163","Type":"ContainerStarted","Data":"b59dc5b9c5c745a84f2611f47cbba25be78364fe1b3986e2ef064cbe200d94d2"}
Aug 04 11:35:43.296869 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:43.296829    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck" podStartSLOduration=2.296814403 podStartE2EDuration="2.296814403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:35:43.295009294 +0000 UTC m=+3534.021079628" watchObservedRunningTime="2026-08-04 11:35:43.296814403 +0000 UTC m=+3534.022884736"
Aug 04 11:35:44.208453 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:44.208420    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:44.213280 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:44.213252    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:44.266438 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:44.266403    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:44.267298 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:44.267282    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:35:59.271492 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:59.271372    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Aug 04 11:35:59.272120 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:59.272086    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck" podUID="bc9b21ad-14c4-464d-9581-3c116e823163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Aug 04 11:35:59.342419 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:59.342389    2559 generic.go:356] "Generic (PLEG): container finished" podID="bc9b21ad-14c4-464d-9581-3c116e823163" containerID="fbff9e3fc06615ebcaeb2933973113b729d2a391c9ff156a20b48727550b86ab" exitCode=0
Aug 04 11:35:59.342563 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:59.342460    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck" event={"ID":"bc9b21ad-14c4-464d-9581-3c116e823163","Type":"ContainerDied","Data":"fbff9e3fc06615ebcaeb2933973113b729d2a391c9ff156a20b48727550b86ab"}
Aug 04 11:35:59.342874 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:59.342858    2559 scope.go:117] "RemoveContainer" containerID="fbff9e3fc06615ebcaeb2933973113b729d2a391c9ff156a20b48727550b86ab"
Aug 04 11:35:59.343925 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:59.343901    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:35:59.343997 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:59.343965    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:35:59.344042 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:35:59.344001    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:36:00.349031 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:00.348996    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck" event={"ID":"bc9b21ad-14c4-464d-9581-3c116e823163","Type":"ContainerStarted","Data":"17c52ee7988c76650a014231d0a3993df7437f41a2e478df8ace281c6a248eb5"}
Aug 04 11:36:00.938665 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:00.938494    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"]
Aug 04 11:36:00.941388 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:00.941366    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:00.943719 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:00.943696    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-29b2ff-openshift-default-dockercfg-m4ttk\""
Aug 04 11:36:00.948351 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:00.948331    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"]
Aug 04 11:36:01.003275 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.003246    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-istio-envoy\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.003395 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.003278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/346bb938-589c-495c-88aa-4298b2a60350-istio-podinfo\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.003395 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.003305    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-istio-data\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.003395 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.003384    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-credential-socket\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.003496 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.003446    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-workload-certs\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.003496 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.003483    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/346bb938-589c-495c-88aa-4298b2a60350-istio-token\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.003801 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.003586    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-workload-socket\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.003801 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.003609    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/346bb938-589c-495c-88aa-4298b2a60350-istiod-ca-cert\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.003801 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.003624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gvrn\" (UniqueName: \"kubernetes.io/projected/346bb938-589c-495c-88aa-4298b2a60350-kube-api-access-6gvrn\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.104776 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.104746    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-workload-socket\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.104969 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.104782    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/346bb938-589c-495c-88aa-4298b2a60350-istiod-ca-cert\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.104969 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.104803    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gvrn\" (UniqueName: \"kubernetes.io/projected/346bb938-589c-495c-88aa-4298b2a60350-kube-api-access-6gvrn\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.104969 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.104844    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-istio-envoy\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.104969 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.104866    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/346bb938-589c-495c-88aa-4298b2a60350-istio-podinfo\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.104969 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.104899    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-istio-data\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.105221 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.104999    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-credential-socket\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.105221 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.105056    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-workload-certs\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.105221 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.105109    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/346bb938-589c-495c-88aa-4298b2a60350-istio-token\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.105378 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.105252    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-workload-socket\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.105438 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.105374    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-credential-socket\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.105479 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.105454    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-istio-data\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.105514 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.105488    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-workload-certs\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.105679 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.105659    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/346bb938-589c-495c-88aa-4298b2a60350-istiod-ca-cert\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.107541 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.107516    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-istio-envoy\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.107820 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.107794    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/346bb938-589c-495c-88aa-4298b2a60350-istio-podinfo\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.129125 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.129092    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/346bb938-589c-495c-88aa-4298b2a60350-istio-token\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.129652 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.129604    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gvrn\" (UniqueName: \"kubernetes.io/projected/346bb938-589c-495c-88aa-4298b2a60350-kube-api-access-6gvrn\") pod \"e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") " pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.208686 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.208572    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:36:01.208686 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.208619    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Aug 04 11:36:01.208896 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.208729    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck" podUID="bc9b21ad-14c4-464d-9581-3c116e823163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Aug 04 11:36:01.253276 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.253249    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:01.425669 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.424078    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"]
Aug 04 11:36:01.436889 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:36:01.436846    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346bb938_589c_495c_88aa_4298b2a60350.slice/crio-f03e7784c354c2b9c419b42a34ce1a663884d6fc70d982c49b60b4d450927d35 WatchSource:0}: Error finding container f03e7784c354c2b9c419b42a34ce1a663884d6fc70d982c49b60b4d450927d35: Status 404 returned error can't find the container with id f03e7784c354c2b9c419b42a34ce1a663884d6fc70d982c49b60b4d450927d35
Aug 04 11:36:01.439497 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.439466    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:36:01.439575 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.439544    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:36:01.439618 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:01.439576    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:36:02.208964 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:02.208929    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Aug 04 11:36:02.209237 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:02.209209    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck" podUID="bc9b21ad-14c4-464d-9581-3c116e823163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Aug 04 11:36:02.360948 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:02.360914    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz" event={"ID":"346bb938-589c-495c-88aa-4298b2a60350","Type":"ContainerStarted","Data":"098f7da59319e36e8855f234e06c9950f3bef369db6a6f4992f16f4852dc1f6e"}
Aug 04 11:36:02.361129 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:02.360972    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz" event={"ID":"346bb938-589c-495c-88aa-4298b2a60350","Type":"ContainerStarted","Data":"f03e7784c354c2b9c419b42a34ce1a663884d6fc70d982c49b60b4d450927d35"}
Aug 04 11:36:02.390680 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:02.390617    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz" podStartSLOduration=2.390604278 podStartE2EDuration="2.390604278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:36:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:36:02.387981997 +0000 UTC m=+3553.114052331" watchObservedRunningTime="2026-08-04 11:36:02.390604278 +0000 UTC m=+3553.116674685"
Aug 04 11:36:03.208964 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:03.208923    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Aug 04 11:36:03.209462 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:03.208999    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck" podUID="bc9b21ad-14c4-464d-9581-3c116e823163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Aug 04 11:36:03.253711 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:03.253676    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:03.258648 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:03.258613    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:03.365410 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:03.365378    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:03.366442 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:03.366422    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:04.208489 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:04.208448    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Aug 04 11:36:04.208725 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:04.208510    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck" podUID="bc9b21ad-14c4-464d-9581-3c116e823163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Aug 04 11:36:05.209068 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:05.209033    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Aug 04 11:36:05.209619 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:05.209590    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck" podUID="bc9b21ad-14c4-464d-9581-3c116e823163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Aug 04 11:36:06.211960 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:06.211933    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:36:06.212452 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:06.212300    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:36:06.213040 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:06.213022    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:36:19.407814 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:19.407775    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Aug 04 11:36:19.408170 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:19.407829    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz" podUID="346bb938-589c-495c-88aa-4298b2a60350" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Aug 04 11:36:20.453206 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:20.453170    2559 generic.go:356] "Generic (PLEG): container finished" podID="346bb938-589c-495c-88aa-4298b2a60350" containerID="098f7da59319e36e8855f234e06c9950f3bef369db6a6f4992f16f4852dc1f6e" exitCode=0
Aug 04 11:36:20.453603 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:20.453205    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz" event={"ID":"346bb938-589c-495c-88aa-4298b2a60350","Type":"ContainerDied","Data":"098f7da59319e36e8855f234e06c9950f3bef369db6a6f4992f16f4852dc1f6e"}
Aug 04 11:36:20.453603 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:20.453589    2559 scope.go:117] "RemoveContainer" containerID="098f7da59319e36e8855f234e06c9950f3bef369db6a6f4992f16f4852dc1f6e"
Aug 04 11:36:20.454728 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:20.454704    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:36:20.454802 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:20.454766    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:36:20.454802 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:20.454798    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:36:21.460037 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:21.459996    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz" event={"ID":"346bb938-589c-495c-88aa-4298b2a60350","Type":"ContainerStarted","Data":"1ec7b270aff49a3f90a8220728fe80200ab230badb3f5390878d43a5d94f865a"}
Aug 04 11:36:22.254379 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:22.254348    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:22.254573 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:22.254502    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Aug 04 11:36:22.254573 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:22.254545    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz" podUID="346bb938-589c-495c-88aa-4298b2a60350" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Aug 04 11:36:23.254068 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:23.254025    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Aug 04 11:36:23.254447 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:23.254105    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz" podUID="346bb938-589c-495c-88aa-4298b2a60350" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Aug 04 11:36:24.254186 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:24.254148    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Aug 04 11:36:24.254548 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:24.254213    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz" podUID="346bb938-589c-495c-88aa-4298b2a60350" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Aug 04 11:36:25.253717 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:25.253671    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Aug 04 11:36:25.253934 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:25.253733    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz" podUID="346bb938-589c-495c-88aa-4298b2a60350" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Aug 04 11:36:26.254215 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:26.254181    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Aug 04 11:36:26.254634 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:26.254237    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz" podUID="346bb938-589c-495c-88aa-4298b2a60350" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Aug 04 11:36:27.257600 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:27.257571    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:27.258104 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:27.257953    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:36:27.258687 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:36:27.258670    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:37:16.735504 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.735473    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"]
Aug 04 11:37:16.738829 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.738809    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.742664 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.742627    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-20aab6-openshift-default-dockercfg-w2vzd\""
Aug 04 11:37:16.759714 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.759691    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"]
Aug 04 11:37:16.808744 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.808712    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-podinfo\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.808863 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.808762    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsm27\" (UniqueName: \"kubernetes.io/projected/63b35ba8-2836-474a-9a20-dd3c44c5efae-kube-api-access-rsm27\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.808863 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.808792    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-token\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.808863 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.808855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-envoy\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.808990 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.808920    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-workload-socket\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.809150 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.809126    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-workload-certs\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.809218 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.809175    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-credential-socket\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.809218 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.809204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63b35ba8-2836-474a-9a20-dd3c44c5efae-istiod-ca-cert\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.809320 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.809255    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-data\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.910672 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.910615    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-workload-certs\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.910856 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.910692    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-credential-socket\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.910856 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.910720    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63b35ba8-2836-474a-9a20-dd3c44c5efae-istiod-ca-cert\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.910856 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.910750    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-data\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.910856 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.910783    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-podinfo\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.910856 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.910824    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsm27\" (UniqueName: \"kubernetes.io/projected/63b35ba8-2836-474a-9a20-dd3c44c5efae-kube-api-access-rsm27\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.910856 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.910849    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-token\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.911146 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.910881    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-envoy\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.911146 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.910946    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-workload-socket\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.911412 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.911383    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-workload-socket\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.911680 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.911656    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-workload-certs\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.911930 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.911906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-credential-socket\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.912598 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.912569    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63b35ba8-2836-474a-9a20-dd3c44c5efae-istiod-ca-cert\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.912884 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.912852    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-data\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.917697 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.917115    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-envoy\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.919840 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.919816    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-podinfo\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.923550 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.923522    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-token\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:16.924193 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:16.924170    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsm27\" (UniqueName: \"kubernetes.io/projected/63b35ba8-2836-474a-9a20-dd3c44c5efae-kube-api-access-rsm27\") pod \"e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") " pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:17.048965 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:17.048890    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:17.191312 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:17.191288    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"]
Aug 04 11:37:17.193190 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:37:17.193162    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b35ba8_2836_474a_9a20_dd3c44c5efae.slice/crio-6814810fba2c35ec3502589d869aab690cff561cc4ec6efd899a22e8b7810e37 WatchSource:0}: Error finding container 6814810fba2c35ec3502589d869aab690cff561cc4ec6efd899a22e8b7810e37: Status 404 returned error can't find the container with id 6814810fba2c35ec3502589d869aab690cff561cc4ec6efd899a22e8b7810e37
Aug 04 11:37:17.195512 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:17.195478    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:37:17.195589 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:17.195569    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:37:17.195626 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:17.195604    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:37:17.727169 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:17.727136    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8" event={"ID":"63b35ba8-2836-474a-9a20-dd3c44c5efae","Type":"ContainerStarted","Data":"8b4ab31c586ea6a1798543b5e8264e9be9c019ed1794f8f9db5b75338410fe4f"}
Aug 04 11:37:17.727347 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:17.727189    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8" event={"ID":"63b35ba8-2836-474a-9a20-dd3c44c5efae","Type":"ContainerStarted","Data":"6814810fba2c35ec3502589d869aab690cff561cc4ec6efd899a22e8b7810e37"}
Aug 04 11:37:17.752415 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:17.752368    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8" podStartSLOduration=1.7523539449999999 podStartE2EDuration="1.752353945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:37:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:37:17.751425969 +0000 UTC m=+3628.477496304" watchObservedRunningTime="2026-08-04 11:37:17.752353945 +0000 UTC m=+3628.478424275"
Aug 04 11:37:18.049311 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:18.049225    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:18.054311 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:18.054287    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:18.732454 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:18.732420    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:18.733408 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:18.733391    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:34.774817 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:34.774773    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Aug 04 11:37:34.775212 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:34.774843    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8" podUID="63b35ba8-2836-474a-9a20-dd3c44c5efae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Aug 04 11:37:35.813277 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:35.813248    2559 generic.go:356] "Generic (PLEG): container finished" podID="63b35ba8-2836-474a-9a20-dd3c44c5efae" containerID="8b4ab31c586ea6a1798543b5e8264e9be9c019ed1794f8f9db5b75338410fe4f" exitCode=0
Aug 04 11:37:35.813743 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:35.813291    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8" event={"ID":"63b35ba8-2836-474a-9a20-dd3c44c5efae","Type":"ContainerDied","Data":"8b4ab31c586ea6a1798543b5e8264e9be9c019ed1794f8f9db5b75338410fe4f"}
Aug 04 11:37:35.813812 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:35.813799    2559 scope.go:117] "RemoveContainer" containerID="8b4ab31c586ea6a1798543b5e8264e9be9c019ed1794f8f9db5b75338410fe4f"
Aug 04 11:37:35.814930 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:35.814901    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:37:35.815042 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:35.814989    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:37:35.815104 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:35.815037    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 04 11:37:36.823881 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:36.823838    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8" event={"ID":"63b35ba8-2836-474a-9a20-dd3c44c5efae","Type":"ContainerStarted","Data":"8410de2695fb7ac31b30b3f50dc4ccce0bab2ab4bbf2336cebb04dce163c3aea"}
Aug 04 11:37:37.049126 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:37.049092    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:37.049326 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:37.049299    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Aug 04 11:37:37.049406 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:37.049364    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8" podUID="63b35ba8-2836-474a-9a20-dd3c44c5efae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Aug 04 11:37:38.049487 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:38.049454    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Aug 04 11:37:38.049888 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:38.049507    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8" podUID="63b35ba8-2836-474a-9a20-dd3c44c5efae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Aug 04 11:37:39.049340 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:39.049302    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Aug 04 11:37:39.049532 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:39.049356    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8" podUID="63b35ba8-2836-474a-9a20-dd3c44c5efae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Aug 04 11:37:40.050020 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:40.049979    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Aug 04 11:37:40.050407 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:40.050045    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8" podUID="63b35ba8-2836-474a-9a20-dd3c44c5efae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Aug 04 11:37:41.049944 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:41.049905    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Aug 04 11:37:41.050126 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:41.049960    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8" podUID="63b35ba8-2836-474a-9a20-dd3c44c5efae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Aug 04 11:37:42.053536 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:42.053507    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:42.054014 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:42.053906    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:42.054474 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:42.054454    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:37:57.277602 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:57.277571    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"]
Aug 04 11:37:57.278047 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:37:57.277856    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8" podUID="63b35ba8-2836-474a-9a20-dd3c44c5efae" containerName="istio-proxy" containerID="cri-o://8410de2695fb7ac31b30b3f50dc4ccce0bab2ab4bbf2336cebb04dce163c3aea" gracePeriod=30
Aug 04 11:38:02.525894 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.525861    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:38:02.647965 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.647936    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63b35ba8-2836-474a-9a20-dd3c44c5efae-istiod-ca-cert\") pod \"63b35ba8-2836-474a-9a20-dd3c44c5efae\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") "
Aug 04 11:38:02.648132 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.647988    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-workload-socket\") pod \"63b35ba8-2836-474a-9a20-dd3c44c5efae\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") "
Aug 04 11:38:02.648132 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648025    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsm27\" (UniqueName: \"kubernetes.io/projected/63b35ba8-2836-474a-9a20-dd3c44c5efae-kube-api-access-rsm27\") pod \"63b35ba8-2836-474a-9a20-dd3c44c5efae\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") "
Aug 04 11:38:02.648132 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648123    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-credential-socket\") pod \"63b35ba8-2836-474a-9a20-dd3c44c5efae\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") "
Aug 04 11:38:02.648304 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648197    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-data\") pod \"63b35ba8-2836-474a-9a20-dd3c44c5efae\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") "
Aug 04 11:38:02.648304 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648227    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-workload-certs\") pod \"63b35ba8-2836-474a-9a20-dd3c44c5efae\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") "
Aug 04 11:38:02.648304 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648244    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-podinfo\") pod \"63b35ba8-2836-474a-9a20-dd3c44c5efae\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") "
Aug 04 11:38:02.648304 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648291    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-token\") pod \"63b35ba8-2836-474a-9a20-dd3c44c5efae\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") "
Aug 04 11:38:02.648505 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648321    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-envoy\") pod \"63b35ba8-2836-474a-9a20-dd3c44c5efae\" (UID: \"63b35ba8-2836-474a-9a20-dd3c44c5efae\") "
Aug 04 11:38:02.648505 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648331    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63b35ba8-2836-474a-9a20-dd3c44c5efae" (UID: "63b35ba8-2836-474a-9a20-dd3c44c5efae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:38:02.648505 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648416    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63b35ba8-2836-474a-9a20-dd3c44c5efae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63b35ba8-2836-474a-9a20-dd3c44c5efae" (UID: "63b35ba8-2836-474a-9a20-dd3c44c5efae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:38:02.648505 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648390    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63b35ba8-2836-474a-9a20-dd3c44c5efae" (UID: "63b35ba8-2836-474a-9a20-dd3c44c5efae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:38:02.648505 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648446    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-data" (OuterVolumeSpecName: "istio-data") pod "63b35ba8-2836-474a-9a20-dd3c44c5efae" (UID: "63b35ba8-2836-474a-9a20-dd3c44c5efae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:38:02.648812 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648723    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:38:02.648812 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648743    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:38:02.648812 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648757    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63b35ba8-2836-474a-9a20-dd3c44c5efae-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:38:02.648812 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648768    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:38:02.649012 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.648821    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63b35ba8-2836-474a-9a20-dd3c44c5efae" (UID: "63b35ba8-2836-474a-9a20-dd3c44c5efae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:38:02.650296 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.650269    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63b35ba8-2836-474a-9a20-dd3c44c5efae-kube-api-access-rsm27" (OuterVolumeSpecName: "kube-api-access-rsm27") pod "63b35ba8-2836-474a-9a20-dd3c44c5efae" (UID: "63b35ba8-2836-474a-9a20-dd3c44c5efae"). InnerVolumeSpecName "kube-api-access-rsm27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:38:02.650405 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.650376    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63b35ba8-2836-474a-9a20-dd3c44c5efae" (UID: "63b35ba8-2836-474a-9a20-dd3c44c5efae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 11:38:02.650450 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.650424    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63b35ba8-2836-474a-9a20-dd3c44c5efae" (UID: "63b35ba8-2836-474a-9a20-dd3c44c5efae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:38:02.650670 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.650625    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-token" (OuterVolumeSpecName: "istio-token") pod "63b35ba8-2836-474a-9a20-dd3c44c5efae" (UID: "63b35ba8-2836-474a-9a20-dd3c44c5efae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:38:02.749424 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.749402    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsm27\" (UniqueName: \"kubernetes.io/projected/63b35ba8-2836-474a-9a20-dd3c44c5efae-kube-api-access-rsm27\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:38:02.749424 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.749421    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:38:02.749567 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.749430    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:38:02.749567 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.749438    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:38:02.749567 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.749447    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63b35ba8-2836-474a-9a20-dd3c44c5efae-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:38:02.956257 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.956171    2559 generic.go:356] "Generic (PLEG): container finished" podID="63b35ba8-2836-474a-9a20-dd3c44c5efae" containerID="8410de2695fb7ac31b30b3f50dc4ccce0bab2ab4bbf2336cebb04dce163c3aea" exitCode=0
Aug 04 11:38:02.956409 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.956275    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"
Aug 04 11:38:02.956409 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.956293    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8" event={"ID":"63b35ba8-2836-474a-9a20-dd3c44c5efae","Type":"ContainerDied","Data":"8410de2695fb7ac31b30b3f50dc4ccce0bab2ab4bbf2336cebb04dce163c3aea"}
Aug 04 11:38:02.956409 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.956346    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8" event={"ID":"63b35ba8-2836-474a-9a20-dd3c44c5efae","Type":"ContainerDied","Data":"6814810fba2c35ec3502589d869aab690cff561cc4ec6efd899a22e8b7810e37"}
Aug 04 11:38:02.956409 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.956367    2559 scope.go:117] "RemoveContainer" containerID="8410de2695fb7ac31b30b3f50dc4ccce0bab2ab4bbf2336cebb04dce163c3aea"
Aug 04 11:38:02.965888 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.965870    2559 scope.go:117] "RemoveContainer" containerID="8b4ab31c586ea6a1798543b5e8264e9be9c019ed1794f8f9db5b75338410fe4f"
Aug 04 11:38:02.973732 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.973687    2559 scope.go:117] "RemoveContainer" containerID="8410de2695fb7ac31b30b3f50dc4ccce0bab2ab4bbf2336cebb04dce163c3aea"
Aug 04 11:38:02.974015 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:38:02.973992    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8410de2695fb7ac31b30b3f50dc4ccce0bab2ab4bbf2336cebb04dce163c3aea\": container with ID starting with 8410de2695fb7ac31b30b3f50dc4ccce0bab2ab4bbf2336cebb04dce163c3aea not found: ID does not exist" containerID="8410de2695fb7ac31b30b3f50dc4ccce0bab2ab4bbf2336cebb04dce163c3aea"
Aug 04 11:38:02.974067 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.974027    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8410de2695fb7ac31b30b3f50dc4ccce0bab2ab4bbf2336cebb04dce163c3aea"} err="failed to get container status \"8410de2695fb7ac31b30b3f50dc4ccce0bab2ab4bbf2336cebb04dce163c3aea\": rpc error: code = NotFound desc = could not find container \"8410de2695fb7ac31b30b3f50dc4ccce0bab2ab4bbf2336cebb04dce163c3aea\": container with ID starting with 8410de2695fb7ac31b30b3f50dc4ccce0bab2ab4bbf2336cebb04dce163c3aea not found: ID does not exist"
Aug 04 11:38:02.974067 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.974046    2559 scope.go:117] "RemoveContainer" containerID="8b4ab31c586ea6a1798543b5e8264e9be9c019ed1794f8f9db5b75338410fe4f"
Aug 04 11:38:02.974323 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:38:02.974302    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b4ab31c586ea6a1798543b5e8264e9be9c019ed1794f8f9db5b75338410fe4f\": container with ID starting with 8b4ab31c586ea6a1798543b5e8264e9be9c019ed1794f8f9db5b75338410fe4f not found: ID does not exist" containerID="8b4ab31c586ea6a1798543b5e8264e9be9c019ed1794f8f9db5b75338410fe4f"
Aug 04 11:38:02.974402 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.974325    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4ab31c586ea6a1798543b5e8264e9be9c019ed1794f8f9db5b75338410fe4f"} err="failed to get container status \"8b4ab31c586ea6a1798543b5e8264e9be9c019ed1794f8f9db5b75338410fe4f\": rpc error: code = NotFound desc = could not find container \"8b4ab31c586ea6a1798543b5e8264e9be9c019ed1794f8f9db5b75338410fe4f\": container with ID starting with 8b4ab31c586ea6a1798543b5e8264e9be9c019ed1794f8f9db5b75338410fe4f not found: ID does not exist"
Aug 04 11:38:02.981905 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.981884    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"]
Aug 04 11:38:02.991498 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:02.991477    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-20aab6-openshift-default-6c94698d8d-9fzh8"]
Aug 04 11:38:03.781086 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:38:03.781052    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63b35ba8-2836-474a-9a20-dd3c44c5efae" path="/var/lib/kubelet/pods/63b35ba8-2836-474a-9a20-dd3c44c5efae/volumes"
Aug 04 11:39:11.559850 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:11.559810    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"]
Aug 04 11:39:11.560277 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:11.560030    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck" podUID="bc9b21ad-14c4-464d-9581-3c116e823163" containerName="istio-proxy" containerID="cri-o://17c52ee7988c76650a014231d0a3993df7437f41a2e478df8ace281c6a248eb5" gracePeriod=30
Aug 04 11:39:16.806113 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.806076    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:39:16.908120 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.908090    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvtgc\" (UniqueName: \"kubernetes.io/projected/bc9b21ad-14c4-464d-9581-3c116e823163-kube-api-access-vvtgc\") pod \"bc9b21ad-14c4-464d-9581-3c116e823163\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") "
Aug 04 11:39:16.908307 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.908135    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-workload-socket\") pod \"bc9b21ad-14c4-464d-9581-3c116e823163\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") "
Aug 04 11:39:16.908307 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.908165    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-workload-certs\") pod \"bc9b21ad-14c4-464d-9581-3c116e823163\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") "
Aug 04 11:39:16.908307 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.908268    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc9b21ad-14c4-464d-9581-3c116e823163-istiod-ca-cert\") pod \"bc9b21ad-14c4-464d-9581-3c116e823163\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") "
Aug 04 11:39:16.908477 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.908319    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-istio-data\") pod \"bc9b21ad-14c4-464d-9581-3c116e823163\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") "
Aug 04 11:39:16.908477 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.908353    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc9b21ad-14c4-464d-9581-3c116e823163-istio-token\") pod \"bc9b21ad-14c4-464d-9581-3c116e823163\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") "
Aug 04 11:39:16.908477 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.908372    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc9b21ad-14c4-464d-9581-3c116e823163-istio-podinfo\") pod \"bc9b21ad-14c4-464d-9581-3c116e823163\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") "
Aug 04 11:39:16.908477 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.908415    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-istio-envoy\") pod \"bc9b21ad-14c4-464d-9581-3c116e823163\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") "
Aug 04 11:39:16.908477 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.908444    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc9b21ad-14c4-464d-9581-3c116e823163" (UID: "bc9b21ad-14c4-464d-9581-3c116e823163"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:16.908477 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.908458    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc9b21ad-14c4-464d-9581-3c116e823163" (UID: "bc9b21ad-14c4-464d-9581-3c116e823163"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:16.908830 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.908529    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-credential-socket\") pod \"bc9b21ad-14c4-464d-9581-3c116e823163\" (UID: \"bc9b21ad-14c4-464d-9581-3c116e823163\") "
Aug 04 11:39:16.908830 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.908696    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc9b21ad-14c4-464d-9581-3c116e823163" (UID: "bc9b21ad-14c4-464d-9581-3c116e823163"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:16.908830 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.908711    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc9b21ad-14c4-464d-9581-3c116e823163-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc9b21ad-14c4-464d-9581-3c116e823163" (UID: "bc9b21ad-14c4-464d-9581-3c116e823163"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:39:16.908979 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.908890    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc9b21ad-14c4-464d-9581-3c116e823163" (UID: "bc9b21ad-14c4-464d-9581-3c116e823163"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:16.909062 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.909038    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:16.909178 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.909067    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:16.909178 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.909081    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc9b21ad-14c4-464d-9581-3c116e823163-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:16.909178 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.909093    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:16.909178 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.909106    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:16.910779 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.910756    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc9b21ad-14c4-464d-9581-3c116e823163-kube-api-access-vvtgc" (OuterVolumeSpecName: "kube-api-access-vvtgc") pod "bc9b21ad-14c4-464d-9581-3c116e823163" (UID: "bc9b21ad-14c4-464d-9581-3c116e823163"). InnerVolumeSpecName "kube-api-access-vvtgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:39:16.910779 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.910744    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc9b21ad-14c4-464d-9581-3c116e823163-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc9b21ad-14c4-464d-9581-3c116e823163" (UID: "bc9b21ad-14c4-464d-9581-3c116e823163"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 11:39:16.910918 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.910808    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc9b21ad-14c4-464d-9581-3c116e823163-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc9b21ad-14c4-464d-9581-3c116e823163" (UID: "bc9b21ad-14c4-464d-9581-3c116e823163"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:39:16.911089 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:16.911048    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc9b21ad-14c4-464d-9581-3c116e823163" (UID: "bc9b21ad-14c4-464d-9581-3c116e823163"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:17.010033 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.010004    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc9b21ad-14c4-464d-9581-3c116e823163-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:17.010033 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.010028    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc9b21ad-14c4-464d-9581-3c116e823163-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:17.010203 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.010042    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc9b21ad-14c4-464d-9581-3c116e823163-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:17.010203 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.010055    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvtgc\" (UniqueName: \"kubernetes.io/projected/bc9b21ad-14c4-464d-9581-3c116e823163-kube-api-access-vvtgc\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:17.306431 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.306327    2559 generic.go:356] "Generic (PLEG): container finished" podID="bc9b21ad-14c4-464d-9581-3c116e823163" containerID="17c52ee7988c76650a014231d0a3993df7437f41a2e478df8ace281c6a248eb5" exitCode=0
Aug 04 11:39:17.306431 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.306397    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"
Aug 04 11:39:17.306665 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.306453    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck" event={"ID":"bc9b21ad-14c4-464d-9581-3c116e823163","Type":"ContainerDied","Data":"17c52ee7988c76650a014231d0a3993df7437f41a2e478df8ace281c6a248eb5"}
Aug 04 11:39:17.306665 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.306518    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck" event={"ID":"bc9b21ad-14c4-464d-9581-3c116e823163","Type":"ContainerDied","Data":"b59dc5b9c5c745a84f2611f47cbba25be78364fe1b3986e2ef064cbe200d94d2"}
Aug 04 11:39:17.306665 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.306546    2559 scope.go:117] "RemoveContainer" containerID="17c52ee7988c76650a014231d0a3993df7437f41a2e478df8ace281c6a248eb5"
Aug 04 11:39:17.320719 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.320698    2559 scope.go:117] "RemoveContainer" containerID="fbff9e3fc06615ebcaeb2933973113b729d2a391c9ff156a20b48727550b86ab"
Aug 04 11:39:17.329061 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.329040    2559 scope.go:117] "RemoveContainer" containerID="17c52ee7988c76650a014231d0a3993df7437f41a2e478df8ace281c6a248eb5"
Aug 04 11:39:17.329296 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:39:17.329279    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17c52ee7988c76650a014231d0a3993df7437f41a2e478df8ace281c6a248eb5\": container with ID starting with 17c52ee7988c76650a014231d0a3993df7437f41a2e478df8ace281c6a248eb5 not found: ID does not exist" containerID="17c52ee7988c76650a014231d0a3993df7437f41a2e478df8ace281c6a248eb5"
Aug 04 11:39:17.329333 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.329304    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17c52ee7988c76650a014231d0a3993df7437f41a2e478df8ace281c6a248eb5"} err="failed to get container status \"17c52ee7988c76650a014231d0a3993df7437f41a2e478df8ace281c6a248eb5\": rpc error: code = NotFound desc = could not find container \"17c52ee7988c76650a014231d0a3993df7437f41a2e478df8ace281c6a248eb5\": container with ID starting with 17c52ee7988c76650a014231d0a3993df7437f41a2e478df8ace281c6a248eb5 not found: ID does not exist"
Aug 04 11:39:17.329333 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.329320    2559 scope.go:117] "RemoveContainer" containerID="fbff9e3fc06615ebcaeb2933973113b729d2a391c9ff156a20b48727550b86ab"
Aug 04 11:39:17.329557 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:39:17.329539    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbff9e3fc06615ebcaeb2933973113b729d2a391c9ff156a20b48727550b86ab\": container with ID starting with fbff9e3fc06615ebcaeb2933973113b729d2a391c9ff156a20b48727550b86ab not found: ID does not exist" containerID="fbff9e3fc06615ebcaeb2933973113b729d2a391c9ff156a20b48727550b86ab"
Aug 04 11:39:17.329602 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.329565    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbff9e3fc06615ebcaeb2933973113b729d2a391c9ff156a20b48727550b86ab"} err="failed to get container status \"fbff9e3fc06615ebcaeb2933973113b729d2a391c9ff156a20b48727550b86ab\": rpc error: code = NotFound desc = could not find container \"fbff9e3fc06615ebcaeb2933973113b729d2a391c9ff156a20b48727550b86ab\": container with ID starting with fbff9e3fc06615ebcaeb2933973113b729d2a391c9ff156a20b48727550b86ab not found: ID does not exist"
Aug 04 11:39:17.338711 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.338691    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"]
Aug 04 11:39:17.341625 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.341606    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-e44431-openshift-default-79fd45f564-qhrck"]
Aug 04 11:39:17.780972 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:17.780937    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc9b21ad-14c4-464d-9581-3c116e823163" path="/var/lib/kubelet/pods/bc9b21ad-14c4-464d-9581-3c116e823163/volumes"
Aug 04 11:39:25.479541 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:25.479508    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"]
Aug 04 11:39:25.480196 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:25.479766    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz" podUID="346bb938-589c-495c-88aa-4298b2a60350" containerName="istio-proxy" containerID="cri-o://1ec7b270aff49a3f90a8220728fe80200ab230badb3f5390878d43a5d94f865a" gracePeriod=30
Aug 04 11:39:27.260235 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:27.260200    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 11:39:27.260615 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:27.260267    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz" podUID="346bb938-589c-495c-88aa-4298b2a60350" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 11:39:30.729724 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.729701    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:39:30.827164 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.827089    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/346bb938-589c-495c-88aa-4298b2a60350-istio-podinfo\") pod \"346bb938-589c-495c-88aa-4298b2a60350\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") "
Aug 04 11:39:30.827164 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.827130    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-istio-envoy\") pod \"346bb938-589c-495c-88aa-4298b2a60350\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") "
Aug 04 11:39:30.827164 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.827163    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-workload-socket\") pod \"346bb938-589c-495c-88aa-4298b2a60350\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") "
Aug 04 11:39:30.827412 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.827189    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gvrn\" (UniqueName: \"kubernetes.io/projected/346bb938-589c-495c-88aa-4298b2a60350-kube-api-access-6gvrn\") pod \"346bb938-589c-495c-88aa-4298b2a60350\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") "
Aug 04 11:39:30.827412 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.827227    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/346bb938-589c-495c-88aa-4298b2a60350-istiod-ca-cert\") pod \"346bb938-589c-495c-88aa-4298b2a60350\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") "
Aug 04 11:39:30.827412 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.827251    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-credential-socket\") pod \"346bb938-589c-495c-88aa-4298b2a60350\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") "
Aug 04 11:39:30.827412 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.827292    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/346bb938-589c-495c-88aa-4298b2a60350-istio-token\") pod \"346bb938-589c-495c-88aa-4298b2a60350\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") "
Aug 04 11:39:30.827412 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.827328    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-workload-certs\") pod \"346bb938-589c-495c-88aa-4298b2a60350\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") "
Aug 04 11:39:30.827412 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.827399    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-istio-data\") pod \"346bb938-589c-495c-88aa-4298b2a60350\" (UID: \"346bb938-589c-495c-88aa-4298b2a60350\") "
Aug 04 11:39:30.827754 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.827507    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "346bb938-589c-495c-88aa-4298b2a60350" (UID: "346bb938-589c-495c-88aa-4298b2a60350"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:30.827754 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.827520    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "346bb938-589c-495c-88aa-4298b2a60350" (UID: "346bb938-589c-495c-88aa-4298b2a60350"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:30.827754 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.827606    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/346bb938-589c-495c-88aa-4298b2a60350-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "346bb938-589c-495c-88aa-4298b2a60350" (UID: "346bb938-589c-495c-88aa-4298b2a60350"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:39:30.827754 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.827705    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "346bb938-589c-495c-88aa-4298b2a60350" (UID: "346bb938-589c-495c-88aa-4298b2a60350"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:30.828001 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.827984    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:30.828071 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.828007    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:30.828071 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.828020    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/346bb938-589c-495c-88aa-4298b2a60350-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:30.828071 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.828034    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:30.828071 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.828054    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-istio-data" (OuterVolumeSpecName: "istio-data") pod "346bb938-589c-495c-88aa-4298b2a60350" (UID: "346bb938-589c-495c-88aa-4298b2a60350"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:30.829688 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.829663    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "346bb938-589c-495c-88aa-4298b2a60350" (UID: "346bb938-589c-495c-88aa-4298b2a60350"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:30.829795 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.829740    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/346bb938-589c-495c-88aa-4298b2a60350-istio-token" (OuterVolumeSpecName: "istio-token") pod "346bb938-589c-495c-88aa-4298b2a60350" (UID: "346bb938-589c-495c-88aa-4298b2a60350"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:39:30.829934 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.829913    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/346bb938-589c-495c-88aa-4298b2a60350-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "346bb938-589c-495c-88aa-4298b2a60350" (UID: "346bb938-589c-495c-88aa-4298b2a60350"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 11:39:30.830016 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.829998    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/346bb938-589c-495c-88aa-4298b2a60350-kube-api-access-6gvrn" (OuterVolumeSpecName: "kube-api-access-6gvrn") pod "346bb938-589c-495c-88aa-4298b2a60350" (UID: "346bb938-589c-495c-88aa-4298b2a60350"). InnerVolumeSpecName "kube-api-access-6gvrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:39:30.929429 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.929385    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:30.929429 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.929424    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/346bb938-589c-495c-88aa-4298b2a60350-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:30.929628 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.929439    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/346bb938-589c-495c-88aa-4298b2a60350-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:30.929628 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.929453    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gvrn\" (UniqueName: \"kubernetes.io/projected/346bb938-589c-495c-88aa-4298b2a60350-kube-api-access-6gvrn\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:30.929628 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:30.929467    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/346bb938-589c-495c-88aa-4298b2a60350-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:31.376537 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:31.376503    2559 generic.go:356] "Generic (PLEG): container finished" podID="346bb938-589c-495c-88aa-4298b2a60350" containerID="1ec7b270aff49a3f90a8220728fe80200ab230badb3f5390878d43a5d94f865a" exitCode=0
Aug 04 11:39:31.376738 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:31.376553    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"
Aug 04 11:39:31.376738 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:31.376587    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz" event={"ID":"346bb938-589c-495c-88aa-4298b2a60350","Type":"ContainerDied","Data":"1ec7b270aff49a3f90a8220728fe80200ab230badb3f5390878d43a5d94f865a"}
Aug 04 11:39:31.376738 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:31.376656    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz" event={"ID":"346bb938-589c-495c-88aa-4298b2a60350","Type":"ContainerDied","Data":"f03e7784c354c2b9c419b42a34ce1a663884d6fc70d982c49b60b4d450927d35"}
Aug 04 11:39:31.376738 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:31.376682    2559 scope.go:117] "RemoveContainer" containerID="1ec7b270aff49a3f90a8220728fe80200ab230badb3f5390878d43a5d94f865a"
Aug 04 11:39:31.386206 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:31.386185    2559 scope.go:117] "RemoveContainer" containerID="098f7da59319e36e8855f234e06c9950f3bef369db6a6f4992f16f4852dc1f6e"
Aug 04 11:39:31.393968 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:31.393947    2559 scope.go:117] "RemoveContainer" containerID="1ec7b270aff49a3f90a8220728fe80200ab230badb3f5390878d43a5d94f865a"
Aug 04 11:39:31.394209 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:39:31.394191    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ec7b270aff49a3f90a8220728fe80200ab230badb3f5390878d43a5d94f865a\": container with ID starting with 1ec7b270aff49a3f90a8220728fe80200ab230badb3f5390878d43a5d94f865a not found: ID does not exist" containerID="1ec7b270aff49a3f90a8220728fe80200ab230badb3f5390878d43a5d94f865a"
Aug 04 11:39:31.394256 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:31.394217    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ec7b270aff49a3f90a8220728fe80200ab230badb3f5390878d43a5d94f865a"} err="failed to get container status \"1ec7b270aff49a3f90a8220728fe80200ab230badb3f5390878d43a5d94f865a\": rpc error: code = NotFound desc = could not find container \"1ec7b270aff49a3f90a8220728fe80200ab230badb3f5390878d43a5d94f865a\": container with ID starting with 1ec7b270aff49a3f90a8220728fe80200ab230badb3f5390878d43a5d94f865a not found: ID does not exist"
Aug 04 11:39:31.394256 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:31.394234    2559 scope.go:117] "RemoveContainer" containerID="098f7da59319e36e8855f234e06c9950f3bef369db6a6f4992f16f4852dc1f6e"
Aug 04 11:39:31.394464 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:39:31.394451    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"098f7da59319e36e8855f234e06c9950f3bef369db6a6f4992f16f4852dc1f6e\": container with ID starting with 098f7da59319e36e8855f234e06c9950f3bef369db6a6f4992f16f4852dc1f6e not found: ID does not exist" containerID="098f7da59319e36e8855f234e06c9950f3bef369db6a6f4992f16f4852dc1f6e"
Aug 04 11:39:31.394500 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:31.394468    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"098f7da59319e36e8855f234e06c9950f3bef369db6a6f4992f16f4852dc1f6e"} err="failed to get container status \"098f7da59319e36e8855f234e06c9950f3bef369db6a6f4992f16f4852dc1f6e\": rpc error: code = NotFound desc = could not find container \"098f7da59319e36e8855f234e06c9950f3bef369db6a6f4992f16f4852dc1f6e\": container with ID starting with 098f7da59319e36e8855f234e06c9950f3bef369db6a6f4992f16f4852dc1f6e not found: ID does not exist"
Aug 04 11:39:31.399482 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:31.399463    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"]
Aug 04 11:39:31.402095 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:31.402067    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-29b2ff-openshift-default-86c76dd6-488lz"]
Aug 04 11:39:31.781646 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:31.781616    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="346bb938-589c-495c-88aa-4298b2a60350" path="/var/lib/kubelet/pods/346bb938-589c-495c-88aa-4298b2a60350/volumes"
Aug 04 11:39:38.141582 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:38.141550    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"]
Aug 04 11:39:38.142046 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:38.141774    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds" podUID="7d699dd9-29ae-423e-a74e-1cb055498160" containerName="istio-proxy" containerID="cri-o://26037294622a2965a0651be8eeda43b52144e9a1a3104debe6038fdfc7ef3298" gracePeriod=30
Aug 04 11:39:43.394032 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.394006    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:39:43.432847 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.432785    2559 generic.go:356] "Generic (PLEG): container finished" podID="7d699dd9-29ae-423e-a74e-1cb055498160" containerID="26037294622a2965a0651be8eeda43b52144e9a1a3104debe6038fdfc7ef3298" exitCode=0
Aug 04 11:39:43.432956 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.432844    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"
Aug 04 11:39:43.432956 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.432852    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds" event={"ID":"7d699dd9-29ae-423e-a74e-1cb055498160","Type":"ContainerDied","Data":"26037294622a2965a0651be8eeda43b52144e9a1a3104debe6038fdfc7ef3298"}
Aug 04 11:39:43.433041 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.432966    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds" event={"ID":"7d699dd9-29ae-423e-a74e-1cb055498160","Type":"ContainerDied","Data":"15aaa112c2a738742de51124f8ab8034fd41e288cff2a3c688729b4e636b6aeb"}
Aug 04 11:39:43.433041 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.432988    2559 scope.go:117] "RemoveContainer" containerID="26037294622a2965a0651be8eeda43b52144e9a1a3104debe6038fdfc7ef3298"
Aug 04 11:39:43.436067 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.436051    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-istio-data\") pod \"7d699dd9-29ae-423e-a74e-1cb055498160\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") "
Aug 04 11:39:43.436178 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.436077    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d699dd9-29ae-423e-a74e-1cb055498160-istio-podinfo\") pod \"7d699dd9-29ae-423e-a74e-1cb055498160\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") "
Aug 04 11:39:43.436178 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.436118    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d699dd9-29ae-423e-a74e-1cb055498160-istiod-ca-cert\") pod \"7d699dd9-29ae-423e-a74e-1cb055498160\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") "
Aug 04 11:39:43.436178 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.436174    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-credential-socket\") pod \"7d699dd9-29ae-423e-a74e-1cb055498160\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") "
Aug 04 11:39:43.436372 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.436199    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-workload-certs\") pod \"7d699dd9-29ae-423e-a74e-1cb055498160\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") "
Aug 04 11:39:43.436372 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.436343    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-istio-data" (OuterVolumeSpecName: "istio-data") pod "7d699dd9-29ae-423e-a74e-1cb055498160" (UID: "7d699dd9-29ae-423e-a74e-1cb055498160"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:43.436473 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.436414    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj2z8\" (UniqueName: \"kubernetes.io/projected/7d699dd9-29ae-423e-a74e-1cb055498160-kube-api-access-wj2z8\") pod \"7d699dd9-29ae-423e-a74e-1cb055498160\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") "
Aug 04 11:39:43.436524 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.436472    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-istio-envoy\") pod \"7d699dd9-29ae-423e-a74e-1cb055498160\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") "
Aug 04 11:39:43.436524 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.436457    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7d699dd9-29ae-423e-a74e-1cb055498160" (UID: "7d699dd9-29ae-423e-a74e-1cb055498160"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:43.436524 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.436498    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-workload-socket\") pod \"7d699dd9-29ae-423e-a74e-1cb055498160\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") "
Aug 04 11:39:43.436810 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.436500    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7d699dd9-29ae-423e-a74e-1cb055498160" (UID: "7d699dd9-29ae-423e-a74e-1cb055498160"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:43.436903 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.436686    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d699dd9-29ae-423e-a74e-1cb055498160-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7d699dd9-29ae-423e-a74e-1cb055498160" (UID: "7d699dd9-29ae-423e-a74e-1cb055498160"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:39:43.436903 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.436541    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d699dd9-29ae-423e-a74e-1cb055498160-istio-token\") pod \"7d699dd9-29ae-423e-a74e-1cb055498160\" (UID: \"7d699dd9-29ae-423e-a74e-1cb055498160\") "
Aug 04 11:39:43.437296 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.437179    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:43.437296 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.437002    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7d699dd9-29ae-423e-a74e-1cb055498160" (UID: "7d699dd9-29ae-423e-a74e-1cb055498160"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:43.437296 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.437206    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d699dd9-29ae-423e-a74e-1cb055498160-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:43.437296 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.437248    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:43.437554 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.437359    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:43.439047 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.439020    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d699dd9-29ae-423e-a74e-1cb055498160-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7d699dd9-29ae-423e-a74e-1cb055498160" (UID: "7d699dd9-29ae-423e-a74e-1cb055498160"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 11:39:43.439185 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.439072    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d699dd9-29ae-423e-a74e-1cb055498160-kube-api-access-wj2z8" (OuterVolumeSpecName: "kube-api-access-wj2z8") pod "7d699dd9-29ae-423e-a74e-1cb055498160" (UID: "7d699dd9-29ae-423e-a74e-1cb055498160"). InnerVolumeSpecName "kube-api-access-wj2z8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:39:43.439321 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.439279    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7d699dd9-29ae-423e-a74e-1cb055498160" (UID: "7d699dd9-29ae-423e-a74e-1cb055498160"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:39:43.439427 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.439387    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d699dd9-29ae-423e-a74e-1cb055498160-istio-token" (OuterVolumeSpecName: "istio-token") pod "7d699dd9-29ae-423e-a74e-1cb055498160" (UID: "7d699dd9-29ae-423e-a74e-1cb055498160"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:39:43.444094 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.443983    2559 scope.go:117] "RemoveContainer" containerID="efb3035bd47ebb80c4afa51048365664b2e6150598b85b40830209319ea0205c"
Aug 04 11:39:43.457193 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.457177    2559 scope.go:117] "RemoveContainer" containerID="26037294622a2965a0651be8eeda43b52144e9a1a3104debe6038fdfc7ef3298"
Aug 04 11:39:43.457460 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:39:43.457444    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26037294622a2965a0651be8eeda43b52144e9a1a3104debe6038fdfc7ef3298\": container with ID starting with 26037294622a2965a0651be8eeda43b52144e9a1a3104debe6038fdfc7ef3298 not found: ID does not exist" containerID="26037294622a2965a0651be8eeda43b52144e9a1a3104debe6038fdfc7ef3298"
Aug 04 11:39:43.457533 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.457472    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26037294622a2965a0651be8eeda43b52144e9a1a3104debe6038fdfc7ef3298"} err="failed to get container status \"26037294622a2965a0651be8eeda43b52144e9a1a3104debe6038fdfc7ef3298\": rpc error: code = NotFound desc = could not find container \"26037294622a2965a0651be8eeda43b52144e9a1a3104debe6038fdfc7ef3298\": container with ID starting with 26037294622a2965a0651be8eeda43b52144e9a1a3104debe6038fdfc7ef3298 not found: ID does not exist"
Aug 04 11:39:43.457533 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.457493    2559 scope.go:117] "RemoveContainer" containerID="efb3035bd47ebb80c4afa51048365664b2e6150598b85b40830209319ea0205c"
Aug 04 11:39:43.457786 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:39:43.457768    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efb3035bd47ebb80c4afa51048365664b2e6150598b85b40830209319ea0205c\": container with ID starting with efb3035bd47ebb80c4afa51048365664b2e6150598b85b40830209319ea0205c not found: ID does not exist" containerID="efb3035bd47ebb80c4afa51048365664b2e6150598b85b40830209319ea0205c"
Aug 04 11:39:43.457830 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.457791    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efb3035bd47ebb80c4afa51048365664b2e6150598b85b40830209319ea0205c"} err="failed to get container status \"efb3035bd47ebb80c4afa51048365664b2e6150598b85b40830209319ea0205c\": rpc error: code = NotFound desc = could not find container \"efb3035bd47ebb80c4afa51048365664b2e6150598b85b40830209319ea0205c\": container with ID starting with efb3035bd47ebb80c4afa51048365664b2e6150598b85b40830209319ea0205c not found: ID does not exist"
Aug 04 11:39:43.537771 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.537745    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d699dd9-29ae-423e-a74e-1cb055498160-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:43.537771 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.537768    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj2z8\" (UniqueName: \"kubernetes.io/projected/7d699dd9-29ae-423e-a74e-1cb055498160-kube-api-access-wj2z8\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:43.537896 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.537782    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:43.537896 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.537793    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d699dd9-29ae-423e-a74e-1cb055498160-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:43.537896 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.537803    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d699dd9-29ae-423e-a74e-1cb055498160-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:39:43.755001 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.754968    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"]
Aug 04 11:39:43.758607 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.758585    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-ed8ca8-openshift-default-6fd688fcc6-x4sds"]
Aug 04 11:39:43.780920 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:43.780900    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d699dd9-29ae-423e-a74e-1cb055498160" path="/var/lib/kubelet/pods/7d699dd9-29ae-423e-a74e-1cb055498160/volumes"
Aug 04 11:39:56.217062 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:56.207975    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"]
Aug 04 11:39:56.217062 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:56.209060    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss" podUID="90dbd07a-e51f-4456-a172-356b2c8aeadf" containerName="istio-proxy" containerID="cri-o://14fe7155a101c75dd1d826ecb1c487baa3c2e98e73bb0e91c3fa8b224fbf9628" gracePeriod=30
Aug 04 11:39:58.212252 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:58.212210    2559 patch_prober.go:28] interesting pod/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 11:39:58.212688 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:39:58.212269    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss" podUID="90dbd07a-e51f-4456-a172-356b2c8aeadf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 11:40:01.463833 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.463807    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:40:01.518353 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.518289    2559 generic.go:356] "Generic (PLEG): container finished" podID="90dbd07a-e51f-4456-a172-356b2c8aeadf" containerID="14fe7155a101c75dd1d826ecb1c487baa3c2e98e73bb0e91c3fa8b224fbf9628" exitCode=0
Aug 04 11:40:01.518353 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.518333    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"
Aug 04 11:40:01.518509 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.518371    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss" event={"ID":"90dbd07a-e51f-4456-a172-356b2c8aeadf","Type":"ContainerDied","Data":"14fe7155a101c75dd1d826ecb1c487baa3c2e98e73bb0e91c3fa8b224fbf9628"}
Aug 04 11:40:01.518509 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.518440    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss" event={"ID":"90dbd07a-e51f-4456-a172-356b2c8aeadf","Type":"ContainerDied","Data":"1ca1bc6d40d1998870d5a5c43f8ef9205a79a42873cdcfb6f1f99d8c28af28c4"}
Aug 04 11:40:01.518509 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.518461    2559 scope.go:117] "RemoveContainer" containerID="14fe7155a101c75dd1d826ecb1c487baa3c2e98e73bb0e91c3fa8b224fbf9628"
Aug 04 11:40:01.526598 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.526584    2559 scope.go:117] "RemoveContainer" containerID="1cdee45b0592d4926760971935ea1f282a9425b6311043c8ab5751e3eee210b1"
Aug 04 11:40:01.534190 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.534174    2559 scope.go:117] "RemoveContainer" containerID="14fe7155a101c75dd1d826ecb1c487baa3c2e98e73bb0e91c3fa8b224fbf9628"
Aug 04 11:40:01.534439 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:40:01.534419    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14fe7155a101c75dd1d826ecb1c487baa3c2e98e73bb0e91c3fa8b224fbf9628\": container with ID starting with 14fe7155a101c75dd1d826ecb1c487baa3c2e98e73bb0e91c3fa8b224fbf9628 not found: ID does not exist" containerID="14fe7155a101c75dd1d826ecb1c487baa3c2e98e73bb0e91c3fa8b224fbf9628"
Aug 04 11:40:01.534489 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.534449    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14fe7155a101c75dd1d826ecb1c487baa3c2e98e73bb0e91c3fa8b224fbf9628"} err="failed to get container status \"14fe7155a101c75dd1d826ecb1c487baa3c2e98e73bb0e91c3fa8b224fbf9628\": rpc error: code = NotFound desc = could not find container \"14fe7155a101c75dd1d826ecb1c487baa3c2e98e73bb0e91c3fa8b224fbf9628\": container with ID starting with 14fe7155a101c75dd1d826ecb1c487baa3c2e98e73bb0e91c3fa8b224fbf9628 not found: ID does not exist"
Aug 04 11:40:01.534489 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.534465    2559 scope.go:117] "RemoveContainer" containerID="1cdee45b0592d4926760971935ea1f282a9425b6311043c8ab5751e3eee210b1"
Aug 04 11:40:01.534671 ip-10-0-136-162 kubenswrapper[2559]: E0804 11:40:01.534654    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cdee45b0592d4926760971935ea1f282a9425b6311043c8ab5751e3eee210b1\": container with ID starting with 1cdee45b0592d4926760971935ea1f282a9425b6311043c8ab5751e3eee210b1 not found: ID does not exist" containerID="1cdee45b0592d4926760971935ea1f282a9425b6311043c8ab5751e3eee210b1"
Aug 04 11:40:01.534717 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.534678    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cdee45b0592d4926760971935ea1f282a9425b6311043c8ab5751e3eee210b1"} err="failed to get container status \"1cdee45b0592d4926760971935ea1f282a9425b6311043c8ab5751e3eee210b1\": rpc error: code = NotFound desc = could not find container \"1cdee45b0592d4926760971935ea1f282a9425b6311043c8ab5751e3eee210b1\": container with ID starting with 1cdee45b0592d4926760971935ea1f282a9425b6311043c8ab5751e3eee210b1 not found: ID does not exist"
Aug 04 11:40:01.591524 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.591503    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-podinfo\") pod \"90dbd07a-e51f-4456-a172-356b2c8aeadf\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") "
Aug 04 11:40:01.591591 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.591548    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-data\") pod \"90dbd07a-e51f-4456-a172-356b2c8aeadf\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") "
Aug 04 11:40:01.591627 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.591588    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-workload-socket\") pod \"90dbd07a-e51f-4456-a172-356b2c8aeadf\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") "
Aug 04 11:40:01.591627 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.591620    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90dbd07a-e51f-4456-a172-356b2c8aeadf-istiod-ca-cert\") pod \"90dbd07a-e51f-4456-a172-356b2c8aeadf\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") "
Aug 04 11:40:01.591750 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.591698    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-token\") pod \"90dbd07a-e51f-4456-a172-356b2c8aeadf\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") "
Aug 04 11:40:01.591750 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.591724    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-credential-socket\") pod \"90dbd07a-e51f-4456-a172-356b2c8aeadf\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") "
Aug 04 11:40:01.591750 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.591748    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-envoy\") pod \"90dbd07a-e51f-4456-a172-356b2c8aeadf\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") "
Aug 04 11:40:01.591891 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.591790    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4d4l8\" (UniqueName: \"kubernetes.io/projected/90dbd07a-e51f-4456-a172-356b2c8aeadf-kube-api-access-4d4l8\") pod \"90dbd07a-e51f-4456-a172-356b2c8aeadf\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") "
Aug 04 11:40:01.591891 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.591818    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-workload-certs\") pod \"90dbd07a-e51f-4456-a172-356b2c8aeadf\" (UID: \"90dbd07a-e51f-4456-a172-356b2c8aeadf\") "
Aug 04 11:40:01.591993 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.591910    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-data" (OuterVolumeSpecName: "istio-data") pod "90dbd07a-e51f-4456-a172-356b2c8aeadf" (UID: "90dbd07a-e51f-4456-a172-356b2c8aeadf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:40:01.591993 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.591922    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "90dbd07a-e51f-4456-a172-356b2c8aeadf" (UID: "90dbd07a-e51f-4456-a172-356b2c8aeadf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:40:01.592103 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.592010    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "90dbd07a-e51f-4456-a172-356b2c8aeadf" (UID: "90dbd07a-e51f-4456-a172-356b2c8aeadf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:40:01.592160 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.592093    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90dbd07a-e51f-4456-a172-356b2c8aeadf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "90dbd07a-e51f-4456-a172-356b2c8aeadf" (UID: "90dbd07a-e51f-4456-a172-356b2c8aeadf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 11:40:01.592238 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.592218    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-data\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:40:01.592303 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.592242    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-workload-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:40:01.592303 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.592254    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90dbd07a-e51f-4456-a172-356b2c8aeadf-istiod-ca-cert\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:40:01.592303 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.592262    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-credential-socket\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:40:01.592446 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.592375    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "90dbd07a-e51f-4456-a172-356b2c8aeadf" (UID: "90dbd07a-e51f-4456-a172-356b2c8aeadf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:40:01.593801 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.593781    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "90dbd07a-e51f-4456-a172-356b2c8aeadf" (UID: "90dbd07a-e51f-4456-a172-356b2c8aeadf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 11:40:01.594026 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.594004    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90dbd07a-e51f-4456-a172-356b2c8aeadf-kube-api-access-4d4l8" (OuterVolumeSpecName: "kube-api-access-4d4l8") pod "90dbd07a-e51f-4456-a172-356b2c8aeadf" (UID: "90dbd07a-e51f-4456-a172-356b2c8aeadf"). InnerVolumeSpecName "kube-api-access-4d4l8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:40:01.594345 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.594316    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "90dbd07a-e51f-4456-a172-356b2c8aeadf" (UID: "90dbd07a-e51f-4456-a172-356b2c8aeadf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 11:40:01.594345 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.594325    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-token" (OuterVolumeSpecName: "istio-token") pod "90dbd07a-e51f-4456-a172-356b2c8aeadf" (UID: "90dbd07a-e51f-4456-a172-356b2c8aeadf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 11:40:01.692771 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.692746    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-token\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:40:01.692771 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.692765    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-envoy\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:40:01.692771 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.692774    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4d4l8\" (UniqueName: \"kubernetes.io/projected/90dbd07a-e51f-4456-a172-356b2c8aeadf-kube-api-access-4d4l8\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:40:01.692934 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.692782    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90dbd07a-e51f-4456-a172-356b2c8aeadf-workload-certs\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:40:01.692934 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.692791    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90dbd07a-e51f-4456-a172-356b2c8aeadf-istio-podinfo\") on node \"ip-10-0-136-162.ec2.internal\" DevicePath \"\""
Aug 04 11:40:01.834978 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.834953    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"]
Aug 04 11:40:01.836935 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:01.836915    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-c74755-openshift-default-6fc866df56-tmvss"]
Aug 04 11:40:02.162891 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:02.162863    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-f59h8_583fa4ff-d003-4d57-8455-7a43b4b438de/manager/0.log"
Aug 04 11:40:02.276432 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:02.276402    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5f49d_db00b9e4-c36b-4320-919f-34445e05559a/manager/0.log"
Aug 04 11:40:02.386163 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:02.386134    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-f96587765-qrm9c_81cf906d-3725-409e-996d-3b524aeaa43d/manager/0.log"
Aug 04 11:40:02.494244 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:02.494175    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cpnxc_041462fc-fd0f-4d96-b002-8a53f4ab4543/server/0.log"
Aug 04 11:40:02.719914 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:02.719888    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79895c7c95-84fs9_4ba9a250-c2b4-4854-9869-a746af25a20e/copy-manifests/0.log"
Aug 04 11:40:02.726228 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:02.726204    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79895c7c95-84fs9_4ba9a250-c2b4-4854-9869-a746af25a20e/manager/0.log"
Aug 04 11:40:03.317559 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:03.317525    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7fb57cb99-ctdfr_9d7a362d-fdc6-4940-86a5-1aa8e54645d7/maas-api/0.log"
Aug 04 11:40:03.755706 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:03.755680    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-st8cq_7518d4c5-ca18-4e4e-928d-a9fafaaee3ec/postgres/0.log"
Aug 04 11:40:03.780532 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:03.780502    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90dbd07a-e51f-4456-a172-356b2c8aeadf" path="/var/lib/kubelet/pods/90dbd07a-e51f-4456-a172-356b2c8aeadf/volumes"
Aug 04 11:40:04.588447 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:04.588421    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-2cngp_5f78925b-9a46-44c6-bb27-ab49bba636a9/manager/0.log"
Aug 04 11:40:04.810620 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:04.810593    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-8bb7m_dec9e228-29b2-4655-93dd-795cd63dacd4/kuadrant-console-plugin/0.log"
Aug 04 11:40:05.165511 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:05.165483    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-mzstt_f7fd55c8-1d96-4d99-8f16-3067b796e243/manager/0.log"
Aug 04 11:40:05.496962 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:05.496886    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799chpnsm_e26b8e41-0ff1-4de7-adc6-ad7c5d00c864/istio-proxy/0.log"
Aug 04 11:40:05.831912 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:05.831805    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bc4f665b9-m8crw_7e0256a1-1ff1-460f-bd51-893049655ec4/kube-auth-proxy/0.log"
Aug 04 11:40:05.947331 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:05.947305    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dd9rb_17dc7398-b910-4116-baaa-376652f9e50c/istio-proxy/1.log"
Aug 04 11:40:06.620280 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:06.620250    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-h8n76_3494acf8-232e-42d7-8cc8-26b62e27b733/main/0.log"
Aug 04 11:40:06.837618 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:06.837589    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-whghz_93aee302-6eec-4276-97b1-752aa7880e57/main/0.log"
Aug 04 11:40:07.165811 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:07.165783    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-djhm8_bd2bf965-6927-4566-947c-4675e7f49004/main/0.log"
Aug 04 11:40:15.809263 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:15.809233    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mtxjn_790dd286-529d-47d2-a860-6f692d635f80/global-pull-secret-syncer/0.log"
Aug 04 11:40:15.954367 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:15.954317    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rvnjq_eb5ca508-8941-4f0a-b418-defcadef5c2e/konnectivity-agent/0.log"
Aug 04 11:40:16.005981 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:16.005955    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-162.ec2.internal_9c6c3d58b6fed20e5c5b5b141f5402cf/haproxy/0.log"
Aug 04 11:40:20.495013 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:20.494971    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-2cngp_5f78925b-9a46-44c6-bb27-ab49bba636a9/manager/0.log"
Aug 04 11:40:20.563585 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:20.563563    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-8bb7m_dec9e228-29b2-4655-93dd-795cd63dacd4/kuadrant-console-plugin/0.log"
Aug 04 11:40:20.817816 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:20.817730    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-mzstt_f7fd55c8-1d96-4d99-8f16-3067b796e243/manager/0.log"
Aug 04 11:40:22.832838 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:22.832809    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mbwbq_7bddd16d-cfbc-4143-8402-bda919bcc9e6/node-exporter/0.log"
Aug 04 11:40:22.857833 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:22.857809    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mbwbq_7bddd16d-cfbc-4143-8402-bda919bcc9e6/kube-rbac-proxy/0.log"
Aug 04 11:40:22.882875 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:22.882852    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mbwbq_7bddd16d-cfbc-4143-8402-bda919bcc9e6/init-textfile/0.log"
Aug 04 11:40:25.956140 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956108    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"]
Aug 04 11:40:25.956499 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956417    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="346bb938-589c-495c-88aa-4298b2a60350" containerName="istio-proxy"
Aug 04 11:40:25.956499 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956428    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="346bb938-589c-495c-88aa-4298b2a60350" containerName="istio-proxy"
Aug 04 11:40:25.956499 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956441    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90dbd07a-e51f-4456-a172-356b2c8aeadf" containerName="istio-proxy"
Aug 04 11:40:25.956499 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956446    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="90dbd07a-e51f-4456-a172-356b2c8aeadf" containerName="istio-proxy"
Aug 04 11:40:25.956499 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956455    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc9b21ad-14c4-464d-9581-3c116e823163" containerName="istio-proxy"
Aug 04 11:40:25.956499 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956460    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc9b21ad-14c4-464d-9581-3c116e823163" containerName="istio-proxy"
Aug 04 11:40:25.956499 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956466    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc9b21ad-14c4-464d-9581-3c116e823163" containerName="istio-proxy"
Aug 04 11:40:25.956499 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956473    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc9b21ad-14c4-464d-9581-3c116e823163" containerName="istio-proxy"
Aug 04 11:40:25.956499 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956480    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d699dd9-29ae-423e-a74e-1cb055498160" containerName="istio-proxy"
Aug 04 11:40:25.956499 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956485    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d699dd9-29ae-423e-a74e-1cb055498160" containerName="istio-proxy"
Aug 04 11:40:25.956499 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956491    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63b35ba8-2836-474a-9a20-dd3c44c5efae" containerName="istio-proxy"
Aug 04 11:40:25.956499 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956496    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="63b35ba8-2836-474a-9a20-dd3c44c5efae" containerName="istio-proxy"
Aug 04 11:40:25.956499 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956501    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d699dd9-29ae-423e-a74e-1cb055498160" containerName="istio-proxy"
Aug 04 11:40:25.956499 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956506    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d699dd9-29ae-423e-a74e-1cb055498160" containerName="istio-proxy"
Aug 04 11:40:25.956937 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956515    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63b35ba8-2836-474a-9a20-dd3c44c5efae" containerName="istio-proxy"
Aug 04 11:40:25.956937 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956520    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="63b35ba8-2836-474a-9a20-dd3c44c5efae" containerName="istio-proxy"
Aug 04 11:40:25.956937 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956569    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc9b21ad-14c4-464d-9581-3c116e823163" containerName="istio-proxy"
Aug 04 11:40:25.956937 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956578    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="63b35ba8-2836-474a-9a20-dd3c44c5efae" containerName="istio-proxy"
Aug 04 11:40:25.956937 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956584    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d699dd9-29ae-423e-a74e-1cb055498160" containerName="istio-proxy"
Aug 04 11:40:25.956937 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956589    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="63b35ba8-2836-474a-9a20-dd3c44c5efae" containerName="istio-proxy"
Aug 04 11:40:25.956937 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956594    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="346bb938-589c-495c-88aa-4298b2a60350" containerName="istio-proxy"
Aug 04 11:40:25.956937 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956599    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="90dbd07a-e51f-4456-a172-356b2c8aeadf" containerName="istio-proxy"
Aug 04 11:40:25.956937 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.956605    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="90dbd07a-e51f-4456-a172-356b2c8aeadf" containerName="istio-proxy"
Aug 04 11:40:25.959479 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.959464    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:25.961983 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.961964    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lm9vx\"/\"kube-root-ca.crt\""
Aug 04 11:40:25.962611 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.962598    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lm9vx\"/\"default-dockercfg-jmtxh\""
Aug 04 11:40:25.962685 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.962613    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lm9vx\"/\"openshift-service-ca.crt\""
Aug 04 11:40:25.967429 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.967408    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"]
Aug 04 11:40:25.991157 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.991131    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98e1db4b-50df-4125-a150-35d5c0707f3e-sys\") pod \"perf-node-gather-daemonset-dxwk7\" (UID: \"98e1db4b-50df-4125-a150-35d5c0707f3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:25.991260 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.991160    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhj8g\" (UniqueName: \"kubernetes.io/projected/98e1db4b-50df-4125-a150-35d5c0707f3e-kube-api-access-dhj8g\") pod \"perf-node-gather-daemonset-dxwk7\" (UID: \"98e1db4b-50df-4125-a150-35d5c0707f3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:25.991260 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.991197    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/98e1db4b-50df-4125-a150-35d5c0707f3e-proc\") pod \"perf-node-gather-daemonset-dxwk7\" (UID: \"98e1db4b-50df-4125-a150-35d5c0707f3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:25.991260 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.991247    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/98e1db4b-50df-4125-a150-35d5c0707f3e-podres\") pod \"perf-node-gather-daemonset-dxwk7\" (UID: \"98e1db4b-50df-4125-a150-35d5c0707f3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:25.991379 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:25.991276    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98e1db4b-50df-4125-a150-35d5c0707f3e-lib-modules\") pod \"perf-node-gather-daemonset-dxwk7\" (UID: \"98e1db4b-50df-4125-a150-35d5c0707f3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:26.092453 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.092424    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98e1db4b-50df-4125-a150-35d5c0707f3e-sys\") pod \"perf-node-gather-daemonset-dxwk7\" (UID: \"98e1db4b-50df-4125-a150-35d5c0707f3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:26.092597 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.092456    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhj8g\" (UniqueName: \"kubernetes.io/projected/98e1db4b-50df-4125-a150-35d5c0707f3e-kube-api-access-dhj8g\") pod \"perf-node-gather-daemonset-dxwk7\" (UID: \"98e1db4b-50df-4125-a150-35d5c0707f3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:26.092597 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.092502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/98e1db4b-50df-4125-a150-35d5c0707f3e-proc\") pod \"perf-node-gather-daemonset-dxwk7\" (UID: \"98e1db4b-50df-4125-a150-35d5c0707f3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:26.092597 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.092538    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/98e1db4b-50df-4125-a150-35d5c0707f3e-podres\") pod \"perf-node-gather-daemonset-dxwk7\" (UID: \"98e1db4b-50df-4125-a150-35d5c0707f3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:26.092597 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.092546    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98e1db4b-50df-4125-a150-35d5c0707f3e-sys\") pod \"perf-node-gather-daemonset-dxwk7\" (UID: \"98e1db4b-50df-4125-a150-35d5c0707f3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:26.092597 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.092578    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98e1db4b-50df-4125-a150-35d5c0707f3e-lib-modules\") pod \"perf-node-gather-daemonset-dxwk7\" (UID: \"98e1db4b-50df-4125-a150-35d5c0707f3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:26.092890 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.092625    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/98e1db4b-50df-4125-a150-35d5c0707f3e-proc\") pod \"perf-node-gather-daemonset-dxwk7\" (UID: \"98e1db4b-50df-4125-a150-35d5c0707f3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:26.092890 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.092679    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/98e1db4b-50df-4125-a150-35d5c0707f3e-podres\") pod \"perf-node-gather-daemonset-dxwk7\" (UID: \"98e1db4b-50df-4125-a150-35d5c0707f3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:26.092890 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.092720    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98e1db4b-50df-4125-a150-35d5c0707f3e-lib-modules\") pod \"perf-node-gather-daemonset-dxwk7\" (UID: \"98e1db4b-50df-4125-a150-35d5c0707f3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:26.101420 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.101399    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhj8g\" (UniqueName: \"kubernetes.io/projected/98e1db4b-50df-4125-a150-35d5c0707f3e-kube-api-access-dhj8g\") pod \"perf-node-gather-daemonset-dxwk7\" (UID: \"98e1db4b-50df-4125-a150-35d5c0707f3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:26.269513 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.269437    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:26.402595 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.402572    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"]
Aug 04 11:40:26.404160 ip-10-0-136-162 kubenswrapper[2559]: W0804 11:40:26.404134    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod98e1db4b_50df_4125_a150_35d5c0707f3e.slice/crio-a37d0d1198f47df7fe896c361b568f43ff21ea263b0ec1aa279778313303f755 WatchSource:0}: Error finding container a37d0d1198f47df7fe896c361b568f43ff21ea263b0ec1aa279778313303f755: Status 404 returned error can't find the container with id a37d0d1198f47df7fe896c361b568f43ff21ea263b0ec1aa279778313303f755
Aug 04 11:40:26.627800 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.627769    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7" event={"ID":"98e1db4b-50df-4125-a150-35d5c0707f3e","Type":"ContainerStarted","Data":"a867953ae8bdebea1ff4a6d25b3f70b2e4d0a4fd6ffce09db4509ef7c9312025"}
Aug 04 11:40:26.628113 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.627823    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7" event={"ID":"98e1db4b-50df-4125-a150-35d5c0707f3e","Type":"ContainerStarted","Data":"a37d0d1198f47df7fe896c361b568f43ff21ea263b0ec1aa279778313303f755"}
Aug 04 11:40:26.628113 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.627911    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:26.646758 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:26.646717    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7" podStartSLOduration=1.6467037740000001 podStartE2EDuration="1.646703774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 11:40:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:40:26.644871069 +0000 UTC m=+3817.370941403" watchObservedRunningTime="2026-08-04 11:40:26.646703774 +0000 UTC m=+3817.372774104"
Aug 04 11:40:28.291270 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:28.291246    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2c279_568a8a46-1a19-47c9-8070-c5de70047dad/dns/0.log"
Aug 04 11:40:28.322018 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:28.321983    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2c279_568a8a46-1a19-47c9-8070-c5de70047dad/kube-rbac-proxy/0.log"
Aug 04 11:40:28.483629 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:28.483597    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mg8tk_ddccaa00-a3b0-4696-9f37-7e86195ddf41/dns-node-resolver/0.log"
Aug 04 11:40:29.136527 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:29.136498    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nc4hz_781d93fa-f41a-4510-836a-deadf3c3be42/node-ca/0.log"
Aug 04 11:40:30.181221 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:30.181197    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799chpnsm_e26b8e41-0ff1-4de7-adc6-ad7c5d00c864/istio-proxy/0.log"
Aug 04 11:40:30.570045 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:30.569969    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bc4f665b9-m8crw_7e0256a1-1ff1-460f-bd51-893049655ec4/kube-auth-proxy/0.log"
Aug 04 11:40:30.604959 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:30.604930    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dd9rb_17dc7398-b910-4116-baaa-376652f9e50c/istio-proxy/0.log"
Aug 04 11:40:30.611755 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:30.611737    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dd9rb_17dc7398-b910-4116-baaa-376652f9e50c/istio-proxy/1.log"
Aug 04 11:40:31.580838 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:31.580765    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qf66x_66434394-a392-41f9-b8ff-1d93cd551961/serve-healthcheck-canary/0.log"
Aug 04 11:40:32.272551 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:32.272517    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lqdbv_5b76b54f-db74-42fc-bbee-8e48683f9d91/kube-rbac-proxy/0.log"
Aug 04 11:40:32.299885 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:32.299865    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lqdbv_5b76b54f-db74-42fc-bbee-8e48683f9d91/exporter/0.log"
Aug 04 11:40:32.327786 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:32.327758    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lqdbv_5b76b54f-db74-42fc-bbee-8e48683f9d91/extractor/0.log"
Aug 04 11:40:32.641874 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:32.641851    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-dxwk7"
Aug 04 11:40:34.929088 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:34.929018    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-f59h8_583fa4ff-d003-4d57-8455-7a43b4b438de/manager/0.log"
Aug 04 11:40:35.144884 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:35.144853    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5f49d_db00b9e4-c36b-4320-919f-34445e05559a/manager/0.log"
Aug 04 11:40:35.343101 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:35.343078    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-f96587765-qrm9c_81cf906d-3725-409e-996d-3b524aeaa43d/manager/0.log"
Aug 04 11:40:35.366229 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:35.366204    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cpnxc_041462fc-fd0f-4d96-b002-8a53f4ab4543/server/0.log"
Aug 04 11:40:35.491301 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:35.491277    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79895c7c95-84fs9_4ba9a250-c2b4-4854-9869-a746af25a20e/manager/0.log"
Aug 04 11:40:35.517653 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:35.517617    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79895c7c95-84fs9_4ba9a250-c2b4-4854-9869-a746af25a20e/copy-manifests/0.log"
Aug 04 11:40:36.939857 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:36.939809    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799chpnsm_e26b8e41-0ff1-4de7-adc6-ad7c5d00c864/istio-proxy/0.log"
Aug 04 11:40:37.336975 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:37.336888    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bc4f665b9-m8crw_7e0256a1-1ff1-460f-bd51-893049655ec4/kube-auth-proxy/0.log"
Aug 04 11:40:37.361160 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:37.361132    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dd9rb_17dc7398-b910-4116-baaa-376652f9e50c/istio-proxy/0.log"
Aug 04 11:40:37.367217 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:37.367199    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dd9rb_17dc7398-b910-4116-baaa-376652f9e50c/istio-proxy/1.log"
Aug 04 11:40:38.863041 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:38.863013    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799chpnsm_e26b8e41-0ff1-4de7-adc6-ad7c5d00c864/istio-proxy/0.log"
Aug 04 11:40:39.246449 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:39.246381    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bc4f665b9-m8crw_7e0256a1-1ff1-460f-bd51-893049655ec4/kube-auth-proxy/0.log"
Aug 04 11:40:39.283077 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:39.283048    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dd9rb_17dc7398-b910-4116-baaa-376652f9e50c/istio-proxy/0.log"
Aug 04 11:40:39.288945 ip-10-0-136-162 kubenswrapper[2559]: I0804 11:40:39.288925    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-dd9rb_17dc7398-b910-4116-baaa-376652f9e50c/istio-proxy/1.log"