Aug 05 16:38:47.282428 ip-10-0-138-233 systemd[1]: Starting Kubernetes Kubelet...
Aug 05 16:38:47.734492 ip-10-0-138-233 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 16:38:47.734492 ip-10-0-138-233 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 05 16:38:47.734492 ip-10-0-138-233 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 16:38:47.734492 ip-10-0-138-233 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 05 16:38:47.734492 ip-10-0-138-233 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 16:38:47.736631 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.736548    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 05 16:38:47.741772 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741757    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:38:47.741772 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741771    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741776    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741780    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741783    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741786    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741790    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741792    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741795    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741798    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741802    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741805    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741807    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741810    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741813    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741815    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741818    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741821    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741823    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741826    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741828    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:38:47.741836 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741835    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741838    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741841    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741844    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741847    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741850    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741853    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741856    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741858    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741861    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741863    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741866    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741868    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741871    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741874    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741876    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741879    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741881    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741883    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741887    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:38:47.742339 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741889    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741892    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741894    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741897    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741899    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741902    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741904    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741907    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741909    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741913    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741915    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741918    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741920    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741923    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741927    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741929    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741932    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741935    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741937    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741940    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:38:47.742817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741942    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741945    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741947    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741950    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741954    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741958    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741961    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741964    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741966    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741969    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741971    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741974    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741977    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741981    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741984    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741987    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741991    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741995    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:38:47.743312 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.741998    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742001    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742004    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742006    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742009    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742012    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742014    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742017    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742023    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742025    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742028    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742031    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742034    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742036    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742039    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742041    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742044    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742046    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742049    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742056    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:38:47.743746 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742871    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742878    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742881    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742884    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742887    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742889    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742894    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742898    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742901    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742904    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742907    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742910    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742912    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742915    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742917    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742920    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742923    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742925    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742928    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742930    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:38:47.744249 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742934    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742943    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742945    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742948    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742950    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742953    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742956    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742958    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742961    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742964    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742966    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742969    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742971    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742974    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742976    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742979    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742982    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742984    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742987    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742989    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:38:47.744749 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742992    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742994    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742997    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.742999    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743003    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743007    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743009    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743013    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743016    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743019    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743021    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743024    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743027    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743030    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743038    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743041    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743044    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743047    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743049    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:38:47.745377 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743052    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743054    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743058    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743061    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743064    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743066    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743069    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743072    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743075    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743078    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743081    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743083    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743086    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743088    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743091    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743107    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743110    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743113    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743115    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:38:47.746090 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743118    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743120    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743123    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743125    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743128    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743131    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743134    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743137    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743139    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743149    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743151    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743154    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743157    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743159    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743162    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743165    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743167    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743170    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743172    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743175    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:38:47.746673 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743177    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743617    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743621    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743624    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743627    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743629    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743632    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743635    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743637    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743640    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743643    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743645    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743648    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743651    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743653    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743656    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743659    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743661    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743664    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743667    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:38:47.747192 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743670    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743678    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743681    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743684    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743686    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743689    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743692    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743694    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743697    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743699    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743702    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743704    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743707    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743710    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743712    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743715    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743717    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743720    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743722    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743725    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743728    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:38:47.747686 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743731    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743733    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743736    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743739    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743741    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743743    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743746    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743752    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743754    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743757    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743760    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743762    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743765    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743774    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743776    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743779    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743781    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743784    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743787    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743789    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:38:47.748248 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743792    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743794    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743797    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743801    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743804    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743807    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743810    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743813    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743817    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743820    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743823    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743825    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743828    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743831    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743833    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743836    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743838    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743841    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743843    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:38:47.748731 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743847    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743850    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743852    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743856    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743858    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743861    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743864    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743872    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743875    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743877    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743880    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743882    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743885    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743887    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743889    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743893    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743897    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743900    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743902    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:38:47.749220 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.743905    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.743983    2565 flags.go:64] FLAG: --address="0.0.0.0"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744012    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744023    2565 flags.go:64] FLAG: --anonymous-auth="true"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744028    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744032    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744035    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744040    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744044    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744047    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744050    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744053    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744057    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744061    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744064    2565 flags.go:64] FLAG: --cgroup-root=""
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744067    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744070    2565 flags.go:64] FLAG: --client-ca-file=""
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744073    2565 flags.go:64] FLAG: --cloud-provider="external"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744076    2565 flags.go:64] FLAG: --cluster-dns="[]"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744082    2565 flags.go:64] FLAG: --cluster-domain=""
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744085    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744105    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744108    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744112    2565 flags.go:64] FLAG: --container-log-max-files="5"
Aug 05 16:38:47.749712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744115    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744118    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744121    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744124    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744127    2565 flags.go:64] FLAG: --contention-profiling="false"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744130    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744133    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744136    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744139    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744143    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744148    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744151    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744154    2565 flags.go:64] FLAG: --enable-load-reader="false"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744157    2565 flags.go:64] FLAG: --enable-server="true"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744160    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744167    2565 flags.go:64] FLAG: --event-burst="100"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744171    2565 flags.go:64] FLAG: --event-qps="50"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744174    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744177    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744180    2565 flags.go:64] FLAG: --eviction-hard=""
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744183    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744188    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744191    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744194    2565 flags.go:64] FLAG: --eviction-soft=""
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744196    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 05 16:38:47.750314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744199    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744202    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744205    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744208    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744211    2565 flags.go:64] FLAG: --fail-swap-on="true"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744219    2565 flags.go:64] FLAG: --feature-gates=""
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744223    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744226    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744229    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744232    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744235    2565 flags.go:64] FLAG: --healthz-port="10248"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744252    2565 flags.go:64] FLAG: --help="false"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744256    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-138-233.ec2.internal"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744260    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744263    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744266    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744270    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744274    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744277    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744280    2565 flags.go:64] FLAG: --image-service-endpoint=""
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744283    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744286    2565 flags.go:64] FLAG: --kube-api-burst="100"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744289    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744298    2565 flags.go:64] FLAG: --kube-api-qps="50"
Aug 05 16:38:47.750924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744301    2565 flags.go:64] FLAG: --kube-reserved=""
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744304    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744306    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744309    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744313    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744316    2565 flags.go:64] FLAG: --lock-file=""
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744319    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744322    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744324    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744330    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744333    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744335    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744338    2565 flags.go:64] FLAG: --logging-format="text"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744341    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744350    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744353    2565 flags.go:64] FLAG: --manifest-url=""
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744355    2565 flags.go:64] FLAG: --manifest-url-header=""
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744359    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744362    2565 flags.go:64] FLAG: --max-open-files="1000000"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744366    2565 flags.go:64] FLAG: --max-pods="110"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744369    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744372    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744375    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744378    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744380    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 05 16:38:47.751529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744385    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744388    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744395    2565 flags.go:64] FLAG: --node-status-max-images="50"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744398    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744401    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744404    2565 flags.go:64] FLAG: --pod-cidr=""
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744407    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744415    2565 flags.go:64] FLAG: --pod-manifest-path=""
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744418    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744421    2565 flags.go:64] FLAG: --pods-per-core="0"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744424    2565 flags.go:64] FLAG: --port="10250"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744427    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744430    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04102b02eea2fb716"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744433    2565 flags.go:64] FLAG: --qos-reserved=""
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744436    2565 flags.go:64] FLAG: --read-only-port="10255"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744439    2565 flags.go:64] FLAG: --register-node="true"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744442    2565 flags.go:64] FLAG: --register-with-taints=""
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744446    2565 flags.go:64] FLAG: --registry-burst="10"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744449    2565 flags.go:64] FLAG: --registry-qps="5"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744452    2565 flags.go:64] FLAG: --reserved-cpus=""
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744455    2565 flags.go:64] FLAG: --reserved-memory=""
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744459    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744468    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744472    2565 flags.go:64] FLAG: --rotate-certificates="false"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744474    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 05 16:38:47.752172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744477    2565 flags.go:64] FLAG: --runonce="false"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744480    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744483    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744486    2565 flags.go:64] FLAG: --seccomp-default="false"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744489    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744492    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744495    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744499    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744502    2565 flags.go:64] FLAG: --storage-driver-password="root"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744505    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744508    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744510    2565 flags.go:64] FLAG: --storage-driver-user="root"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744513    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744516    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744519    2565 flags.go:64] FLAG: --system-cgroups=""
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744522    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744527    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744530    2565 flags.go:64] FLAG: --tls-cert-file=""
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744532    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744539    2565 flags.go:64] FLAG: --tls-min-version=""
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744542    2565 flags.go:64] FLAG: --tls-private-key-file=""
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744544    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744547    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744550    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744552    2565 flags.go:64] FLAG: --v="2"
Aug 05 16:38:47.752803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744556    2565 flags.go:64] FLAG: --version="false"
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744560    2565 flags.go:64] FLAG: --vmodule=""
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744563    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.744566    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744743    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744752    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744756    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744759    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744762    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744766    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744769    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744771    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744775    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744779    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744783    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744786    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744788    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744791    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744794    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744796    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:38:47.753454 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744799    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744802    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744804    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744807    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744809    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744812    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744817    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744820    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744823    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744825    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744828    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744830    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744833    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744836    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744839    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744842    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744846    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744849    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744858    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:38:47.753943 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744861    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744864    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744867    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744869    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744872    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744874    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744877    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744881    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744884    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744886    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744889    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744891    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744894    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744896    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744899    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744901    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744904    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744906    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744909    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744913    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:38:47.754532 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744916    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744919    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744921    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744924    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744926    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744929    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744931    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744934    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744937    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744939    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744942    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744944    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.744994    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746159    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746169    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746174    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746180    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746184    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746189    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746195    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:38:47.755032 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746200    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746205    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746210    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746213    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746220    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746261    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746281    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746287    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746294    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746303    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746311    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746317    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746322    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746327    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746332    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746337    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746342    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746353    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746358    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:38:47.755534 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746362    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:38:47.756003 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746367    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:38:47.756003 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746372    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:38:47.756003 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746377    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:38:47.756003 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.746397    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:38:47.756003 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.746416    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 16:38:47.756003 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.753973    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 05 16:38:47.756003 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.753987    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 05 16:38:47.756003 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.754907    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 05 16:38:47.756003 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.754918    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 05 16:38:47.756003 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.754975    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:38:47.756003 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.754980    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:38:47.756003 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.754984    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:38:47.756003 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.754987    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:38:47.756003 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.754990    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:38:47.756003 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.754993    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.754996    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.754999    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755001    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755005    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755007    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755010    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755013    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755015    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755018    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755020    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755024    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755028    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755032    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755035    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755038    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755042    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755046    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755049    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:38:47.756386 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755053    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755055    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755058    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755061    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755064    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755067    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755070    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755073    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755075    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755078    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755080    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755083    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755086    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755089    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755092    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755108    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755112    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755115    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755117    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:38:47.756937 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755120    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755123    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755126    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755129    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755131    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755134    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755137    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755139    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755142    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755144    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755147    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755150    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755153    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755155    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755158    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755160    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755163    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755165    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755168    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755170    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:38:47.757420 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755173    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755176    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755179    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755182    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755184    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755187    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755190    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755192    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755195    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755197    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755200    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755202    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755205    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755208    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755210    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755214    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755216    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755219    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755222    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755226    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:38:47.757914 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755230    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:38:47.758460 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755232    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:38:47.758460 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755235    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:38:47.758460 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755239    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:38:47.758460 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755241    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:38:47.758460 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755244    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:38:47.758460 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755247    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:38:47.758460 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755250    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:38:47.758460 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755253    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:38:47.758460 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755255    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:38:47.758460 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755258    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:38:47.758460 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755260    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:38:47.758460 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755263    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:38:47.758460 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755266    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:38:47.758460 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755268    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:38:47.758460 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755271    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:38:47.758846 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.755276    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 16:38:47.758846 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755407    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:38:47.758846 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755413    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:38:47.758846 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755417    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:38:47.758846 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755420    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:38:47.758846 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755422    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:38:47.758846 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755425    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:38:47.758846 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755428    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:38:47.758846 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755431    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:38:47.758846 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755433    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:38:47.758846 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755436    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:38:47.758846 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755438    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:38:47.758846 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755442    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:38:47.758846 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755444    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:38:47.758846 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755447    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755449    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755452    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755454    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755457    2565 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755460    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755462    2565 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755465    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755468    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755470    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755473    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755475    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755478    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755481    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755483    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755486    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755489    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755491    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755494    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755497    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:38:47.759274 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755500    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755504    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755507    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755510    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755513    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755516    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755519    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755521    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755524    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755527    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755529    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755533    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755535    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755538    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755541    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755545    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755549    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755552    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755555    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:38:47.759767 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755558    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755560    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755562    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755565    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755567    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755570    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755572    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755575    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755577    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755580    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755582    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755585    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755588    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755590    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755593    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755595    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755598    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755600    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755603    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755605    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:38:47.760270 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755608    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755610    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755613    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755616    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755618    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755621    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755624    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755627    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755629    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755631    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755634    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755636    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755639    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755641    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755644    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755646    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755649    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755652    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755654    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755657    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:38:47.760817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755659    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:38:47.761365 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755662    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:38:47.761365 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755665    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:38:47.761365 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755667    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:38:47.761365 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755670    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:38:47.761365 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755672    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:38:47.761365 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:47.755675    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:38:47.761365 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.755680    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 16:38:47.761365 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.755778    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 05 16:38:47.761365 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.758888    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 05 16:38:47.761365 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.760623    2565 server.go:1019] "Starting client certificate rotation"
Aug 05 16:38:47.761365 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.760741    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 16:38:47.761365 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.760790    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 16:38:47.763557 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.763540    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 16:38:47.764713 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.764689    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 16:38:47.773650 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.773622    2565 log.go:25] "Validated CRI v1 runtime API"
Aug 05 16:38:47.776992 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.776968    2565 log.go:25] "Validated CRI v1 image API"
Aug 05 16:38:47.778508 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.778490    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 05 16:38:47.781807 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.781789    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 eabba323-2679-4d38-b78f-12c09fe980a6:/dev/nvme0n1p3 f1ed1f41-b71a-4eb7-bb65-c5fccbec68b2:/dev/nvme0n1p4]
Aug 05 16:38:47.781862 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.781807    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 05 16:38:47.787855 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.787750    2565 manager.go:216] Machine: {Timestamp:2026-08-05 16:38:47.785369935 +0000 UTC m=+0.367441581 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094445 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cd96b6ca5ffbd06efae7c0e40576f SystemUUID:ec2cd96b-6ca5-ffbd-06ef-ae7c0e40576f BootID:70ce31c5-1e81-4b10-8cf3-e617ab3c823a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5c:01:e1:4d:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5c:01:e1:4d:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:f0:1e:ab:f3:98 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 05 16:38:47.787855 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.787847    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 05 16:38:47.787968 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.787924    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 05 16:38:47.791627 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.791598    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 05 16:38:47.791761 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.791630    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-233.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 05 16:38:47.792460 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.792449    2565 topology_manager.go:138] "Creating topology manager with none policy"
Aug 05 16:38:47.792493 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.792462    2565 container_manager_linux.go:309] "Creating device plugin manager"
Aug 05 16:38:47.792493 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.792470    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 16:38:47.793194 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.793170    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 16:38:47.793289 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.793264    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 16:38:47.794509 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.794495    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 05 16:38:47.799703 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.799688    2565 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 16:38:47.800001 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.799989    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 05 16:38:47.800063 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.800029    2565 kubelet.go:486] "Attempting to sync node with API server"
Aug 05 16:38:47.800063 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.800044    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 05 16:38:47.800169 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.800064    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 05 16:38:47.800169 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.800078    2565 kubelet.go:398] "Adding apiserver pod source"
Aug 05 16:38:47.800169 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.800091    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 05 16:38:47.800515 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.800501    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 16:38:47.800585 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.800525    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 16:38:47.803006 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.802989    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 05 16:38:47.804864 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.804850    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 05 16:38:47.804928 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.804880    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 05 16:38:47.806388 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.806377    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 05 16:38:47.806441 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.806393    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 05 16:38:47.806441 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.806399    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 05 16:38:47.806441 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.806404    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 05 16:38:47.806441 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.806412    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 05 16:38:47.806441 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.806418    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 05 16:38:47.806441 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.806427    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 05 16:38:47.806441 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.806432    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 05 16:38:47.806441 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.806439    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 05 16:38:47.806441 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.806444    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 05 16:38:47.806658 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.806461    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 05 16:38:47.806658 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.806468    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 05 16:38:47.807355 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.807343    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 05 16:38:47.807406 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.807356    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 05 16:38:47.809507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.809479    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-233.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 05 16:38:47.809575 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.809502    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 05 16:38:47.809575 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.809532    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 05 16:38:47.810861 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.810849    2565 server.go:1268] "Started kubelet"
Aug 05 16:38:47.810930 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.810907    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 05 16:38:47.810977 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.810914    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 05 16:38:47.811019 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.810998    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 05 16:38:47.811838 ip-10-0-138-233 systemd[1]: Started Kubernetes Kubelet.
Aug 05 16:38:47.812357 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.812339    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 05 16:38:47.812832 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.812819    2565 server.go:310] "Adding debug handlers to kubelet server"
Aug 05 16:38:47.816790 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.815703    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-233.ec2.internal.18c8f62d90824be1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-233.ec2.internal,UID:ip-10-0-138-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-233.ec2.internal,},FirstTimestamp:2026-08-05 16:38:47.810821089 +0000 UTC m=+0.392892736,LastTimestamp:2026-08-05 16:38:47.810821089 +0000 UTC m=+0.392892736,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-233.ec2.internal,}"
Aug 05 16:38:47.818549 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.818531    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 05 16:38:47.819669 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.819652    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 05 16:38:47.819669 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.819663    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 05 16:38:47.819797 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.819741    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-233.ec2.internal\" not found"
Aug 05 16:38:47.820433 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.820418    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 05 16:38:47.820433 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.820430    2565 factory.go:55] Registering systemd factory
Aug 05 16:38:47.820576 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.820445    2565 factory.go:223] Registration of the systemd container factory successfully
Aug 05 16:38:47.820576 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.820421    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 05 16:38:47.820576 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.820488    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 05 16:38:47.820576 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.820563    2565 reconstruct.go:97] "Volume reconstruction finished"
Aug 05 16:38:47.820576 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.820572    2565 reconciler.go:29] "Reconciler: start to sync state"
Aug 05 16:38:47.820833 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.820816    2565 factory.go:153] Registering CRI-O factory
Aug 05 16:38:47.820833 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.820829    2565 factory.go:223] Registration of the crio container factory successfully
Aug 05 16:38:47.820951 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.820886    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 05 16:38:47.820951 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.820907    2565 factory.go:103] Registering Raw factory
Aug 05 16:38:47.820951 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.820918    2565 manager.go:1196] Started watching for new ooms in manager
Aug 05 16:38:47.821638 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.821622    2565 manager.go:349] Starting recovery of all containers
Aug 05 16:38:47.830291 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.830149    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 05 16:38:47.830291 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.830178    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 05 16:38:47.833620 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.832809    2565 manager.go:354] Recovery completed
Aug 05 16:38:47.836886 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.836871    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:38:47.838792 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.838767    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:38:47.838880 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.838808    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:38:47.838880 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.838825    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:38:47.839322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.839309    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 05 16:38:47.839322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.839315    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:38:47.839322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.839323    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 05 16:38:47.839467 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.839344    2565 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 16:38:47.840442 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.840397    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:38:47.840442 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.840424    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:38:47.840442 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.840439    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:38:47.841575 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.841561    2565 policy_none.go:49] "None policy: Start"
Aug 05 16:38:47.841640 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.841580    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 05 16:38:47.841640 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.841594    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 05 16:38:47.844059 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.844045    2565 policy_none.go:47] "Start"
Aug 05 16:38:47.849125 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.849031    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-233.ec2.internal.18c8f62d922d149f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-233.ec2.internal,UID:ip-10-0-138-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-233.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-233.ec2.internal,},FirstTimestamp:2026-08-05 16:38:47.838790815 +0000 UTC m=+0.420862467,LastTimestamp:2026-08-05 16:38:47.838790815 +0000 UTC m=+0.420862467,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-233.ec2.internal,}"
Aug 05 16:38:47.851412 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.851354    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-233.ec2.internal.18c8f62d922d764f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-233.ec2.internal,UID:ip-10-0-138-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-233.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-233.ec2.internal,},FirstTimestamp:2026-08-05 16:38:47.838815823 +0000 UTC m=+0.420887471,LastTimestamp:2026-08-05 16:38:47.838815823 +0000 UTC m=+0.420887471,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-233.ec2.internal,}"
Aug 05 16:38:47.858223 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.858146    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-233.ec2.internal.18c8f62d922db293  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-233.ec2.internal,UID:ip-10-0-138-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-233.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-233.ec2.internal,},FirstTimestamp:2026-08-05 16:38:47.838831251 +0000 UTC m=+0.420902902,LastTimestamp:2026-08-05 16:38:47.838831251 +0000 UTC m=+0.420902902,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-233.ec2.internal,}"
Aug 05 16:38:47.862110 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.862013    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-233.ec2.internal.18c8f62d922d149f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-233.ec2.internal.18c8f62d922d149f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-233.ec2.internal,UID:ip-10-0-138-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-233.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-233.ec2.internal,},FirstTimestamp:2026-08-05 16:38:47.838790815 +0000 UTC m=+0.420862467,LastTimestamp:2026-08-05 16:38:47.840409888 +0000 UTC m=+0.422481539,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-233.ec2.internal,}"
Aug 05 16:38:47.871109 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.871034    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-233.ec2.internal.18c8f62d922d764f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-233.ec2.internal.18c8f62d922d764f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-233.ec2.internal,UID:ip-10-0-138-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-233.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-233.ec2.internal,},FirstTimestamp:2026-08-05 16:38:47.838815823 +0000 UTC m=+0.420887471,LastTimestamp:2026-08-05 16:38:47.840431351 +0000 UTC m=+0.422503001,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-233.ec2.internal,}"
Aug 05 16:38:47.894461 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.876648    2565 manager.go:337] "Starting Device Plugin manager"
Aug 05 16:38:47.894461 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.876676    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 05 16:38:47.894461 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.876691    2565 server.go:87] "Starting device plugin registration server"
Aug 05 16:38:47.894461 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.876943    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 05 16:38:47.894461 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.876956    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 05 16:38:47.894461 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.877032    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 05 16:38:47.894461 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.877116    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 05 16:38:47.894461 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.877123    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 05 16:38:47.894461 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.877769    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 05 16:38:47.894461 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.877806    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-233.ec2.internal\" not found"
Aug 05 16:38:47.894461 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.878258    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-46hc6"
Aug 05 16:38:47.894461 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.881736    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-233.ec2.internal.18c8f62d922db293\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-233.ec2.internal.18c8f62d922db293  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-233.ec2.internal,UID:ip-10-0-138-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-233.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-233.ec2.internal,},FirstTimestamp:2026-08-05 16:38:47.838831251 +0000 UTC m=+0.420902902,LastTimestamp:2026-08-05 16:38:47.840446746 +0000 UTC m=+0.422518404,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-233.ec2.internal,}"
Aug 05 16:38:47.894461 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.886316    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-46hc6"
Aug 05 16:38:47.894461 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.892240    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-233.ec2.internal.18c8f62d94919dc9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-233.ec2.internal,UID:ip-10-0-138-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-138-233.ec2.internal,},FirstTimestamp:2026-08-05 16:38:47.878933961 +0000 UTC m=+0.461005602,LastTimestamp:2026-08-05 16:38:47.878933961 +0000 UTC m=+0.461005602,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-233.ec2.internal,}"
Aug 05 16:38:47.944918 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.944864    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 05 16:38:47.946090 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.946066    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 05 16:38:47.946215 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.946119    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 05 16:38:47.946215 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.946143    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 05 16:38:47.946215 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.946177    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 05 16:38:47.959863 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.959840    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:38:47.978073 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.978055    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:38:47.979080 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.979064    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:38:47.979284 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.979112    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:38:47.979284 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.979128    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:38:47.979284 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.979155    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-233.ec2.internal"
Aug 05 16:38:47.989725 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:47.989682    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-233.ec2.internal"
Aug 05 16:38:47.989725 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:47.989702    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-233.ec2.internal\": node \"ip-10-0-138-233.ec2.internal\" not found"
Aug 05 16:38:48.027113 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:48.027074    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-233.ec2.internal\" not found"
Aug 05 16:38:48.046267 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.046221    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-233.ec2.internal"]
Aug 05 16:38:48.046389 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.046307    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:38:48.047791 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.047774    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:38:48.047886 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.047809    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:38:48.047886 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.047823    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:38:48.050294 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.050278    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:38:48.050389 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.050375    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal"
Aug 05 16:38:48.050434 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.050409    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:38:48.051282 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.051265    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:38:48.051282 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.051274    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:38:48.051389 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.051293    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:38:48.051389 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.051296    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:38:48.051389 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.051304    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:38:48.051389 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.051305    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:38:48.055293 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.053805    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-233.ec2.internal"
Aug 05 16:38:48.055293 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.053857    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:38:48.056273 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.056255    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:38:48.056342 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.056287    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:38:48.056342 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.056301    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:38:48.081825 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:48.081802    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-233.ec2.internal\" not found" node="ip-10-0-138-233.ec2.internal"
Aug 05 16:38:48.086300 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:48.086285    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-233.ec2.internal\" not found" node="ip-10-0-138-233.ec2.internal"
Aug 05 16:38:48.122508 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.122483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2195b22536e7a63f1b330fe10277dc4d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-233.ec2.internal\" (UID: \"2195b22536e7a63f1b330fe10277dc4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-233.ec2.internal"
Aug 05 16:38:48.122613 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.122532    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d5ca96e55fb213d9a4ddacd00813d730-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal\" (UID: \"d5ca96e55fb213d9a4ddacd00813d730\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal"
Aug 05 16:38:48.122613 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.122554    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5ca96e55fb213d9a4ddacd00813d730-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal\" (UID: \"d5ca96e55fb213d9a4ddacd00813d730\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal"
Aug 05 16:38:48.127586 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:48.127571    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-233.ec2.internal\" not found"
Aug 05 16:38:48.223456 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.223426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2195b22536e7a63f1b330fe10277dc4d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-233.ec2.internal\" (UID: \"2195b22536e7a63f1b330fe10277dc4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-233.ec2.internal"
Aug 05 16:38:48.223570 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.223461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d5ca96e55fb213d9a4ddacd00813d730-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal\" (UID: \"d5ca96e55fb213d9a4ddacd00813d730\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal"
Aug 05 16:38:48.223570 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.223485    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5ca96e55fb213d9a4ddacd00813d730-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal\" (UID: \"d5ca96e55fb213d9a4ddacd00813d730\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal"
Aug 05 16:38:48.223570 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.223538    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5ca96e55fb213d9a4ddacd00813d730-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal\" (UID: \"d5ca96e55fb213d9a4ddacd00813d730\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal"
Aug 05 16:38:48.223570 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.223555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2195b22536e7a63f1b330fe10277dc4d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-233.ec2.internal\" (UID: \"2195b22536e7a63f1b330fe10277dc4d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-233.ec2.internal"
Aug 05 16:38:48.223712 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.223586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d5ca96e55fb213d9a4ddacd00813d730-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal\" (UID: \"d5ca96e55fb213d9a4ddacd00813d730\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal"
Aug 05 16:38:48.228521 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:48.228504    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-233.ec2.internal\" not found"
Aug 05 16:38:48.329331 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:48.329268    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-233.ec2.internal\" not found"
Aug 05 16:38:48.384494 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.384458    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal"
Aug 05 16:38:48.388239 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.388224    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-233.ec2.internal"
Aug 05 16:38:48.429496 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:48.429465    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-233.ec2.internal\" not found"
Aug 05 16:38:48.529985 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:48.529956    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-233.ec2.internal\" not found"
Aug 05 16:38:48.630911 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:48.630841    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-233.ec2.internal\" not found"
Aug 05 16:38:48.731942 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:48.731912    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-233.ec2.internal\" not found"
Aug 05 16:38:48.760935 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.760899    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 05 16:38:48.761599 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.761060    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 16:38:48.832217 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:48.832182    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-233.ec2.internal\" not found"
Aug 05 16:38:48.891688 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.891600    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 16:33:48 +0000 UTC" deadline="2028-05-15 04:00:41.110398918 +0000 UTC"
Aug 05 16:38:48.891688 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.891646    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15563h21m52.218755641s"
Aug 05 16:38:48.926162 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.926137    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:38:48.927678 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.927657    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:38:48.927785 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.927697    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:38:48.927785 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:48.927712    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:38:48.932253 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:48.932234    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-233.ec2.internal\" not found"
Aug 05 16:38:49.033411 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:49.033377    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-233.ec2.internal\" not found"
Aug 05 16:38:49.072436 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.072414    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:38:49.075867 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:49.075834    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5ca96e55fb213d9a4ddacd00813d730.slice/crio-c073ecc314eedc93e4b87658dd1d601549d8bd2ccd0e88398c4477129cc0b8b3 WatchSource:0}: Error finding container c073ecc314eedc93e4b87658dd1d601549d8bd2ccd0e88398c4477129cc0b8b3: Status 404 returned error can't find the container with id c073ecc314eedc93e4b87658dd1d601549d8bd2ccd0e88398c4477129cc0b8b3
Aug 05 16:38:49.084269 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.084245    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:38:49.090014 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:49.089990    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2195b22536e7a63f1b330fe10277dc4d.slice/crio-a83a9136d44b4c6b7a514531a0278c9e307c1960d0497a1b8d25a867ae502045 WatchSource:0}: Error finding container a83a9136d44b4c6b7a514531a0278c9e307c1960d0497a1b8d25a867ae502045: Status 404 returned error can't find the container with id a83a9136d44b4c6b7a514531a0278c9e307c1960d0497a1b8d25a867ae502045
Aug 05 16:38:49.114221 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.114196    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:38:49.133968 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:49.133945    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-233.ec2.internal\" not found"
Aug 05 16:38:49.221711 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.221642    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:38:49.321250 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.321214    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-233.ec2.internal"
Aug 05 16:38:49.332976 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.332954    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 16:38:49.333679 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.333665    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal"
Aug 05 16:38:49.350325 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.350302    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 16:38:49.802410 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.802374    2565 apiserver.go:52] "Watching apiserver"
Aug 05 16:38:49.812436 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.812406    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 05 16:38:49.813728 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.813698    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal","openshift-multus/multus-8qwgf","openshift-network-diagnostics/network-check-target-dkx9l","openshift-network-operator/iptables-alerter-xl9st","openshift-ovn-kubernetes/ovnkube-node-7klt7","kube-system/global-pull-secret-syncer-qjpz2","kube-system/konnectivity-agent-xgbcz","kube-system/kube-apiserver-proxy-ip-10-0-138-233.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4","openshift-cluster-node-tuning-operator/tuned-gd577","openshift-dns/node-resolver-8m5sn","openshift-multus/multus-additional-cni-plugins-z77rg","openshift-multus/network-metrics-daemon-pjntd","openshift-image-registry/node-ca-njsvq"]
Aug 05 16:38:49.816452 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.816429    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xgbcz"
Aug 05 16:38:49.818919 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.818894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:38:49.819038 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:49.819008    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:38:49.819844 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.819824    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v7hq8\""
Aug 05 16:38:49.820131 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.820112    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 05 16:38:49.820456 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.820432    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 05 16:38:49.821199 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.820615    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 05 16:38:49.821485 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.821464    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:38:49.821557 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:49.821529    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:38:49.824049 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.824018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xl9st"
Aug 05 16:38:49.828110 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.826957    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.828717 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.828402    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 05 16:38:49.828717 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.828542    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:38:49.829054 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.828998    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ks7kz\""
Aug 05 16:38:49.829322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.829302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:49.829415 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:49.829394    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:38:49.830746 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.830653    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 05 16:38:49.830995 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.830963    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 05 16:38:49.831080 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.831059    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cflnw\""
Aug 05 16:38:49.831352 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.831334    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 05 16:38:49.831745 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.831720    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 05 16:38:49.831961 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.831944    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 05 16:38:49.832044 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.831959    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 05 16:38:49.832445 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.832393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/382b20e8-1d7c-4476-826b-f9abf1316d84-agent-certs\") pod \"konnectivity-agent-xgbcz\" (UID: \"382b20e8-1d7c-4476-826b-f9abf1316d84\") " pod="kube-system/konnectivity-agent-xgbcz"
Aug 05 16:38:49.832445 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.832431    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/382b20e8-1d7c-4476-826b-f9abf1316d84-konnectivity-ca\") pod \"konnectivity-agent-xgbcz\" (UID: \"382b20e8-1d7c-4476-826b-f9abf1316d84\") " pod="kube-system/konnectivity-agent-xgbcz"
Aug 05 16:38:49.832566 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.832436    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 05 16:38:49.832566 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.832460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs\") pod \"network-metrics-daemon-pjntd\" (UID: \"57bcc436-b7a1-4fe4-a41c-3e531fdab605\") " pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:38:49.832566 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.832503    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dn47\" (UniqueName: \"kubernetes.io/projected/57bcc436-b7a1-4fe4-a41c-3e531fdab605-kube-api-access-7dn47\") pod \"network-metrics-daemon-pjntd\" (UID: \"57bcc436-b7a1-4fe4-a41c-3e531fdab605\") " pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:38:49.832566 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.832531    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqf47\" (UniqueName: \"kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47\") pod \"network-check-target-dkx9l\" (UID: \"7fd3c40e-e8fb-4df3-b357-c927dd8340c6\") " pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:38:49.832772 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.832716    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:49.834494 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.834466    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-njsvq"
Aug 05 16:38:49.834965 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.834947    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 16:38:49.835300 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.835283    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j9p4z\""
Aug 05 16:38:49.835342 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.835311    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 05 16:38:49.835470 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.835450    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 05 16:38:49.835589 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.835550    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 05 16:38:49.837324 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.836931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.837688 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.837666    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 05 16:38:49.837964 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.837944    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 05 16:38:49.838373 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.838358    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 05 16:38:49.838580 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.838563    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zmncd\""
Aug 05 16:38:49.839379 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.839359    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 05 16:38:49.839812 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.839605    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 05 16:38:49.840076 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.840058    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:49.842204 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.841541    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 05 16:38:49.842204 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.841833    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 05 16:38:49.842204 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.842004    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n42xv\""
Aug 05 16:38:49.843845 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.842630    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8m5sn"
Aug 05 16:38:49.843845 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.843395    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:38:49.843845 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.843691    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 05 16:38:49.843845 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.843732    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2wfzk\""
Aug 05 16:38:49.846434 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.845216    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:49.846434 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.846045    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m2jj7\""
Aug 05 16:38:49.846434 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.846063    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 05 16:38:49.846434 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.846373    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 05 16:38:49.847685 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.847665    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 05 16:38:49.848013 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.848000    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 05 16:38:49.848781 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.848404    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-66l9p\""
Aug 05 16:38:49.856647 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.856611    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kqtsp"
Aug 05 16:38:49.865697 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.865320    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kqtsp"
Aug 05 16:38:49.922050 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.921922    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 05 16:38:49.933423 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.933396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-system-cni-dir\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.933529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.933438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d38b9ecf-3aa5-48e4-8133-8e582d025c27-os-release\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:49.933529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.933468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-etc-kubernetes\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.933529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.933492    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-modprobe-d\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:49.933529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.933521    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g858\" (UniqueName: \"kubernetes.io/projected/e3ddc572-cfcd-4574-bc5d-47d7c976dce9-kube-api-access-8g858\") pod \"iptables-alerter-xl9st\" (UID: \"e3ddc572-cfcd-4574-bc5d-47d7c976dce9\") " pod="openshift-network-operator/iptables-alerter-xl9st"
Aug 05 16:38:49.933796 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.933545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-run-systemd\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.933796 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.933569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-cni-bin\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.933796 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.933601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bf8e77a-297f-4c1e-b328-5a3f67b1933d-tmp-dir\") pod \"node-resolver-8m5sn\" (UID: \"7bf8e77a-297f-4c1e-b328-5a3f67b1933d\") " pod="openshift-dns/node-resolver-8m5sn"
Aug 05 16:38:49.933796 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.933628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c78cfde8-7c7b-4364-863a-116fe6296403-kubelet-config\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:49.933796 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.933651    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/039cfccd-9099-4601-ad17-e55a36a84c17-serviceca\") pod \"node-ca-njsvq\" (UID: \"039cfccd-9099-4601-ad17-e55a36a84c17\") " pod="openshift-image-registry/node-ca-njsvq"
Aug 05 16:38:49.933796 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.933684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-run-k8s-cni-cncf-io\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.933796 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.933709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d38b9ecf-3aa5-48e4-8133-8e582d025c27-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:49.933796 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.933734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-systemd-units\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.933796 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.933767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/459a3f5b-0732-46a3-af8a-6e65a64a571a-ovn-node-metrics-cert\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.933796 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.933792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-multus-socket-dir-parent\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.934334 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-var-lib-cni-bin\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.934396 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934351    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t42gj\" (UniqueName: \"kubernetes.io/projected/ec63c906-2568-429c-ae7e-663ee1273c94-kube-api-access-t42gj\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:49.934396 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6765g\" (UniqueName: \"kubernetes.io/projected/d38b9ecf-3aa5-48e4-8133-8e582d025c27-kube-api-access-6765g\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:49.934502 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-var-lib-openvswitch\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.934502 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-device-dir\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:49.934502 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/039cfccd-9099-4601-ad17-e55a36a84c17-host\") pod \"node-ca-njsvq\" (UID: \"039cfccd-9099-4601-ad17-e55a36a84c17\") " pod="openshift-image-registry/node-ca-njsvq"
Aug 05 16:38:49.934658 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f07222b-4188-45a8-83c7-abc385cb5e4a-cni-binary-copy\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.934658 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcrdt\" (UniqueName: \"kubernetes.io/projected/6f07222b-4188-45a8-83c7-abc385cb5e4a-kube-api-access-vcrdt\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.934658 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934554    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-sys-fs\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:49.934658 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqf47\" (UniqueName: \"kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47\") pod \"network-check-target-dkx9l\" (UID: \"7fd3c40e-e8fb-4df3-b357-c927dd8340c6\") " pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:38:49.934658 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-var-lib-kubelet\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.934658 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-run-multus-certs\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.934945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-var-lib-kubelet\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:49.934945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-node-log\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.934945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-hostroot\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.934945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-run\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:49.934945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3ddc572-cfcd-4574-bc5d-47d7c976dce9-host-slash\") pod \"iptables-alerter-xl9st\" (UID: \"e3ddc572-cfcd-4574-bc5d-47d7c976dce9\") " pod="openshift-network-operator/iptables-alerter-xl9st"
Aug 05 16:38:49.934945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-run-ovn-kubernetes\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.934945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934816    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-cni-netd\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.934945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/459a3f5b-0732-46a3-af8a-6e65a64a571a-ovnkube-script-lib\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.934945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934870    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzfqv\" (UniqueName: \"kubernetes.io/projected/7bf8e77a-297f-4c1e-b328-5a3f67b1933d-kube-api-access-dzfqv\") pod \"node-resolver-8m5sn\" (UID: \"7bf8e77a-297f-4c1e-b328-5a3f67b1933d\") " pod="openshift-dns/node-resolver-8m5sn"
Aug 05 16:38:49.934945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934893    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-multus-cni-dir\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.934945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-socket-dir\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:49.934945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f07222b-4188-45a8-83c7-abc385cb5e4a-multus-daemon-config\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.935594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.934975    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-lib-modules\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:49.935594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935053    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d38b9ecf-3aa5-48e4-8133-8e582d025c27-system-cni-dir\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:49.935594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d38b9ecf-3aa5-48e4-8133-8e582d025c27-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:49.935594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935120    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d38b9ecf-3aa5-48e4-8133-8e582d025c27-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:49.935594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935151    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-slash\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.935594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/382b20e8-1d7c-4476-826b-f9abf1316d84-agent-certs\") pod \"konnectivity-agent-xgbcz\" (UID: \"382b20e8-1d7c-4476-826b-f9abf1316d84\") " pod="kube-system/konnectivity-agent-xgbcz"
Aug 05 16:38:49.935594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-os-release\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.935594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-sysconfig\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:49.935594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/382b20e8-1d7c-4476-826b-f9abf1316d84-konnectivity-ca\") pod \"konnectivity-agent-xgbcz\" (UID: \"382b20e8-1d7c-4476-826b-f9abf1316d84\") " pod="kube-system/konnectivity-agent-xgbcz"
Aug 05 16:38:49.935594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935403    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-sysctl-d\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:49.935594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-systemd\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:49.935594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-kubelet\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.935594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935509    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-run-netns\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.935594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-run-ovn\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.935594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935579    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935884    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-log-socket\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzrz7\" (UniqueName: \"kubernetes.io/projected/039cfccd-9099-4601-ad17-e55a36a84c17-kube-api-access-pzrz7\") pod \"node-ca-njsvq\" (UID: \"039cfccd-9099-4601-ad17-e55a36a84c17\") " pod="openshift-image-registry/node-ca-njsvq"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-run-netns\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3ddc572-cfcd-4574-bc5d-47d7c976dce9-iptables-alerter-script\") pod \"iptables-alerter-xl9st\" (UID: \"e3ddc572-cfcd-4574-bc5d-47d7c976dce9\") " pod="openshift-network-operator/iptables-alerter-xl9st"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.935995    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936020    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/459a3f5b-0732-46a3-af8a-6e65a64a571a-ovnkube-config\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7bf8e77a-297f-4c1e-b328-5a3f67b1933d-hosts-file\") pod \"node-resolver-8m5sn\" (UID: \"7bf8e77a-297f-4c1e-b328-5a3f67b1933d\") " pod="openshift-dns/node-resolver-8m5sn"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936065    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c78cfde8-7c7b-4364-863a-116fe6296403-dbus\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs\") pod \"network-metrics-daemon-pjntd\" (UID: \"57bcc436-b7a1-4fe4-a41c-3e531fdab605\") " pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/382b20e8-1d7c-4476-826b-f9abf1316d84-konnectivity-ca\") pod \"konnectivity-agent-xgbcz\" (UID: \"382b20e8-1d7c-4476-826b-f9abf1316d84\") " pod="kube-system/konnectivity-agent-xgbcz"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dn47\" (UniqueName: \"kubernetes.io/projected/57bcc436-b7a1-4fe4-a41c-3e531fdab605-kube-api-access-7dn47\") pod \"network-metrics-daemon-pjntd\" (UID: \"57bcc436-b7a1-4fe4-a41c-3e531fdab605\") " pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ec63c906-2568-429c-ae7e-663ee1273c94-etc-tuned\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec63c906-2568-429c-ae7e-663ee1273c94-tmp\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936301    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d38b9ecf-3aa5-48e4-8133-8e582d025c27-cnibin\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936332    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-run-openvswitch\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.936507 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:49.936355    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-cnibin\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:49.936446    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs podName:57bcc436-b7a1-4fe4-a41c-3e531fdab605 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:50.436405333 +0000 UTC m=+3.018476984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs") pod "network-metrics-daemon-pjntd" (UID: "57bcc436-b7a1-4fe4-a41c-3e531fdab605") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-var-lib-cni-multus\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-etc-openvswitch\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h22gq\" (UniqueName: \"kubernetes.io/projected/459a3f5b-0732-46a3-af8a-6e65a64a571a-kube-api-access-h22gq\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-sysctl-conf\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-sys\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-host\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936708    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d38b9ecf-3aa5-48e4-8133-8e582d025c27-cni-binary-copy\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/459a3f5b-0732-46a3-af8a-6e65a64a571a-env-overrides\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936760    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-registration-dir\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94xvt\" (UniqueName: \"kubernetes.io/projected/10b4545f-a570-4bdf-8b66-28ea371a9b7e-kube-api-access-94xvt\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-multus-conf-dir\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-kubernetes\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:49.937431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.936877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:49.940134 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.940109    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/382b20e8-1d7c-4476-826b-f9abf1316d84-agent-certs\") pod \"konnectivity-agent-xgbcz\" (UID: \"382b20e8-1d7c-4476-826b-f9abf1316d84\") " pod="kube-system/konnectivity-agent-xgbcz"
Aug 05 16:38:49.944703 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:49.944678    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:38:49.944703 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:49.944704    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:38:49.944870 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:49.944717    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xqf47 for pod openshift-network-diagnostics/network-check-target-dkx9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:38:49.944870 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:49.944772    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47 podName:7fd3c40e-e8fb-4df3-b357-c927dd8340c6 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:50.444751611 +0000 UTC m=+3.026823247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xqf47" (UniqueName: "kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47") pod "network-check-target-dkx9l" (UID: "7fd3c40e-e8fb-4df3-b357-c927dd8340c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:38:49.958024 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.957259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-233.ec2.internal" event={"ID":"2195b22536e7a63f1b330fe10277dc4d","Type":"ContainerStarted","Data":"a83a9136d44b4c6b7a514531a0278c9e307c1960d0497a1b8d25a867ae502045"}
Aug 05 16:38:49.958024 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.957554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dn47\" (UniqueName: \"kubernetes.io/projected/57bcc436-b7a1-4fe4-a41c-3e531fdab605-kube-api-access-7dn47\") pod \"network-metrics-daemon-pjntd\" (UID: \"57bcc436-b7a1-4fe4-a41c-3e531fdab605\") " pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:38:49.959453 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:49.959427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal" event={"ID":"d5ca96e55fb213d9a4ddacd00813d730","Type":"ContainerStarted","Data":"c073ecc314eedc93e4b87658dd1d601549d8bd2ccd0e88398c4477129cc0b8b3"}
Aug 05 16:38:50.037836 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.037804    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-run-ovn-kubernetes\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.037836 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.037841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-cni-netd\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.038132 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.037858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/459a3f5b-0732-46a3-af8a-6e65a64a571a-ovnkube-script-lib\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.038132 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.037881    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzfqv\" (UniqueName: \"kubernetes.io/projected/7bf8e77a-297f-4c1e-b328-5a3f67b1933d-kube-api-access-dzfqv\") pod \"node-resolver-8m5sn\" (UID: \"7bf8e77a-297f-4c1e-b328-5a3f67b1933d\") " pod="openshift-dns/node-resolver-8m5sn"
Aug 05 16:38:50.038132 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.037905    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-multus-cni-dir\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.038132 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.037923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-socket-dir\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:50.038132 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.037942    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f07222b-4188-45a8-83c7-abc385cb5e4a-multus-daemon-config\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.038132 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.037957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-lib-modules\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.038132 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.037974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d38b9ecf-3aa5-48e4-8133-8e582d025c27-system-cni-dir\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.038132 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.037990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d38b9ecf-3aa5-48e4-8133-8e582d025c27-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.038132 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d38b9ecf-3aa5-48e4-8133-8e582d025c27-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.038132 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-slash\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.038132 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-os-release\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.038132 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-sysconfig\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.038132 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-sysctl-d\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.038132 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038098    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-systemd\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.038132 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-kubelet\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038163    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-run-netns\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-run-ovn\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-log-socket\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzrz7\" (UniqueName: \"kubernetes.io/projected/039cfccd-9099-4601-ad17-e55a36a84c17-kube-api-access-pzrz7\") pod \"node-ca-njsvq\" (UID: \"039cfccd-9099-4601-ad17-e55a36a84c17\") " pod="openshift-image-registry/node-ca-njsvq"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-run-netns\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3ddc572-cfcd-4574-bc5d-47d7c976dce9-iptables-alerter-script\") pod \"iptables-alerter-xl9st\" (UID: \"e3ddc572-cfcd-4574-bc5d-47d7c976dce9\") " pod="openshift-network-operator/iptables-alerter-xl9st"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-lib-modules\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/459a3f5b-0732-46a3-af8a-6e65a64a571a-ovnkube-config\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038380    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d38b9ecf-3aa5-48e4-8133-8e582d025c27-system-cni-dir\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038391    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7bf8e77a-297f-4c1e-b328-5a3f67b1933d-hosts-file\") pod \"node-resolver-8m5sn\" (UID: \"7bf8e77a-297f-4c1e-b328-5a3f67b1933d\") " pod="openshift-dns/node-resolver-8m5sn"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c78cfde8-7c7b-4364-863a-116fe6296403-dbus\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ec63c906-2568-429c-ae7e-663ee1273c94-etc-tuned\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec63c906-2568-429c-ae7e-663ee1273c94-tmp\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.038958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d38b9ecf-3aa5-48e4-8133-8e582d025c27-cnibin\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-run-openvswitch\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-cnibin\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-var-lib-cni-multus\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038689    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-etc-openvswitch\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h22gq\" (UniqueName: \"kubernetes.io/projected/459a3f5b-0732-46a3-af8a-6e65a64a571a-kube-api-access-h22gq\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038740    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-sysctl-conf\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-sys\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-host\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d38b9ecf-3aa5-48e4-8133-8e582d025c27-cni-binary-copy\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/459a3f5b-0732-46a3-af8a-6e65a64a571a-env-overrides\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-registration-dir\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038894    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d38b9ecf-3aa5-48e4-8133-8e582d025c27-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94xvt\" (UniqueName: \"kubernetes.io/projected/10b4545f-a570-4bdf-8b66-28ea371a9b7e-kube-api-access-94xvt\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-multus-conf-dir\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038952    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-kubernetes\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.039804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.038981    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-system-cni-dir\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d38b9ecf-3aa5-48e4-8133-8e582d025c27-os-release\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-etc-kubernetes\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-modprobe-d\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g858\" (UniqueName: \"kubernetes.io/projected/e3ddc572-cfcd-4574-bc5d-47d7c976dce9-kube-api-access-8g858\") pod \"iptables-alerter-xl9st\" (UID: \"e3ddc572-cfcd-4574-bc5d-47d7c976dce9\") " pod="openshift-network-operator/iptables-alerter-xl9st"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039107    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-run-systemd\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039184    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-log-socket\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-cni-bin\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039268    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-host\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bf8e77a-297f-4c1e-b328-5a3f67b1933d-tmp-dir\") pod \"node-resolver-8m5sn\" (UID: \"7bf8e77a-297f-4c1e-b328-5a3f67b1933d\") " pod="openshift-dns/node-resolver-8m5sn"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c78cfde8-7c7b-4364-863a-116fe6296403-kubelet-config\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/039cfccd-9099-4601-ad17-e55a36a84c17-serviceca\") pod \"node-ca-njsvq\" (UID: \"039cfccd-9099-4601-ad17-e55a36a84c17\") " pod="openshift-image-registry/node-ca-njsvq"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-run-k8s-cni-cncf-io\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d38b9ecf-3aa5-48e4-8133-8e582d025c27-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039408    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-run-netns\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-systemd-units\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.040698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-registration-dir\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/459a3f5b-0732-46a3-af8a-6e65a64a571a-ovn-node-metrics-cert\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-multus-socket-dir-parent\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bf8e77a-297f-4c1e-b328-5a3f67b1933d-tmp-dir\") pod \"node-resolver-8m5sn\" (UID: \"7bf8e77a-297f-4c1e-b328-5a3f67b1933d\") " pod="openshift-dns/node-resolver-8m5sn"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-var-lib-cni-bin\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t42gj\" (UniqueName: \"kubernetes.io/projected/ec63c906-2568-429c-ae7e-663ee1273c94-kube-api-access-t42gj\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039636    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d38b9ecf-3aa5-48e4-8133-8e582d025c27-cnibin\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6765g\" (UniqueName: \"kubernetes.io/projected/d38b9ecf-3aa5-48e4-8133-8e582d025c27-kube-api-access-6765g\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039650    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c78cfde8-7c7b-4364-863a-116fe6296403-kubelet-config\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-var-lib-openvswitch\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d38b9ecf-3aa5-48e4-8133-8e582d025c27-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039722    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-var-lib-openvswitch\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-sys\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039780    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-slash\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-cnibin\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-var-lib-cni-multus\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.041584 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039876    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-os-release\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039889    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-etc-openvswitch\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039931    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-sysconfig\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039986    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-sysctl-conf\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-cni-bin\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040035    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-run-openvswitch\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-sysctl-d\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040113    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/039cfccd-9099-4601-ad17-e55a36a84c17-serviceca\") pod \"node-ca-njsvq\" (UID: \"039cfccd-9099-4601-ad17-e55a36a84c17\") " pod="openshift-image-registry/node-ca-njsvq"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040121    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-systemd\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040130    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d38b9ecf-3aa5-48e4-8133-8e582d025c27-cni-binary-copy\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-device-dir\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040192    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-kubelet\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/039cfccd-9099-4601-ad17-e55a36a84c17-host\") pod \"node-ca-njsvq\" (UID: \"039cfccd-9099-4601-ad17-e55a36a84c17\") " pod="openshift-image-registry/node-ca-njsvq"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040218    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-run-k8s-cni-cncf-io\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040240    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f07222b-4188-45a8-83c7-abc385cb5e4a-cni-binary-copy\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040248    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-run-netns\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcrdt\" (UniqueName: \"kubernetes.io/projected/6f07222b-4188-45a8-83c7-abc385cb5e4a-kube-api-access-vcrdt\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040289    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-run-ovn\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.042448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040299    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-sys-fs\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-run-ovn-kubernetes\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-var-lib-kubelet\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-run-multus-certs\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040377    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-host-cni-netd\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-var-lib-kubelet\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040427    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-node-log\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f07222b-4188-45a8-83c7-abc385cb5e4a-multus-daemon-config\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-hostroot\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-run\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3ddc572-cfcd-4574-bc5d-47d7c976dce9-host-slash\") pod \"iptables-alerter-xl9st\" (UID: \"e3ddc572-cfcd-4574-bc5d-47d7c976dce9\") " pod="openshift-network-operator/iptables-alerter-xl9st"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040592    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-multus-cni-dir\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3ddc572-cfcd-4574-bc5d-47d7c976dce9-host-slash\") pod \"iptables-alerter-xl9st\" (UID: \"e3ddc572-cfcd-4574-bc5d-47d7c976dce9\") " pod="openshift-network-operator/iptables-alerter-xl9st"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040664    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-socket-dir\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040678    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-multus-socket-dir-parent\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040705    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-system-cni-dir\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040721    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-var-lib-cni-bin\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.040868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/459a3f5b-0732-46a3-af8a-6e65a64a571a-ovnkube-script-lib\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.043401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.039607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d38b9ecf-3aa5-48e4-8133-8e582d025c27-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:50.041002    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:50.041061    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret podName:c78cfde8-7c7b-4364-863a-116fe6296403 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:50.541042873 +0000 UTC m=+3.123114521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret") pod "global-pull-secret-syncer-qjpz2" (UID: "c78cfde8-7c7b-4364-863a-116fe6296403") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041067    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3ddc572-cfcd-4574-bc5d-47d7c976dce9-iptables-alerter-script\") pod \"iptables-alerter-xl9st\" (UID: \"e3ddc572-cfcd-4574-bc5d-47d7c976dce9\") " pod="openshift-network-operator/iptables-alerter-xl9st"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/459a3f5b-0732-46a3-af8a-6e65a64a571a-ovnkube-config\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7bf8e77a-297f-4c1e-b328-5a3f67b1933d-hosts-file\") pod \"node-resolver-8m5sn\" (UID: \"7bf8e77a-297f-4c1e-b328-5a3f67b1933d\") " pod="openshift-dns/node-resolver-8m5sn"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041264    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/039cfccd-9099-4601-ad17-e55a36a84c17-host\") pod \"node-ca-njsvq\" (UID: \"039cfccd-9099-4601-ad17-e55a36a84c17\") " pod="openshift-image-registry/node-ca-njsvq"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041282    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-kubernetes\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041303    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-multus-conf-dir\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041328    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/459a3f5b-0732-46a3-af8a-6e65a64a571a-env-overrides\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041409    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041430    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f07222b-4188-45a8-83c7-abc385cb5e4a-cni-binary-copy\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041471    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-etc-modprobe-d\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d38b9ecf-3aa5-48e4-8133-8e582d025c27-os-release\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041579    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-etc-kubernetes\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-var-lib-kubelet\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-var-lib-kubelet\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041693    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c78cfde8-7c7b-4364-863a-116fe6296403-dbus\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:50.044322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041698    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ec63c906-2568-429c-ae7e-663ee1273c94-run\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.045247 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-hostroot\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.045247 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041698    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/459a3f5b-0732-46a3-af8a-6e65a64a571a-ovn-node-metrics-cert\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.045247 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041729    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-node-log\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.045247 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041830    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f07222b-4188-45a8-83c7-abc385cb5e4a-host-run-multus-certs\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.045247 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041847    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-device-dir\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:50.045247 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041886    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-systemd-units\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.045247 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041899    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10b4545f-a570-4bdf-8b66-28ea371a9b7e-sys-fs\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:50.045247 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.041942    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/459a3f5b-0732-46a3-af8a-6e65a64a571a-run-systemd\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.045247 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.043847    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ec63c906-2568-429c-ae7e-663ee1273c94-etc-tuned\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.047591 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.047471    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec63c906-2568-429c-ae7e-663ee1273c94-tmp\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.057451 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.057263    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:38:50.058988 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.058724    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t42gj\" (UniqueName: \"kubernetes.io/projected/ec63c906-2568-429c-ae7e-663ee1273c94-kube-api-access-t42gj\") pod \"tuned-gd577\" (UID: \"ec63c906-2568-429c-ae7e-663ee1273c94\") " pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.061518 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.061450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzfqv\" (UniqueName: \"kubernetes.io/projected/7bf8e77a-297f-4c1e-b328-5a3f67b1933d-kube-api-access-dzfqv\") pod \"node-resolver-8m5sn\" (UID: \"7bf8e77a-297f-4c1e-b328-5a3f67b1933d\") " pod="openshift-dns/node-resolver-8m5sn"
Aug 05 16:38:50.061518 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.061451    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g858\" (UniqueName: \"kubernetes.io/projected/e3ddc572-cfcd-4574-bc5d-47d7c976dce9-kube-api-access-8g858\") pod \"iptables-alerter-xl9st\" (UID: \"e3ddc572-cfcd-4574-bc5d-47d7c976dce9\") " pod="openshift-network-operator/iptables-alerter-xl9st"
Aug 05 16:38:50.061840 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.061807    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzrz7\" (UniqueName: \"kubernetes.io/projected/039cfccd-9099-4601-ad17-e55a36a84c17-kube-api-access-pzrz7\") pod \"node-ca-njsvq\" (UID: \"039cfccd-9099-4601-ad17-e55a36a84c17\") " pod="openshift-image-registry/node-ca-njsvq"
Aug 05 16:38:50.062680 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.062633    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94xvt\" (UniqueName: \"kubernetes.io/projected/10b4545f-a570-4bdf-8b66-28ea371a9b7e-kube-api-access-94xvt\") pod \"aws-ebs-csi-driver-node-6qck4\" (UID: \"10b4545f-a570-4bdf-8b66-28ea371a9b7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:50.062833 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.062809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcrdt\" (UniqueName: \"kubernetes.io/projected/6f07222b-4188-45a8-83c7-abc385cb5e4a-kube-api-access-vcrdt\") pod \"multus-8qwgf\" (UID: \"6f07222b-4188-45a8-83c7-abc385cb5e4a\") " pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.063330 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.063299    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h22gq\" (UniqueName: \"kubernetes.io/projected/459a3f5b-0732-46a3-af8a-6e65a64a571a-kube-api-access-h22gq\") pod \"ovnkube-node-7klt7\" (UID: \"459a3f5b-0732-46a3-af8a-6e65a64a571a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.064541 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.064518    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6765g\" (UniqueName: \"kubernetes.io/projected/d38b9ecf-3aa5-48e4-8133-8e582d025c27-kube-api-access-6765g\") pod \"multus-additional-cni-plugins-z77rg\" (UID: \"d38b9ecf-3aa5-48e4-8133-8e582d025c27\") " pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.130206 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.130171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xgbcz"
Aug 05 16:38:50.139974 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.139945    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xl9st"
Aug 05 16:38:50.142854 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:50.142822    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382b20e8_1d7c_4476_826b_f9abf1316d84.slice/crio-aa5aa35f8a072e9ef77db35598102cd2336b8f1d7366ea3d3cfbb9b90d065fb2 WatchSource:0}: Error finding container aa5aa35f8a072e9ef77db35598102cd2336b8f1d7366ea3d3cfbb9b90d065fb2: Status 404 returned error can't find the container with id aa5aa35f8a072e9ef77db35598102cd2336b8f1d7366ea3d3cfbb9b90d065fb2
Aug 05 16:38:50.149980 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:50.149927    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ddc572_cfcd_4574_bc5d_47d7c976dce9.slice/crio-6185048a0a9ea3f381910c22e0a3cb6e554fb52785443b638cc91e1879d85065 WatchSource:0}: Error finding container 6185048a0a9ea3f381910c22e0a3cb6e554fb52785443b638cc91e1879d85065: Status 404 returned error can't find the container with id 6185048a0a9ea3f381910c22e0a3cb6e554fb52785443b638cc91e1879d85065
Aug 05 16:38:50.152102 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.152082    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:38:50.159293 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.159268    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4"
Aug 05 16:38:50.164054 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:50.164029    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod459a3f5b_0732_46a3_af8a_6e65a64a571a.slice/crio-54024e5be333325d5e7f0ce561e1749e4002a1d54ca064d3b3ee13f7d9e13b81 WatchSource:0}: Error finding container 54024e5be333325d5e7f0ce561e1749e4002a1d54ca064d3b3ee13f7d9e13b81: Status 404 returned error can't find the container with id 54024e5be333325d5e7f0ce561e1749e4002a1d54ca064d3b3ee13f7d9e13b81
Aug 05 16:38:50.168387 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.168317    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-njsvq"
Aug 05 16:38:50.171744 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:50.171719    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b4545f_a570_4bdf_8b66_28ea371a9b7e.slice/crio-b6dd7b0b302fb133827da72efe298745fadfb39e0a50cdc0ecfd87bc22347b86 WatchSource:0}: Error finding container b6dd7b0b302fb133827da72efe298745fadfb39e0a50cdc0ecfd87bc22347b86: Status 404 returned error can't find the container with id b6dd7b0b302fb133827da72efe298745fadfb39e0a50cdc0ecfd87bc22347b86
Aug 05 16:38:50.176367 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.176342    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8qwgf"
Aug 05 16:38:50.184512 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:50.184482    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039cfccd_9099_4601_ad17_e55a36a84c17.slice/crio-f2275760b9d6b539eb9fa4729a1e0bbcb7043b030aa93d0b1a7b0a9e7f0085b2 WatchSource:0}: Error finding container f2275760b9d6b539eb9fa4729a1e0bbcb7043b030aa93d0b1a7b0a9e7f0085b2: Status 404 returned error can't find the container with id f2275760b9d6b539eb9fa4729a1e0bbcb7043b030aa93d0b1a7b0a9e7f0085b2
Aug 05 16:38:50.185543 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.185520    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gd577"
Aug 05 16:38:50.187177 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:50.186966    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f07222b_4188_45a8_83c7_abc385cb5e4a.slice/crio-e118ef7b6745bca527ef6e33810db4956162dfe3b3beaf016f628f0c0c149088 WatchSource:0}: Error finding container e118ef7b6745bca527ef6e33810db4956162dfe3b3beaf016f628f0c0c149088: Status 404 returned error can't find the container with id e118ef7b6745bca527ef6e33810db4956162dfe3b3beaf016f628f0c0c149088
Aug 05 16:38:50.194749 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.194726    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8m5sn"
Aug 05 16:38:50.197199 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:50.197171    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec63c906_2568_429c_ae7e_663ee1273c94.slice/crio-0b2e00244eca1f9d548e0c217a8019280038add4ed26bb6e62da3058f171c450 WatchSource:0}: Error finding container 0b2e00244eca1f9d548e0c217a8019280038add4ed26bb6e62da3058f171c450: Status 404 returned error can't find the container with id 0b2e00244eca1f9d548e0c217a8019280038add4ed26bb6e62da3058f171c450
Aug 05 16:38:50.202043 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.202027    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z77rg"
Aug 05 16:38:50.203515 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:50.203494    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bf8e77a_297f_4c1e_b328_5a3f67b1933d.slice/crio-514c523774cd9c1e2aa392e3e8753c190f6c49e326298b8ecef9cbcc792c7726 WatchSource:0}: Error finding container 514c523774cd9c1e2aa392e3e8753c190f6c49e326298b8ecef9cbcc792c7726: Status 404 returned error can't find the container with id 514c523774cd9c1e2aa392e3e8753c190f6c49e326298b8ecef9cbcc792c7726
Aug 05 16:38:50.211981 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:38:50.211958    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38b9ecf_3aa5_48e4_8133_8e582d025c27.slice/crio-b86125579c82de361064060c47de492d73560071fb770981a70361e8dec935bd WatchSource:0}: Error finding container b86125579c82de361064060c47de492d73560071fb770981a70361e8dec935bd: Status 404 returned error can't find the container with id b86125579c82de361064060c47de492d73560071fb770981a70361e8dec935bd
Aug 05 16:38:50.443019 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.442922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs\") pod \"network-metrics-daemon-pjntd\" (UID: \"57bcc436-b7a1-4fe4-a41c-3e531fdab605\") " pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:38:50.443223 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:50.443100    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:38:50.443223 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:50.443189    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs podName:57bcc436-b7a1-4fe4-a41c-3e531fdab605 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:51.443172259 +0000 UTC m=+4.025243899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs") pod "network-metrics-daemon-pjntd" (UID: "57bcc436-b7a1-4fe4-a41c-3e531fdab605") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:38:50.544388 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.544345    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqf47\" (UniqueName: \"kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47\") pod \"network-check-target-dkx9l\" (UID: \"7fd3c40e-e8fb-4df3-b357-c927dd8340c6\") " pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:38:50.544552 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.544420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:50.544607 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:50.544545    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:38:50.544607 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:50.544575    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:38:50.544607 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:50.544553    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:38:50.544607 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:50.544587    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xqf47 for pod openshift-network-diagnostics/network-check-target-dkx9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:38:50.544768 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:50.544649    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47 podName:7fd3c40e-e8fb-4df3-b357-c927dd8340c6 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:51.544628783 +0000 UTC m=+4.126700443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqf47" (UniqueName: "kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47") pod "network-check-target-dkx9l" (UID: "7fd3c40e-e8fb-4df3-b357-c927dd8340c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:38:50.544768 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:50.544667    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret podName:c78cfde8-7c7b-4364-863a-116fe6296403 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:51.544660145 +0000 UTC m=+4.126731780 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret") pod "global-pull-secret-syncer-qjpz2" (UID: "c78cfde8-7c7b-4364-863a-116fe6296403") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:38:50.869281 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.869167    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 16:33:50 +0000 UTC" deadline="2028-05-02 21:31:38.667858038 +0000 UTC"
Aug 05 16:38:50.869281 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.869228    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15268h52m47.798633756s"
Aug 05 16:38:50.947080 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.947047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:38:50.947273 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:50.947209    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:38:50.964192 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.964128    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-njsvq" event={"ID":"039cfccd-9099-4601-ad17-e55a36a84c17","Type":"ContainerStarted","Data":"f2275760b9d6b539eb9fa4729a1e0bbcb7043b030aa93d0b1a7b0a9e7f0085b2"}
Aug 05 16:38:50.966351 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.966317    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4" event={"ID":"10b4545f-a570-4bdf-8b66-28ea371a9b7e","Type":"ContainerStarted","Data":"b6dd7b0b302fb133827da72efe298745fadfb39e0a50cdc0ecfd87bc22347b86"}
Aug 05 16:38:50.970414 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.970387    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7" event={"ID":"459a3f5b-0732-46a3-af8a-6e65a64a571a","Type":"ContainerStarted","Data":"54024e5be333325d5e7f0ce561e1749e4002a1d54ca064d3b3ee13f7d9e13b81"}
Aug 05 16:38:50.971970 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.971909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8m5sn" event={"ID":"7bf8e77a-297f-4c1e-b328-5a3f67b1933d","Type":"ContainerStarted","Data":"514c523774cd9c1e2aa392e3e8753c190f6c49e326298b8ecef9cbcc792c7726"}
Aug 05 16:38:50.974215 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.974189    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gd577" event={"ID":"ec63c906-2568-429c-ae7e-663ee1273c94","Type":"ContainerStarted","Data":"0b2e00244eca1f9d548e0c217a8019280038add4ed26bb6e62da3058f171c450"}
Aug 05 16:38:50.975864 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.975828    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xl9st" event={"ID":"e3ddc572-cfcd-4574-bc5d-47d7c976dce9","Type":"ContainerStarted","Data":"6185048a0a9ea3f381910c22e0a3cb6e554fb52785443b638cc91e1879d85065"}
Aug 05 16:38:50.977966 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.977940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xgbcz" event={"ID":"382b20e8-1d7c-4476-826b-f9abf1316d84","Type":"ContainerStarted","Data":"aa5aa35f8a072e9ef77db35598102cd2336b8f1d7366ea3d3cfbb9b90d065fb2"}
Aug 05 16:38:50.979743 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.979719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z77rg" event={"ID":"d38b9ecf-3aa5-48e4-8133-8e582d025c27","Type":"ContainerStarted","Data":"b86125579c82de361064060c47de492d73560071fb770981a70361e8dec935bd"}
Aug 05 16:38:50.981522 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:50.981499    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8qwgf" event={"ID":"6f07222b-4188-45a8-83c7-abc385cb5e4a","Type":"ContainerStarted","Data":"e118ef7b6745bca527ef6e33810db4956162dfe3b3beaf016f628f0c0c149088"}
Aug 05 16:38:51.454434 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:51.454388    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs\") pod \"network-metrics-daemon-pjntd\" (UID: \"57bcc436-b7a1-4fe4-a41c-3e531fdab605\") " pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:38:51.454623 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:51.454561    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:38:51.454691 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:51.454632    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs podName:57bcc436-b7a1-4fe4-a41c-3e531fdab605 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:53.454611458 +0000 UTC m=+6.036683097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs") pod "network-metrics-daemon-pjntd" (UID: "57bcc436-b7a1-4fe4-a41c-3e531fdab605") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:38:51.556456 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:51.555535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:51.556456 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:51.555628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqf47\" (UniqueName: \"kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47\") pod \"network-check-target-dkx9l\" (UID: \"7fd3c40e-e8fb-4df3-b357-c927dd8340c6\") " pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:38:51.556456 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:51.555794    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:38:51.556456 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:51.555815    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:38:51.556456 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:51.555829    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xqf47 for pod openshift-network-diagnostics/network-check-target-dkx9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:38:51.556456 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:51.555889    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47 podName:7fd3c40e-e8fb-4df3-b357-c927dd8340c6 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:53.555870315 +0000 UTC m=+6.137941966 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqf47" (UniqueName: "kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47") pod "network-check-target-dkx9l" (UID: "7fd3c40e-e8fb-4df3-b357-c927dd8340c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:38:51.556456 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:51.556349    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:38:51.556456 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:51.556410    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret podName:c78cfde8-7c7b-4364-863a-116fe6296403 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:53.556393026 +0000 UTC m=+6.138464677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret") pod "global-pull-secret-syncer-qjpz2" (UID: "c78cfde8-7c7b-4364-863a-116fe6296403") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:38:51.870060 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:51.869937    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 16:33:50 +0000 UTC" deadline="2028-05-16 13:27:45.251335858 +0000 UTC"
Aug 05 16:38:51.870060 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:51.869978    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15596h48m53.381362626s"
Aug 05 16:38:51.948870 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:51.948311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:51.948870 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:51.948447    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:38:51.949448 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:51.949236    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:38:51.949448 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:51.949358    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:38:52.947069 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:52.946941    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:38:52.956771 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:52.947084    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:38:52.996150 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:52.996066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-233.ec2.internal" event={"ID":"2195b22536e7a63f1b330fe10277dc4d","Type":"ContainerStarted","Data":"9ff530b9c3d5675f05bbe876d31b8cd007c301ea056f8cb6b0d5b9bf31d8525f"}
Aug 05 16:38:53.471574 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:53.471489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs\") pod \"network-metrics-daemon-pjntd\" (UID: \"57bcc436-b7a1-4fe4-a41c-3e531fdab605\") " pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:38:53.471787 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:53.471625    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:38:53.471787 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:53.471690    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs podName:57bcc436-b7a1-4fe4-a41c-3e531fdab605 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:57.471670732 +0000 UTC m=+10.053742380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs") pod "network-metrics-daemon-pjntd" (UID: "57bcc436-b7a1-4fe4-a41c-3e531fdab605") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:38:53.572304 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:53.572235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:53.572593 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:53.572327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqf47\" (UniqueName: \"kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47\") pod \"network-check-target-dkx9l\" (UID: \"7fd3c40e-e8fb-4df3-b357-c927dd8340c6\") " pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:38:53.572593 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:53.572470    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:38:53.572593 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:53.572490    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:38:53.572593 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:53.572504    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xqf47 for pod openshift-network-diagnostics/network-check-target-dkx9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:38:53.572593 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:53.572566    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47 podName:7fd3c40e-e8fb-4df3-b357-c927dd8340c6 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:57.572546407 +0000 UTC m=+10.154618068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqf47" (UniqueName: "kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47") pod "network-check-target-dkx9l" (UID: "7fd3c40e-e8fb-4df3-b357-c927dd8340c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:38:53.572863 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:53.572648    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:38:53.572863 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:53.572685    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret podName:c78cfde8-7c7b-4364-863a-116fe6296403 nodeName:}" failed. No retries permitted until 2026-08-05 16:38:57.572674424 +0000 UTC m=+10.154746063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret") pod "global-pull-secret-syncer-qjpz2" (UID: "c78cfde8-7c7b-4364-863a-116fe6296403") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:38:53.954186 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:53.946835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:38:53.954186 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:53.946835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:53.954186 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:53.952281    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:38:53.954186 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:53.952526    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:38:54.004327 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:54.003144    2565 generic.go:356] "Generic (PLEG): container finished" podID="d5ca96e55fb213d9a4ddacd00813d730" containerID="cb714db4c5a5dc8b253e9e31f331242de310aac2c27a7037b102d786f84aec8c" exitCode=0
Aug 05 16:38:54.004327 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:54.004019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal" event={"ID":"d5ca96e55fb213d9a4ddacd00813d730","Type":"ContainerDied","Data":"cb714db4c5a5dc8b253e9e31f331242de310aac2c27a7037b102d786f84aec8c"}
Aug 05 16:38:54.023730 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:54.023422    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-233.ec2.internal" podStartSLOduration=5.023404094 podStartE2EDuration="5.023404094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:38:53.023075679 +0000 UTC m=+5.605147340" watchObservedRunningTime="2026-08-05 16:38:54.023404094 +0000 UTC m=+6.605475755"
Aug 05 16:38:54.947015 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:54.946981    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:38:54.947227 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:54.947124    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:38:55.947048 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:55.947016    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:55.947462 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:55.947166    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:38:55.947462 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:55.947224    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:38:55.947462 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:55.947344    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:38:56.946815 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:56.946741    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:38:56.946981 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:56.946865    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:38:57.503252 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:57.502646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs\") pod \"network-metrics-daemon-pjntd\" (UID: \"57bcc436-b7a1-4fe4-a41c-3e531fdab605\") " pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:38:57.503252 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:57.502838    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:38:57.503252 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:57.502902    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs podName:57bcc436-b7a1-4fe4-a41c-3e531fdab605 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:05.502884185 +0000 UTC m=+18.084955821 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs") pod "network-metrics-daemon-pjntd" (UID: "57bcc436-b7a1-4fe4-a41c-3e531fdab605") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:38:57.603826 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:57.603786    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:57.603993 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:57.603866    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqf47\" (UniqueName: \"kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47\") pod \"network-check-target-dkx9l\" (UID: \"7fd3c40e-e8fb-4df3-b357-c927dd8340c6\") " pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:38:57.603993 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:57.603951    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:38:57.603993 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:57.603978    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:38:57.603993 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:57.603995    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:38:57.604249 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:57.604008    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xqf47 for pod openshift-network-diagnostics/network-check-target-dkx9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:38:57.604249 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:57.604025    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret podName:c78cfde8-7c7b-4364-863a-116fe6296403 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:05.604009489 +0000 UTC m=+18.186081137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret") pod "global-pull-secret-syncer-qjpz2" (UID: "c78cfde8-7c7b-4364-863a-116fe6296403") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:38:57.604249 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:57.604056    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47 podName:7fd3c40e-e8fb-4df3-b357-c927dd8340c6 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:05.604040329 +0000 UTC m=+18.186111980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqf47" (UniqueName: "kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47") pod "network-check-target-dkx9l" (UID: "7fd3c40e-e8fb-4df3-b357-c927dd8340c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:38:57.947671 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:57.947590    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:57.947819 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:57.947706    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:38:57.947819 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:57.947763    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:38:57.947923 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:57.947901    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:38:58.947167 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:58.947133    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:38:58.947635 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:58.947270    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:38:59.947224 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:59.947191    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:38:59.947680 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:38:59.947202    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:38:59.947680 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:59.947323    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:38:59.947680 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:38:59.947398    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:39:00.946664 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:00.946633    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:00.946826 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:00.946774    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:39:01.947041 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:01.946768    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:01.947628 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:01.946830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:01.947628 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:01.947122    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:39:01.947628 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:01.947166    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:39:02.021269 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:02.021230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal" event={"ID":"d5ca96e55fb213d9a4ddacd00813d730","Type":"ContainerStarted","Data":"81961b8cbec9957bb9467f1a9634a27f7091ffb6fe52daba36cfb78d727e2720"}
Aug 05 16:39:02.022736 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:02.022707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8m5sn" event={"ID":"7bf8e77a-297f-4c1e-b328-5a3f67b1933d","Type":"ContainerStarted","Data":"1f01276a60bd7b813412a9799a9e3cb230274339dcb37e1e6ffa6fc685faaf93"}
Aug 05 16:39:02.024344 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:02.024288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gd577" event={"ID":"ec63c906-2568-429c-ae7e-663ee1273c94","Type":"ContainerStarted","Data":"44d81d3352481cc19076e75242a575ef91496f10edefdfb5da5ae07c5d2a6d6b"}
Aug 05 16:39:02.025977 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:02.025946    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xgbcz" event={"ID":"382b20e8-1d7c-4476-826b-f9abf1316d84","Type":"ContainerStarted","Data":"ecdecee5b3494e78d30c2c19014a2c349d00d364ca42e14a0e7cda44dbf9d363"}
Aug 05 16:39:02.027677 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:02.027651    2565 generic.go:356] "Generic (PLEG): container finished" podID="d38b9ecf-3aa5-48e4-8133-8e582d025c27" containerID="a639738133390503823556e5276313cc3829b8c7f49b3c4f8cd7dad7899c8e59" exitCode=0
Aug 05 16:39:02.028212 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:02.028186    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z77rg" event={"ID":"d38b9ecf-3aa5-48e4-8133-8e582d025c27","Type":"ContainerDied","Data":"a639738133390503823556e5276313cc3829b8c7f49b3c4f8cd7dad7899c8e59"}
Aug 05 16:39:02.031085 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:02.031059    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-njsvq" event={"ID":"039cfccd-9099-4601-ad17-e55a36a84c17","Type":"ContainerStarted","Data":"b2f0ec8115a0c1d6ccef5999e30aadb79a852058dfe012e9c0ba4835bdaa470f"}
Aug 05 16:39:02.032667 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:02.032607    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4" event={"ID":"10b4545f-a570-4bdf-8b66-28ea371a9b7e","Type":"ContainerStarted","Data":"2e383cd9d9a6fa1cd58e45ae150ffc5cdec1e2d2770353f50e3ca93fcb80a10c"}
Aug 05 16:39:02.040549 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:02.040498    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-233.ec2.internal" podStartSLOduration=13.040483236 podStartE2EDuration="13.040483236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:02.040132043 +0000 UTC m=+14.622203712" watchObservedRunningTime="2026-08-05 16:39:02.040483236 +0000 UTC m=+14.622554891"
Aug 05 16:39:02.056988 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:02.056932    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gd577" podStartSLOduration=2.965051319 podStartE2EDuration="14.05691815s" totalImagesPullingTime="11.091866831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:02.056819698 +0000 UTC m=+14.638891381" watchObservedRunningTime="2026-08-05 16:39:02.05691815 +0000 UTC m=+14.638989805"
Aug 05 16:39:02.094282 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:02.094230    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xgbcz" podStartSLOduration=2.952181595 podStartE2EDuration="14.094214783s" totalImagesPullingTime="11.142033188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:02.07190059 +0000 UTC m=+14.653972272" watchObservedRunningTime="2026-08-05 16:39:02.094214783 +0000 UTC m=+14.676286439"
Aug 05 16:39:02.094641 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:02.094611    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-njsvq" podStartSLOduration=3.056380345 podStartE2EDuration="14.094602467s" totalImagesPullingTime="11.038222122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:02.094360205 +0000 UTC m=+14.676431843" watchObservedRunningTime="2026-08-05 16:39:02.094602467 +0000 UTC m=+14.676674126"
Aug 05 16:39:02.123829 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:02.123782    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8m5sn" podStartSLOduration=3.033386619 podStartE2EDuration="14.123768448s" totalImagesPullingTime="11.090381829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:02.123377077 +0000 UTC m=+14.705448732" watchObservedRunningTime="2026-08-05 16:39:02.123768448 +0000 UTC m=+14.705840104"
Aug 05 16:39:02.946972 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:02.946939    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:02.947157 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:02.947062    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:39:03.036389 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:03.036301    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xl9st" event={"ID":"e3ddc572-cfcd-4574-bc5d-47d7c976dce9","Type":"ContainerStarted","Data":"1dd97209d494f766aa45c5ecc3fa42168ea7a88e79626ad90228cea1fb05ea28"}
Aug 05 16:39:03.053378 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:03.053337    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xl9st" podStartSLOduration=3.959884539 podStartE2EDuration="15.053323518s" totalImagesPullingTime="11.093438979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:03.052888473 +0000 UTC m=+15.634960130" watchObservedRunningTime="2026-08-05 16:39:03.053323518 +0000 UTC m=+15.635395174"
Aug 05 16:39:03.946617 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:03.946580    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:03.946772 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:03.946583    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:03.946772 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:03.946735    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:39:03.946772 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:03.946754    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:39:04.946489 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:04.946460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:04.947115 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:04.946580    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:39:05.564309 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:05.564265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs\") pod \"network-metrics-daemon-pjntd\" (UID: \"57bcc436-b7a1-4fe4-a41c-3e531fdab605\") " pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:05.564551 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:05.564382    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:05.564551 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:05.564442    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs podName:57bcc436-b7a1-4fe4-a41c-3e531fdab605 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:21.564425662 +0000 UTC m=+34.146497307 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs") pod "network-metrics-daemon-pjntd" (UID: "57bcc436-b7a1-4fe4-a41c-3e531fdab605") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:05.665193 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:05.665161    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:05.665377 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:05.665237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqf47\" (UniqueName: \"kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47\") pod \"network-check-target-dkx9l\" (UID: \"7fd3c40e-e8fb-4df3-b357-c927dd8340c6\") " pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:05.665377 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:05.665336    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:05.665460 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:05.665410    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret podName:c78cfde8-7c7b-4364-863a-116fe6296403 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:21.665390149 +0000 UTC m=+34.247461797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret") pod "global-pull-secret-syncer-qjpz2" (UID: "c78cfde8-7c7b-4364-863a-116fe6296403") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:05.665460 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:05.665345    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:39:05.665460 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:05.665454    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:39:05.665580 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:05.665469    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xqf47 for pod openshift-network-diagnostics/network-check-target-dkx9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:05.665580 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:05.665525    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47 podName:7fd3c40e-e8fb-4df3-b357-c927dd8340c6 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:21.665508163 +0000 UTC m=+34.247579814 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqf47" (UniqueName: "kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47") pod "network-check-target-dkx9l" (UID: "7fd3c40e-e8fb-4df3-b357-c927dd8340c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:05.946431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:05.946343    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:05.946578 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:05.946352    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:05.946578 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:05.946491    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:39:05.946578 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:05.946564    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:39:06.032504 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:06.032120    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xgbcz"
Aug 05 16:39:06.033004 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:06.032968    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xgbcz"
Aug 05 16:39:06.042160 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:06.042117    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xgbcz"
Aug 05 16:39:06.042618 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:06.042585    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xgbcz"
Aug 05 16:39:06.947015 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:06.946830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:06.947459 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:06.947137    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:39:07.947994 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:07.947965    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:07.948412 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:07.948068    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:39:07.948496 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:07.948477    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:07.948597 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:07.948572    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:39:08.947030 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:08.946995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:08.947256 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:08.947122    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:39:09.946879 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:09.946849    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:09.947231 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:09.946987    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:39:09.947231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:09.947034    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:09.947231 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:09.947132    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:39:10.947409 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:10.947224    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:10.947874 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:10.947499    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:39:11.053212 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:11.053178    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8qwgf" event={"ID":"6f07222b-4188-45a8-83c7-abc385cb5e4a","Type":"ContainerStarted","Data":"8b91a44b6a156ff9f067a52154e2f052fc806d9dc99bf165c1c4969bf0879ef7"}
Aug 05 16:39:11.055457 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:11.055434    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7" event={"ID":"459a3f5b-0732-46a3-af8a-6e65a64a571a","Type":"ContainerStarted","Data":"1c351ab481c21ed34b0f289a222006fb7752da6e5f17ce0e6fd67be31d02d935"}
Aug 05 16:39:11.055550 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:11.055498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7" event={"ID":"459a3f5b-0732-46a3-af8a-6e65a64a571a","Type":"ContainerStarted","Data":"042dcd62819f82d51331b87511bae35e5bbc81409e9ef20b0ab4c745c98776fc"}
Aug 05 16:39:11.055550 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:11.055531    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7" event={"ID":"459a3f5b-0732-46a3-af8a-6e65a64a571a","Type":"ContainerStarted","Data":"6d36e24b3d0d69e7ae15a87d66def2b43be7057a62a891870be75ee130c58f95"}
Aug 05 16:39:11.055634 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:11.055560    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7" event={"ID":"459a3f5b-0732-46a3-af8a-6e65a64a571a","Type":"ContainerStarted","Data":"2a5a2eed18ab8dfa4df9f4e868d772450a50e5e7d3b1dd339f1ee471504a8d60"}
Aug 05 16:39:11.055634 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:11.055587    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7" event={"ID":"459a3f5b-0732-46a3-af8a-6e65a64a571a","Type":"ContainerStarted","Data":"9453d876aaf6ae67372561456ac3fbe3fcb7c6d6b2bf2d4c5ce88015d40bbc5c"}
Aug 05 16:39:11.072842 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:11.072799    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8qwgf" podStartSLOduration=2.95957521 podStartE2EDuration="23.072784957s" totalImagesPullingTime="20.113209747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:11.072255455 +0000 UTC m=+23.654327112" watchObservedRunningTime="2026-08-05 16:39:11.072784957 +0000 UTC m=+23.654856614"
Aug 05 16:39:11.265997 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:11.265972    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 05 16:39:11.894643 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:11.894533    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T16:39:11.26599334Z","UUID":"995af8e9-f23e-4b3d-a9fb-762ef7f3d17d","Handler":null,"Name":"","Endpoint":""}
Aug 05 16:39:11.896268 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:11.896243    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 05 16:39:11.896390 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:11.896293    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 05 16:39:11.946904 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:11.946875    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:11.946904 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:11.946903    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:11.947073 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:11.947008    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:39:11.947167 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:11.947136    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:39:12.062615 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:12.062581    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4" event={"ID":"10b4545f-a570-4bdf-8b66-28ea371a9b7e","Type":"ContainerStarted","Data":"9a48706a1072579915ef7dcb87599e3e31e8f838444f7a3db1942f46814ce8d3"}
Aug 05 16:39:12.065725 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:12.065696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7" event={"ID":"459a3f5b-0732-46a3-af8a-6e65a64a571a","Type":"ContainerStarted","Data":"2563a9e092a9bf2aafb1f22e8122d04159e49b3d0e98ace07d33370e04b7cf92"}
Aug 05 16:39:12.947227 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:12.947200    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:12.947378 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:12.947292    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:39:13.069902 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:13.069866    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4" event={"ID":"10b4545f-a570-4bdf-8b66-28ea371a9b7e","Type":"ContainerStarted","Data":"db89374f7fe0ff7d370465bf1facc9cb3090b2032395b05d4996f27752ffe483"}
Aug 05 16:39:13.090993 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:13.090953    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qck4" podStartSLOduration=3.229988353 podStartE2EDuration="25.09093916s" totalImagesPullingTime="21.860950807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:13.090521639 +0000 UTC m=+25.672593298" watchObservedRunningTime="2026-08-05 16:39:13.09093916 +0000 UTC m=+25.673010816"
Aug 05 16:39:13.947209 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:13.947182    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:13.947209 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:13.947193    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:13.947449 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:13.947314    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:39:13.947520 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:13.947443    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:39:14.075472 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:14.075441    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7" event={"ID":"459a3f5b-0732-46a3-af8a-6e65a64a571a","Type":"ContainerStarted","Data":"1ddb72c1d536715b0ac075eeea803e0680132cfaa757369566f3a8167bd51391"}
Aug 05 16:39:14.946880 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:14.946848    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:14.947053 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:14.946955    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:39:15.947458 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:15.947289    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:15.947870 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:15.947302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:15.947870 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:15.947530    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:39:15.947870 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:15.947600    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:39:16.080885 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:16.080858    2565 generic.go:356] "Generic (PLEG): container finished" podID="d38b9ecf-3aa5-48e4-8133-8e582d025c27" containerID="248ff55a0f93085a6dc0c9613608f418c18e27a21069e1b13233ced65c730b77" exitCode=0
Aug 05 16:39:16.081032 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:16.080942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z77rg" event={"ID":"d38b9ecf-3aa5-48e4-8133-8e582d025c27","Type":"ContainerDied","Data":"248ff55a0f93085a6dc0c9613608f418c18e27a21069e1b13233ced65c730b77"}
Aug 05 16:39:16.084540 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:16.084522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7" event={"ID":"459a3f5b-0732-46a3-af8a-6e65a64a571a","Type":"ContainerStarted","Data":"a1ae4ac35e0ff25e2cfe7a6dd7abb236a3660af8a65501484bbf4fd120b4d80d"}
Aug 05 16:39:16.084750 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:16.084738    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:39:16.084803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:16.084783    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:39:16.084858 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:16.084841    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:39:16.099372 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:16.099353    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:39:16.104472 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:16.104458    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:39:16.141811 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:16.141772    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7" podStartSLOduration=8.01052025 podStartE2EDuration="28.141760624s" totalImagesPullingTime="20.131240374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:16.140137166 +0000 UTC m=+28.722208822" watchObservedRunningTime="2026-08-05 16:39:16.141760624 +0000 UTC m=+28.723832279"
Aug 05 16:39:16.946846 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:16.946818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:16.946945 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:16.946912    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:39:17.089250 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:17.089205    2565 generic.go:356] "Generic (PLEG): container finished" podID="d38b9ecf-3aa5-48e4-8133-8e582d025c27" containerID="18f5775e06a6ccf89b0147c4d30f552773a4a5a73ad73a84a38b4fc81bf50aad" exitCode=0
Aug 05 16:39:17.089608 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:17.089254    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z77rg" event={"ID":"d38b9ecf-3aa5-48e4-8133-8e582d025c27","Type":"ContainerDied","Data":"18f5775e06a6ccf89b0147c4d30f552773a4a5a73ad73a84a38b4fc81bf50aad"}
Aug 05 16:39:17.749735 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:17.749708    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dkx9l"]
Aug 05 16:39:17.749859 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:17.749845    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:17.749969 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:17.749949    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:39:17.753673 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:17.753653    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pjntd"]
Aug 05 16:39:17.753789 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:17.753776    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:17.753939 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:17.753892    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:39:17.754680 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:17.754658    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qjpz2"]
Aug 05 16:39:17.754786 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:17.754761    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:17.754866 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:17.754839    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:39:18.093742 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:18.093713    2565 generic.go:356] "Generic (PLEG): container finished" podID="d38b9ecf-3aa5-48e4-8133-8e582d025c27" containerID="830239a454d8fc7218ab31837ca6c9b0109636ff517200c49f396bca8ce4daf1" exitCode=0
Aug 05 16:39:18.094174 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:18.093790    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z77rg" event={"ID":"d38b9ecf-3aa5-48e4-8133-8e582d025c27","Type":"ContainerDied","Data":"830239a454d8fc7218ab31837ca6c9b0109636ff517200c49f396bca8ce4daf1"}
Aug 05 16:39:18.947083 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:18.946907    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:18.947241 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:18.946943    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:18.947241 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:18.947182    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:39:18.947362 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:18.947259    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:39:19.946979 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:19.946894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:19.947375 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:19.947024    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:39:20.946876 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:20.946843    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:20.947019 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:20.946893    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:20.947019 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:20.946985    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:39:20.947581 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:20.947136    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:39:21.581082 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:21.581052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs\") pod \"network-metrics-daemon-pjntd\" (UID: \"57bcc436-b7a1-4fe4-a41c-3e531fdab605\") " pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:21.581250 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:21.581178    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:21.581250 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:21.581239    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs podName:57bcc436-b7a1-4fe4-a41c-3e531fdab605 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:53.581225132 +0000 UTC m=+66.163296766 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs") pod "network-metrics-daemon-pjntd" (UID: "57bcc436-b7a1-4fe4-a41c-3e531fdab605") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:39:21.682254 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:21.682214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqf47\" (UniqueName: \"kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47\") pod \"network-check-target-dkx9l\" (UID: \"7fd3c40e-e8fb-4df3-b357-c927dd8340c6\") " pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:21.682415 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:21.682273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:21.682415 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:21.682382    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:21.682415 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:21.682398    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:39:21.682415 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:21.682418    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:39:21.682633 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:21.682428    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xqf47 for pod openshift-network-diagnostics/network-check-target-dkx9l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:21.682633 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:21.682437    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret podName:c78cfde8-7c7b-4364-863a-116fe6296403 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:53.682419683 +0000 UTC m=+66.264491317 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret") pod "global-pull-secret-syncer-qjpz2" (UID: "c78cfde8-7c7b-4364-863a-116fe6296403") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:39:21.682633 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:21.682465    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47 podName:7fd3c40e-e8fb-4df3-b357-c927dd8340c6 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:53.682453545 +0000 UTC m=+66.264525179 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqf47" (UniqueName: "kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47") pod "network-check-target-dkx9l" (UID: "7fd3c40e-e8fb-4df3-b357-c927dd8340c6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:39:21.946894 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:21.946822    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:21.947054 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:21.946947    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:39:22.947255 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:22.947218    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:22.947885 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:22.947218    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:22.947885 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:22.947361    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjntd" podUID="57bcc436-b7a1-4fe4-a41c-3e531fdab605"
Aug 05 16:39:22.947885 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:22.947451    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qjpz2" podUID="c78cfde8-7c7b-4364-863a-116fe6296403"
Aug 05 16:39:23.947246 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:23.947179    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:23.947375 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:23.947292    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dkx9l" podUID="7fd3c40e-e8fb-4df3-b357-c927dd8340c6"
Aug 05 16:39:24.108740 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.108702    2565 generic.go:356] "Generic (PLEG): container finished" podID="d38b9ecf-3aa5-48e4-8133-8e582d025c27" containerID="b766bcf42bb76de766e0c76ae68c9dcfd3dbc7a689897a455540d092b73cadd9" exitCode=0
Aug 05 16:39:24.108886 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.108771    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z77rg" event={"ID":"d38b9ecf-3aa5-48e4-8133-8e582d025c27","Type":"ContainerDied","Data":"b766bcf42bb76de766e0c76ae68c9dcfd3dbc7a689897a455540d092b73cadd9"}
Aug 05 16:39:24.175610 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.175587    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-233.ec2.internal" event="NodeReady"
Aug 05 16:39:24.175729 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.175719    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 05 16:39:24.216965 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.216939    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7456db797f-tp7x9"]
Aug 05 16:39:24.241429 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.241143    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"]
Aug 05 16:39:24.241429 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.241347    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.244716 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.244506    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 05 16:39:24.244716 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.244531    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 05 16:39:24.244716 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.244540    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xts8t\""
Aug 05 16:39:24.244953 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.244821    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 05 16:39:24.252311 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.251744    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 05 16:39:24.263036 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.263019    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95f88fd5d-q8w9r"]
Aug 05 16:39:24.263145 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.263040    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.266449 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.266432    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Aug 05 16:39:24.266547 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.266451    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Aug 05 16:39:24.266547 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.266478    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Aug 05 16:39:24.266919 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.266900    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Aug 05 16:39:24.267290 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.267266    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Aug 05 16:39:24.267599 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.267583    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Aug 05 16:39:24.267943 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.267753    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Aug 05 16:39:24.285426 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.285355    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"]
Aug 05 16:39:24.285426 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.285424    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95f88fd5d-q8w9r"
Aug 05 16:39:24.288888 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.288871    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wd4sp\""
Aug 05 16:39:24.292987 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.290233    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Aug 05 16:39:24.317440 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.317422    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"]
Aug 05 16:39:24.317519 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.317450    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7456db797f-tp7x9"]
Aug 05 16:39:24.317519 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.317471    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"]
Aug 05 16:39:24.317519 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.317489    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95f88fd5d-q8w9r"]
Aug 05 16:39:24.317519 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.317506    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nrnbc"]
Aug 05 16:39:24.317642 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.317531    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"
Aug 05 16:39:24.319846 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.319829    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Aug 05 16:39:24.333656 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.333641    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9hvbp"]
Aug 05 16:39:24.333770 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.333754    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nrnbc"
Aug 05 16:39:24.336256 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.336235    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 05 16:39:24.336348 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.336272    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 05 16:39:24.336415 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.336359    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jb59q\""
Aug 05 16:39:24.336955 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.336941    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 05 16:39:24.345644 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.345630    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nrnbc"]
Aug 05 16:39:24.345717 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.345657    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9hvbp"]
Aug 05 16:39:24.345758 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.345728    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:24.349523 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.349503    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 05 16:39:24.349595 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.349505    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 05 16:39:24.349595 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.349590    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p9jdc\""
Aug 05 16:39:24.400730 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.400709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfwvg\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-kube-api-access-sfwvg\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.400826 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.400733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/30fa8922-aa9e-409c-914f-35266f7b16a7-ca\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.400826 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.400750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d07c2a36-0ac8-4a93-aab1-24f3d967c6a8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-95f88fd5d-q8w9r\" (UID: \"d07c2a36-0ac8-4a93-aab1-24f3d967c6a8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95f88fd5d-q8w9r"
Aug 05 16:39:24.400826 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.400779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02bcdafb-b382-4263-bf2e-2297dbd97504-trusted-ca\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.400826 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.400794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/30fa8922-aa9e-409c-914f-35266f7b16a7-hub\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.401033 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.400868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02bcdafb-b382-4263-bf2e-2297dbd97504-ca-trust-extracted\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.401033 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.400900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/30fa8922-aa9e-409c-914f-35266f7b16a7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.401033 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.400934    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02bcdafb-b382-4263-bf2e-2297dbd97504-image-registry-private-configuration\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.401033 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.400969    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-bound-sa-token\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.401033 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.401000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/30fa8922-aa9e-409c-914f-35266f7b16a7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.401308 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.401122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30fa8922-aa9e-409c-914f-35266f7b16a7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.401308 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.401149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8848h\" (UniqueName: \"kubernetes.io/projected/d07c2a36-0ac8-4a93-aab1-24f3d967c6a8-kube-api-access-8848h\") pod \"managed-serviceaccount-addon-agent-95f88fd5d-q8w9r\" (UID: \"d07c2a36-0ac8-4a93-aab1-24f3d967c6a8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95f88fd5d-q8w9r"
Aug 05 16:39:24.401308 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.401178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02bcdafb-b382-4263-bf2e-2297dbd97504-installation-pull-secrets\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.401308 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.401212    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.401308 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.401235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-certificates\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.401308 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.401266    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv9n9\" (UniqueName: \"kubernetes.io/projected/30fa8922-aa9e-409c-914f-35266f7b16a7-kube-api-access-hv9n9\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.453729 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.453663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xgbcz_382b20e8-1d7c-4476-826b-f9abf1316d84/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:24.501721 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.501698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfwvg\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-kube-api-access-sfwvg\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.501821 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.501727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/30fa8922-aa9e-409c-914f-35266f7b16a7-ca\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.501821 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.501743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d07c2a36-0ac8-4a93-aab1-24f3d967c6a8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-95f88fd5d-q8w9r\" (UID: \"d07c2a36-0ac8-4a93-aab1-24f3d967c6a8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95f88fd5d-q8w9r"
Aug 05 16:39:24.501821 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.501778    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02bcdafb-b382-4263-bf2e-2297dbd97504-trusted-ca\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.501821 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.501800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/30fa8922-aa9e-409c-914f-35266f7b16a7-hub\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.502010 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.501918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36075180-a7b5-4331-9929-41bf8e64d43d-config-volume\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:24.502010 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.501958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02bcdafb-b382-4263-bf2e-2297dbd97504-ca-trust-extracted\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.502010 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.501986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/30fa8922-aa9e-409c-914f-35266f7b16a7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.502173 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02bcdafb-b382-4263-bf2e-2297dbd97504-image-registry-private-configuration\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.502173 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgstf\" (UniqueName: \"kubernetes.io/projected/36075180-a7b5-4331-9929-41bf8e64d43d-kube-api-access-pgstf\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:24.502173 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502073    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-bound-sa-token\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.502173 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/30fa8922-aa9e-409c-914f-35266f7b16a7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.502343 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30fa8922-aa9e-409c-914f-35266f7b16a7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.502343 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502208    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8848h\" (UniqueName: \"kubernetes.io/projected/d07c2a36-0ac8-4a93-aab1-24f3d967c6a8-kube-api-access-8848h\") pod \"managed-serviceaccount-addon-agent-95f88fd5d-q8w9r\" (UID: \"d07c2a36-0ac8-4a93-aab1-24f3d967c6a8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95f88fd5d-q8w9r"
Aug 05 16:39:24.502343 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502232    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb0d7c3a-680a-4e31-b6bf-1e80f231487b-cert\") pod \"ingress-canary-nrnbc\" (UID: \"eb0d7c3a-680a-4e31-b6bf-1e80f231487b\") " pod="openshift-ingress-canary/ingress-canary-nrnbc"
Aug 05 16:39:24.502343 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02bcdafb-b382-4263-bf2e-2297dbd97504-installation-pull-secrets\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.502343 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.502343 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-certificates\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.502343 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36075180-a7b5-4331-9929-41bf8e64d43d-tmp-dir\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:24.502646 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv9n9\" (UniqueName: \"kubernetes.io/projected/30fa8922-aa9e-409c-914f-35266f7b16a7-kube-api-access-hv9n9\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.502646 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/27bbc5de-85db-4162-aab8-2d116cec200c-klusterlet-config\") pod \"klusterlet-addon-workmgr-86f77b5d8-p8x28\" (UID: \"27bbc5de-85db-4162-aab8-2d116cec200c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"
Aug 05 16:39:24.502646 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:24.502646 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502458    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcnr6\" (UniqueName: \"kubernetes.io/projected/eb0d7c3a-680a-4e31-b6bf-1e80f231487b-kube-api-access-dcnr6\") pod \"ingress-canary-nrnbc\" (UID: \"eb0d7c3a-680a-4e31-b6bf-1e80f231487b\") " pod="openshift-ingress-canary/ingress-canary-nrnbc"
Aug 05 16:39:24.502646 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502492    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27bbc5de-85db-4162-aab8-2d116cec200c-tmp\") pod \"klusterlet-addon-workmgr-86f77b5d8-p8x28\" (UID: \"27bbc5de-85db-4162-aab8-2d116cec200c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"
Aug 05 16:39:24.502646 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb89x\" (UniqueName: \"kubernetes.io/projected/27bbc5de-85db-4162-aab8-2d116cec200c-kube-api-access-gb89x\") pod \"klusterlet-addon-workmgr-86f77b5d8-p8x28\" (UID: \"27bbc5de-85db-4162-aab8-2d116cec200c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"
Aug 05 16:39:24.502646 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02bcdafb-b382-4263-bf2e-2297dbd97504-ca-trust-extracted\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.502976 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502891    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-certificates\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.502976 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.502906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02bcdafb-b382-4263-bf2e-2297dbd97504-trusted-ca\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.503802 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.503773    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/30fa8922-aa9e-409c-914f-35266f7b16a7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.503911 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:24.503872    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:39:24.503911 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:24.503887    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7456db797f-tp7x9: secret "image-registry-tls" not found
Aug 05 16:39:24.504018 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:24.503955    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls podName:02bcdafb-b382-4263-bf2e-2297dbd97504 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:25.003937378 +0000 UTC m=+37.586009027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls") pod "image-registry-7456db797f-tp7x9" (UID: "02bcdafb-b382-4263-bf2e-2297dbd97504") : secret "image-registry-tls" not found
Aug 05 16:39:24.506531 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.506502    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02bcdafb-b382-4263-bf2e-2297dbd97504-image-registry-private-configuration\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.506531 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.506510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/30fa8922-aa9e-409c-914f-35266f7b16a7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.506531 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.506518    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02bcdafb-b382-4263-bf2e-2297dbd97504-installation-pull-secrets\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.506531 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.506531    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d07c2a36-0ac8-4a93-aab1-24f3d967c6a8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-95f88fd5d-q8w9r\" (UID: \"d07c2a36-0ac8-4a93-aab1-24f3d967c6a8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95f88fd5d-q8w9r"
Aug 05 16:39:24.506776 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.506680    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30fa8922-aa9e-409c-914f-35266f7b16a7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.506892 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.506870    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/30fa8922-aa9e-409c-914f-35266f7b16a7-ca\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.507012 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.506995    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/30fa8922-aa9e-409c-914f-35266f7b16a7-hub\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.511339 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.511315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8848h\" (UniqueName: \"kubernetes.io/projected/d07c2a36-0ac8-4a93-aab1-24f3d967c6a8-kube-api-access-8848h\") pod \"managed-serviceaccount-addon-agent-95f88fd5d-q8w9r\" (UID: \"d07c2a36-0ac8-4a93-aab1-24f3d967c6a8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95f88fd5d-q8w9r"
Aug 05 16:39:24.511981 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.511954    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfwvg\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-kube-api-access-sfwvg\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.513011 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.512985    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-bound-sa-token\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:24.513109 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.513082    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv9n9\" (UniqueName: \"kubernetes.io/projected/30fa8922-aa9e-409c-914f-35266f7b16a7-kube-api-access-hv9n9\") pod \"cluster-proxy-proxy-agent-654b458d44-mw8jl\" (UID: \"30fa8922-aa9e-409c-914f-35266f7b16a7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.588200 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.588170    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:39:24.597324 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.597302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95f88fd5d-q8w9r"
Aug 05 16:39:24.603599 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.603581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb0d7c3a-680a-4e31-b6bf-1e80f231487b-cert\") pod \"ingress-canary-nrnbc\" (UID: \"eb0d7c3a-680a-4e31-b6bf-1e80f231487b\") " pod="openshift-ingress-canary/ingress-canary-nrnbc"
Aug 05 16:39:24.603665 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.603615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36075180-a7b5-4331-9929-41bf8e64d43d-tmp-dir\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:24.603665 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.603639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/27bbc5de-85db-4162-aab8-2d116cec200c-klusterlet-config\") pod \"klusterlet-addon-workmgr-86f77b5d8-p8x28\" (UID: \"27bbc5de-85db-4162-aab8-2d116cec200c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"
Aug 05 16:39:24.603665 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.603654    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:24.603791 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.603669    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcnr6\" (UniqueName: \"kubernetes.io/projected/eb0d7c3a-680a-4e31-b6bf-1e80f231487b-kube-api-access-dcnr6\") pod \"ingress-canary-nrnbc\" (UID: \"eb0d7c3a-680a-4e31-b6bf-1e80f231487b\") " pod="openshift-ingress-canary/ingress-canary-nrnbc"
Aug 05 16:39:24.603791 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:24.603739    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:39:24.603791 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:24.603778    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls podName:36075180-a7b5-4331-9929-41bf8e64d43d nodeName:}" failed. No retries permitted until 2026-08-05 16:39:25.103766052 +0000 UTC m=+37.685837686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls") pod "dns-default-9hvbp" (UID: "36075180-a7b5-4331-9929-41bf8e64d43d") : secret "dns-default-metrics-tls" not found
Aug 05 16:39:24.603791 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.603774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27bbc5de-85db-4162-aab8-2d116cec200c-tmp\") pod \"klusterlet-addon-workmgr-86f77b5d8-p8x28\" (UID: \"27bbc5de-85db-4162-aab8-2d116cec200c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"
Aug 05 16:39:24.603997 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.603812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb89x\" (UniqueName: \"kubernetes.io/projected/27bbc5de-85db-4162-aab8-2d116cec200c-kube-api-access-gb89x\") pod \"klusterlet-addon-workmgr-86f77b5d8-p8x28\" (UID: \"27bbc5de-85db-4162-aab8-2d116cec200c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"
Aug 05 16:39:24.603997 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.603866    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36075180-a7b5-4331-9929-41bf8e64d43d-config-volume\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:24.603997 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.603909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgstf\" (UniqueName: \"kubernetes.io/projected/36075180-a7b5-4331-9929-41bf8e64d43d-kube-api-access-pgstf\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:24.604171 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.604138    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27bbc5de-85db-4162-aab8-2d116cec200c-tmp\") pod \"klusterlet-addon-workmgr-86f77b5d8-p8x28\" (UID: \"27bbc5de-85db-4162-aab8-2d116cec200c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"
Aug 05 16:39:24.604215 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.604165    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36075180-a7b5-4331-9929-41bf8e64d43d-tmp-dir\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:24.604454 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.604434    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36075180-a7b5-4331-9929-41bf8e64d43d-config-volume\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:24.605954 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.605928    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/27bbc5de-85db-4162-aab8-2d116cec200c-klusterlet-config\") pod \"klusterlet-addon-workmgr-86f77b5d8-p8x28\" (UID: \"27bbc5de-85db-4162-aab8-2d116cec200c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"
Aug 05 16:39:24.605954 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.605937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb0d7c3a-680a-4e31-b6bf-1e80f231487b-cert\") pod \"ingress-canary-nrnbc\" (UID: \"eb0d7c3a-680a-4e31-b6bf-1e80f231487b\") " pod="openshift-ingress-canary/ingress-canary-nrnbc"
Aug 05 16:39:24.612996 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.612859    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgstf\" (UniqueName: \"kubernetes.io/projected/36075180-a7b5-4331-9929-41bf8e64d43d-kube-api-access-pgstf\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:24.613127 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.613091    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb89x\" (UniqueName: \"kubernetes.io/projected/27bbc5de-85db-4162-aab8-2d116cec200c-kube-api-access-gb89x\") pod \"klusterlet-addon-workmgr-86f77b5d8-p8x28\" (UID: \"27bbc5de-85db-4162-aab8-2d116cec200c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"
Aug 05 16:39:24.613651 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.613635    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcnr6\" (UniqueName: \"kubernetes.io/projected/eb0d7c3a-680a-4e31-b6bf-1e80f231487b-kube-api-access-dcnr6\") pod \"ingress-canary-nrnbc\" (UID: \"eb0d7c3a-680a-4e31-b6bf-1e80f231487b\") " pod="openshift-ingress-canary/ingress-canary-nrnbc"
Aug 05 16:39:24.676086 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.676049    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"
Aug 05 16:39:24.682193 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.682168    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nrnbc"
Aug 05 16:39:24.788590 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.788187    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95f88fd5d-q8w9r"]
Aug 05 16:39:24.791133 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.790727    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"]
Aug 05 16:39:24.795741 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:39:24.795704    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30fa8922_aa9e_409c_914f_35266f7b16a7.slice/crio-7a20e51c32cfe304ecbc272796f1e22d9e3ca60bc3bc429f9a979560a75a0c21 WatchSource:0}: Error finding container 7a20e51c32cfe304ecbc272796f1e22d9e3ca60bc3bc429f9a979560a75a0c21: Status 404 returned error can't find the container with id 7a20e51c32cfe304ecbc272796f1e22d9e3ca60bc3bc429f9a979560a75a0c21
Aug 05 16:39:24.849642 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.849613    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"]
Aug 05 16:39:24.853292 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:39:24.853257    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27bbc5de_85db_4162_aab8_2d116cec200c.slice/crio-e863280142bdc829b118b0cc90eb60fb014f906cdd90023a0ba8548af6a2d781 WatchSource:0}: Error finding container e863280142bdc829b118b0cc90eb60fb014f906cdd90023a0ba8548af6a2d781: Status 404 returned error can't find the container with id e863280142bdc829b118b0cc90eb60fb014f906cdd90023a0ba8548af6a2d781
Aug 05 16:39:24.865433 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.865405    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nrnbc"]
Aug 05 16:39:24.868412 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:39:24.868392    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb0d7c3a_680a_4e31_b6bf_1e80f231487b.slice/crio-0b62a67920fa91c3c1c7895efc75cdba1b700f50353e5fc4af654af0f054f083 WatchSource:0}: Error finding container 0b62a67920fa91c3c1c7895efc75cdba1b700f50353e5fc4af654af0f054f083: Status 404 returned error can't find the container with id 0b62a67920fa91c3c1c7895efc75cdba1b700f50353e5fc4af654af0f054f083
Aug 05 16:39:24.946659 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.946633    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:24.946803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.946786    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:24.950002 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.949972    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 16:39:24.950002 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.949994    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7qbz9\""
Aug 05 16:39:24.950459 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:24.950028    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 16:39:25.006554 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:25.006530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:25.006673 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:25.006658    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:39:25.006723 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:25.006700    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7456db797f-tp7x9: secret "image-registry-tls" not found
Aug 05 16:39:25.006779 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:25.006768    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls podName:02bcdafb-b382-4263-bf2e-2297dbd97504 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:26.006747786 +0000 UTC m=+38.588819439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls") pod "image-registry-7456db797f-tp7x9" (UID: "02bcdafb-b382-4263-bf2e-2297dbd97504") : secret "image-registry-tls" not found
Aug 05 16:39:25.107683 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:25.107646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:25.107838 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:25.107762    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:39:25.107838 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:25.107822    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls podName:36075180-a7b5-4331-9929-41bf8e64d43d nodeName:}" failed. No retries permitted until 2026-08-05 16:39:26.107804294 +0000 UTC m=+38.689875944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls") pod "dns-default-9hvbp" (UID: "36075180-a7b5-4331-9929-41bf8e64d43d") : secret "dns-default-metrics-tls" not found
Aug 05 16:39:25.113646 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:25.113613    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nrnbc" event={"ID":"eb0d7c3a-680a-4e31-b6bf-1e80f231487b","Type":"ContainerStarted","Data":"0b62a67920fa91c3c1c7895efc75cdba1b700f50353e5fc4af654af0f054f083"}
Aug 05 16:39:25.114595 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:25.114573    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28" event={"ID":"27bbc5de-85db-4162-aab8-2d116cec200c","Type":"ContainerStarted","Data":"e863280142bdc829b118b0cc90eb60fb014f906cdd90023a0ba8548af6a2d781"}
Aug 05 16:39:25.117509 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:25.117485    2565 generic.go:356] "Generic (PLEG): container finished" podID="d38b9ecf-3aa5-48e4-8133-8e582d025c27" containerID="3e50a3f1edf4c7de8b5177bf4583a9612af2e1718eed45e238415a72efc7cb0c" exitCode=0
Aug 05 16:39:25.117574 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:25.117546    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z77rg" event={"ID":"d38b9ecf-3aa5-48e4-8133-8e582d025c27","Type":"ContainerDied","Data":"3e50a3f1edf4c7de8b5177bf4583a9612af2e1718eed45e238415a72efc7cb0c"}
Aug 05 16:39:25.118748 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:25.118725    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95f88fd5d-q8w9r" event={"ID":"d07c2a36-0ac8-4a93-aab1-24f3d967c6a8","Type":"ContainerStarted","Data":"f2329383434cc845265ff3d03bbaf15ca072bd5455350529c899e64a6b09e7cf"}
Aug 05 16:39:25.119861 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:25.119842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl" event={"ID":"30fa8922-aa9e-409c-914f-35266f7b16a7","Type":"ContainerStarted","Data":"7a20e51c32cfe304ecbc272796f1e22d9e3ca60bc3bc429f9a979560a75a0c21"}
Aug 05 16:39:25.544669 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:25.544415    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xgbcz_382b20e8-1d7c-4476-826b-f9abf1316d84/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:25.949060 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:25.948213    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:25.954941 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:25.954138    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 16:39:25.954941 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:25.954363    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 16:39:25.954941 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:25.954543    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cn6w5\""
Aug 05 16:39:26.015899 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:26.015862    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:26.016419 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:26.016076    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:39:26.016419 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:26.016111    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7456db797f-tp7x9: secret "image-registry-tls" not found
Aug 05 16:39:26.016419 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:26.016171    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls podName:02bcdafb-b382-4263-bf2e-2297dbd97504 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:28.01615198 +0000 UTC m=+40.598223629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls") pod "image-registry-7456db797f-tp7x9" (UID: "02bcdafb-b382-4263-bf2e-2297dbd97504") : secret "image-registry-tls" not found
Aug 05 16:39:26.117552 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:26.116945    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:26.117552 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:26.117133    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:39:26.117552 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:26.117198    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls podName:36075180-a7b5-4331-9929-41bf8e64d43d nodeName:}" failed. No retries permitted until 2026-08-05 16:39:28.117178593 +0000 UTC m=+40.699250244 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls") pod "dns-default-9hvbp" (UID: "36075180-a7b5-4331-9929-41bf8e64d43d") : secret "dns-default-metrics-tls" not found
Aug 05 16:39:26.143408 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:26.142532    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z77rg" event={"ID":"d38b9ecf-3aa5-48e4-8133-8e582d025c27","Type":"ContainerStarted","Data":"6350cfb8f159a49aec4ed86f8d6e819cc2645c68ca28c73dae96b11990f564d7"}
Aug 05 16:39:26.170177 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:26.169916    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z77rg" podStartSLOduration=6.863179843 podStartE2EDuration="38.169894829s" totalImagesPullingTime="31.306714986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:26.167560573 +0000 UTC m=+38.749632243" watchObservedRunningTime="2026-08-05 16:39:26.169894829 +0000 UTC m=+38.751966487"
Aug 05 16:39:26.296966 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:26.296825    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xgbcz_382b20e8-1d7c-4476-826b-f9abf1316d84/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:26.356194 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:26.356043    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xgbcz_382b20e8-1d7c-4476-826b-f9abf1316d84/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:27.452782 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:27.452715    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xgbcz_382b20e8-1d7c-4476-826b-f9abf1316d84/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:27.566470 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:27.566402    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xgbcz_382b20e8-1d7c-4476-826b-f9abf1316d84/konnectivity-agent/0.log" limit=1024
Aug 05 16:39:28.038612 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:28.038576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:28.038839 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:28.038820    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:39:28.038839 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:28.038838    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7456db797f-tp7x9: secret "image-registry-tls" not found
Aug 05 16:39:28.039018 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:28.038903    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls podName:02bcdafb-b382-4263-bf2e-2297dbd97504 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:32.03888462 +0000 UTC m=+44.620956268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls") pod "image-registry-7456db797f-tp7x9" (UID: "02bcdafb-b382-4263-bf2e-2297dbd97504") : secret "image-registry-tls" not found
Aug 05 16:39:28.139219 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:28.139181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:28.139411 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:28.139389    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:39:28.139476 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:28.139466    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls podName:36075180-a7b5-4331-9929-41bf8e64d43d nodeName:}" failed. No retries permitted until 2026-08-05 16:39:32.139446267 +0000 UTC m=+44.721517903 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls") pod "dns-default-9hvbp" (UID: "36075180-a7b5-4331-9929-41bf8e64d43d") : secret "dns-default-metrics-tls" not found
Aug 05 16:39:32.068551 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:32.068514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:32.069039 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:32.068700    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:39:32.069039 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:32.068723    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7456db797f-tp7x9: secret "image-registry-tls" not found
Aug 05 16:39:32.069039 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:32.068809    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls podName:02bcdafb-b382-4263-bf2e-2297dbd97504 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:40.068787883 +0000 UTC m=+52.650859522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls") pod "image-registry-7456db797f-tp7x9" (UID: "02bcdafb-b382-4263-bf2e-2297dbd97504") : secret "image-registry-tls" not found
Aug 05 16:39:32.169472 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:32.169434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:32.169624 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:32.169594    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:39:32.169686 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:32.169671    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls podName:36075180-a7b5-4331-9929-41bf8e64d43d nodeName:}" failed. No retries permitted until 2026-08-05 16:39:40.169651177 +0000 UTC m=+52.751722811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls") pod "dns-default-9hvbp" (UID: "36075180-a7b5-4331-9929-41bf8e64d43d") : secret "dns-default-metrics-tls" not found
Aug 05 16:39:34.178709 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:34.178398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95f88fd5d-q8w9r" event={"ID":"d07c2a36-0ac8-4a93-aab1-24f3d967c6a8","Type":"ContainerStarted","Data":"27f86fc2fe6d0d67784ac52676a4dbe07eb331a5a5835bb7cbd5c311d61094d0"}
Aug 05 16:39:34.180447 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:34.180418    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl" event={"ID":"30fa8922-aa9e-409c-914f-35266f7b16a7","Type":"ContainerStarted","Data":"bbf00fe32806f0f35463051547caa89847c09e6a60996f7fdf524733be128e6e"}
Aug 05 16:39:34.180563 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:34.180466    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl" event={"ID":"30fa8922-aa9e-409c-914f-35266f7b16a7","Type":"ContainerStarted","Data":"4a85d78716518678306854030c1c888aea23b75d1f421a77f14dcc4615b738d2"}
Aug 05 16:39:34.180563 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:34.180486    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl" event={"ID":"30fa8922-aa9e-409c-914f-35266f7b16a7","Type":"ContainerStarted","Data":"6cc1e6cb55aaadc0bc0c3a874645105811cd6d86224a058ae0af63163b85aeb9"}
Aug 05 16:39:34.181882 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:34.181855    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nrnbc" event={"ID":"eb0d7c3a-680a-4e31-b6bf-1e80f231487b","Type":"ContainerStarted","Data":"d89e5f292c4e8120cd7752bbb46a429b9773f8783c7edd41e0f84c3d18973c24"}
Aug 05 16:39:34.183191 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:34.183169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28" event={"ID":"27bbc5de-85db-4162-aab8-2d116cec200c","Type":"ContainerStarted","Data":"2491a313a7e11e83232360d47b280d53ce122520c031229b89d609652f5e0437"}
Aug 05 16:39:34.183372 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:34.183359    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"
Aug 05 16:39:34.185017 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:34.185002    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28"
Aug 05 16:39:34.198941 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:34.198900    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95f88fd5d-q8w9r" podStartSLOduration=36.4995376 podStartE2EDuration="45.198888066s" totalImagesPullingTime="8.699350466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:34.197865848 +0000 UTC m=+46.779937506" watchObservedRunningTime="2026-08-05 16:39:34.198888066 +0000 UTC m=+46.780959716"
Aug 05 16:39:34.215466 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:34.215424    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nrnbc" podStartSLOduration=1.591663402 podStartE2EDuration="10.215411659s" totalImagesPullingTime="8.623748257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:34.214884069 +0000 UTC m=+46.796955730" watchObservedRunningTime="2026-08-05 16:39:34.215411659 +0000 UTC m=+46.797483306"
Aug 05 16:39:34.232383 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:34.232341    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86f77b5d8-p8x28" podStartSLOduration=36.578458087 podStartE2EDuration="45.232327955s" totalImagesPullingTime="8.653869868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:34.23169499 +0000 UTC m=+46.813766647" watchObservedRunningTime="2026-08-05 16:39:34.232327955 +0000 UTC m=+46.814399588"
Aug 05 16:39:34.253481 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:34.253440    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl" podStartSLOduration=36.558525217 podStartE2EDuration="45.253424888s" totalImagesPullingTime="8.694899671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:34.252911902 +0000 UTC m=+46.834983558" watchObservedRunningTime="2026-08-05 16:39:34.253424888 +0000 UTC m=+46.835496543"
Aug 05 16:39:40.129537 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:40.129495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:40.130122 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:40.129621    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:39:40.130122 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:40.129639    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7456db797f-tp7x9: secret "image-registry-tls" not found
Aug 05 16:39:40.130122 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:40.129708    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls podName:02bcdafb-b382-4263-bf2e-2297dbd97504 nodeName:}" failed. No retries permitted until 2026-08-05 16:39:56.129687627 +0000 UTC m=+68.711759282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls") pod "image-registry-7456db797f-tp7x9" (UID: "02bcdafb-b382-4263-bf2e-2297dbd97504") : secret "image-registry-tls" not found
Aug 05 16:39:40.230162 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:40.230128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:40.230302 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:40.230271    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:39:40.230346 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:40.230330    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls podName:36075180-a7b5-4331-9929-41bf8e64d43d nodeName:}" failed. No retries permitted until 2026-08-05 16:39:56.230316641 +0000 UTC m=+68.812388275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls") pod "dns-default-9hvbp" (UID: "36075180-a7b5-4331-9929-41bf8e64d43d") : secret "dns-default-metrics-tls" not found
Aug 05 16:39:48.104244 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:48.104210    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7klt7"
Aug 05 16:39:53.631987 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:53.631946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs\") pod \"network-metrics-daemon-pjntd\" (UID: \"57bcc436-b7a1-4fe4-a41c-3e531fdab605\") " pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:39:53.634706 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:53.634688    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 16:39:53.643157 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:53.643134    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 05 16:39:53.643243 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:53.643202    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs podName:57bcc436-b7a1-4fe4-a41c-3e531fdab605 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:57.643182648 +0000 UTC m=+130.225254296 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs") pod "network-metrics-daemon-pjntd" (UID: "57bcc436-b7a1-4fe4-a41c-3e531fdab605") : secret "metrics-daemon-secret" not found
Aug 05 16:39:53.733055 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:53.733013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqf47\" (UniqueName: \"kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47\") pod \"network-check-target-dkx9l\" (UID: \"7fd3c40e-e8fb-4df3-b357-c927dd8340c6\") " pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:53.733231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:53.733077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:53.736046 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:53.736023    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 16:39:53.736171 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:53.736085    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 16:39:53.746187 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:53.746167    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 16:39:53.747049 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:53.747033    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c78cfde8-7c7b-4364-863a-116fe6296403-original-pull-secret\") pod \"global-pull-secret-syncer-qjpz2\" (UID: \"c78cfde8-7c7b-4364-863a-116fe6296403\") " pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:53.756490 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:53.756472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqf47\" (UniqueName: \"kubernetes.io/projected/7fd3c40e-e8fb-4df3-b357-c927dd8340c6-kube-api-access-xqf47\") pod \"network-check-target-dkx9l\" (UID: \"7fd3c40e-e8fb-4df3-b357-c927dd8340c6\") " pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:53.760302 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:53.760285    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qjpz2"
Aug 05 16:39:53.871797 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:53.871775    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cn6w5\""
Aug 05 16:39:53.879915 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:53.879892    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:53.911552 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:53.911525    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qjpz2"]
Aug 05 16:39:53.914253 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:39:53.914231    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78cfde8_7c7b_4364_863a_116fe6296403.slice/crio-d71191e92307f15d6cdc0a2d306b7cfdc8e7228ffbfd3f174316ded9fedf658b WatchSource:0}: Error finding container d71191e92307f15d6cdc0a2d306b7cfdc8e7228ffbfd3f174316ded9fedf658b: Status 404 returned error can't find the container with id d71191e92307f15d6cdc0a2d306b7cfdc8e7228ffbfd3f174316ded9fedf658b
Aug 05 16:39:54.021896 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:54.021866    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dkx9l"]
Aug 05 16:39:54.024824 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:39:54.024797    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd3c40e_e8fb_4df3_b357_c927dd8340c6.slice/crio-61913d868e64c21006d1950b6019aa6c23ce219cdcdf7c87ded521f0162ed4fc WatchSource:0}: Error finding container 61913d868e64c21006d1950b6019aa6c23ce219cdcdf7c87ded521f0162ed4fc: Status 404 returned error can't find the container with id 61913d868e64c21006d1950b6019aa6c23ce219cdcdf7c87ded521f0162ed4fc
Aug 05 16:39:54.242961 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:54.242879    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dkx9l" event={"ID":"7fd3c40e-e8fb-4df3-b357-c927dd8340c6","Type":"ContainerStarted","Data":"61913d868e64c21006d1950b6019aa6c23ce219cdcdf7c87ded521f0162ed4fc"}
Aug 05 16:39:54.243884 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:54.243859    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qjpz2" event={"ID":"c78cfde8-7c7b-4364-863a-116fe6296403","Type":"ContainerStarted","Data":"d71191e92307f15d6cdc0a2d306b7cfdc8e7228ffbfd3f174316ded9fedf658b"}
Aug 05 16:39:56.150769 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:56.150727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:39:56.151343 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:56.150903    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:39:56.151343 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:56.150930    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7456db797f-tp7x9: secret "image-registry-tls" not found
Aug 05 16:39:56.151343 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:56.151003    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls podName:02bcdafb-b382-4263-bf2e-2297dbd97504 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:28.15098165 +0000 UTC m=+100.733053289 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls") pod "image-registry-7456db797f-tp7x9" (UID: "02bcdafb-b382-4263-bf2e-2297dbd97504") : secret "image-registry-tls" not found
Aug 05 16:39:56.251802 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:56.251766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:39:56.252002 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:56.251914    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:39:56.252002 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:39:56.251977    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls podName:36075180-a7b5-4331-9929-41bf8e64d43d nodeName:}" failed. No retries permitted until 2026-08-05 16:40:28.251956337 +0000 UTC m=+100.834027997 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls") pod "dns-default-9hvbp" (UID: "36075180-a7b5-4331-9929-41bf8e64d43d") : secret "dns-default-metrics-tls" not found
Aug 05 16:39:58.259069 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:58.259022    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dkx9l" event={"ID":"7fd3c40e-e8fb-4df3-b357-c927dd8340c6","Type":"ContainerStarted","Data":"fdf94ed03e83bcd52e4d28a9a2b33a47f3b4994c555171623e717d7b272e7da2"}
Aug 05 16:39:58.259534 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:58.259172    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:39:58.278372 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:39:58.278327    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dkx9l" podStartSLOduration=66.747573302 podStartE2EDuration="1m10.278312661s" totalImagesPullingTime="3.530739359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:39:58.277173999 +0000 UTC m=+70.859245656" watchObservedRunningTime="2026-08-05 16:39:58.278312661 +0000 UTC m=+70.860384316"
Aug 05 16:40:00.266785 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:00.266741    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qjpz2" event={"ID":"c78cfde8-7c7b-4364-863a-116fe6296403","Type":"ContainerStarted","Data":"82a398501bb566e0145dcf3c1dee06f6c93efccb07a9e196026f5271a5f771af"}
Aug 05 16:40:00.284913 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:00.284866    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qjpz2" podStartSLOduration=66.859758724 podStartE2EDuration="1m12.284852266s" totalImagesPullingTime="5.425093542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:00.284256714 +0000 UTC m=+72.866328370" watchObservedRunningTime="2026-08-05 16:40:00.284852266 +0000 UTC m=+72.866923918"
Aug 05 16:40:18.987335 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:18.987223    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r6ckt"]
Aug 05 16:40:18.991341 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:18.991325    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.000518 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.000497    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 05 16:40:19.005264 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.005245    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 05 16:40:19.005756 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.005736    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 05 16:40:19.008480 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.008465    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lp7bm\""
Aug 05 16:40:19.021675 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.021655    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 05 16:40:19.034447 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.034425    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r6ckt"]
Aug 05 16:40:19.114558 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.114522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b63a3f07-540b-4b01-ad28-79c751b1db81-data-volume\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.114558 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.114555    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl5hn\" (UniqueName: \"kubernetes.io/projected/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-api-access-nl5hn\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.114773 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.114577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b63a3f07-540b-4b01-ad28-79c751b1db81-crio-socket\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.114773 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.114601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.114773 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.114712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.215930 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.215898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.216068 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.215953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b63a3f07-540b-4b01-ad28-79c751b1db81-data-volume\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.216068 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.215974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl5hn\" (UniqueName: \"kubernetes.io/projected/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-api-access-nl5hn\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.216068 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.216003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b63a3f07-540b-4b01-ad28-79c751b1db81-crio-socket\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.216068 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:19.216023    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:40:19.216262 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:19.216085    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm podName:b63a3f07-540b-4b01-ad28-79c751b1db81 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:19.716070661 +0000 UTC m=+92.298142319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6ckt" (UID: "b63a3f07-540b-4b01-ad28-79c751b1db81") : configmap "kube-rbac-proxy" not found
Aug 05 16:40:19.216262 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.216029    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.216262 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:19.216133    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:19.216262 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.216159    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b63a3f07-540b-4b01-ad28-79c751b1db81-crio-socket\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.216262 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:19.216201    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls podName:b63a3f07-540b-4b01-ad28-79c751b1db81 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:19.716184559 +0000 UTC m=+92.298256196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6ckt" (UID: "b63a3f07-540b-4b01-ad28-79c751b1db81") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:19.216433 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.216334    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b63a3f07-540b-4b01-ad28-79c751b1db81-data-volume\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.224390 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.224373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl5hn\" (UniqueName: \"kubernetes.io/projected/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-api-access-nl5hn\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.720921 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.720885    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.721135 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:19.720950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:19.721135 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:19.721028    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:40:19.721135 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:19.721040    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:19.721135 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:19.721091    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm podName:b63a3f07-540b-4b01-ad28-79c751b1db81 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:20.721077245 +0000 UTC m=+93.303148879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6ckt" (UID: "b63a3f07-540b-4b01-ad28-79c751b1db81") : configmap "kube-rbac-proxy" not found
Aug 05 16:40:19.721301 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:19.721148    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls podName:b63a3f07-540b-4b01-ad28-79c751b1db81 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:20.721136354 +0000 UTC m=+93.303208001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6ckt" (UID: "b63a3f07-540b-4b01-ad28-79c751b1db81") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:20.727489 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:20.727461    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8m5sn_7bf8e77a-297f-4c1e-b328-5a3f67b1933d/dns-node-resolver/0.log"
Aug 05 16:40:20.729759 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:20.729737    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:20.729817 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:20.729800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:20.729854 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:20.729841    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:40:20.729902 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:20.729890    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:20.729936 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:20.729892    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm podName:b63a3f07-540b-4b01-ad28-79c751b1db81 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:22.729877835 +0000 UTC m=+95.311949471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6ckt" (UID: "b63a3f07-540b-4b01-ad28-79c751b1db81") : configmap "kube-rbac-proxy" not found
Aug 05 16:40:20.729976 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:20.729944    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls podName:b63a3f07-540b-4b01-ad28-79c751b1db81 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:22.729932651 +0000 UTC m=+95.312004285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6ckt" (UID: "b63a3f07-540b-4b01-ad28-79c751b1db81") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:22.127333 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:22.127305    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-njsvq_039cfccd-9099-4601-ad17-e55a36a84c17/node-ca/0.log"
Aug 05 16:40:22.744470 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:22.744433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:22.744657 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:22.744498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:22.744657 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:22.744554    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:40:22.744657 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:22.744603    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:22.744657 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:22.744632    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm podName:b63a3f07-540b-4b01-ad28-79c751b1db81 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:26.744612429 +0000 UTC m=+99.326684065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6ckt" (UID: "b63a3f07-540b-4b01-ad28-79c751b1db81") : configmap "kube-rbac-proxy" not found
Aug 05 16:40:22.744657 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:22.744654    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls podName:b63a3f07-540b-4b01-ad28-79c751b1db81 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:26.744645436 +0000 UTC m=+99.326717072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6ckt" (UID: "b63a3f07-540b-4b01-ad28-79c751b1db81") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:22.927319 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:22.927290    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nrnbc_eb0d7c3a-680a-4e31-b6bf-1e80f231487b/serve-healthcheck-canary/0.log"
Aug 05 16:40:26.777198 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:26.777152    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:26.777648 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:26.777227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:26.777648 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:26.777312    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:40:26.777648 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:26.777324    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:26.777648 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:26.777363    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm podName:b63a3f07-540b-4b01-ad28-79c751b1db81 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:34.777349309 +0000 UTC m=+107.359420942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r6ckt" (UID: "b63a3f07-540b-4b01-ad28-79c751b1db81") : configmap "kube-rbac-proxy" not found
Aug 05 16:40:26.777648 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:26.777397    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls podName:b63a3f07-540b-4b01-ad28-79c751b1db81 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:34.777379195 +0000 UTC m=+107.359450846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6ckt" (UID: "b63a3f07-540b-4b01-ad28-79c751b1db81") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:28.190262 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:28.190231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:40:28.192713 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:28.192688    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls\") pod \"image-registry-7456db797f-tp7x9\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") " pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:40:28.291354 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:28.291326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:40:28.291466 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:28.291447    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:40:28.291505 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:28.291493    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls podName:36075180-a7b5-4331-9929-41bf8e64d43d nodeName:}" failed. No retries permitted until 2026-08-05 16:41:32.291480305 +0000 UTC m=+164.873551939 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls") pod "dns-default-9hvbp" (UID: "36075180-a7b5-4331-9929-41bf8e64d43d") : secret "dns-default-metrics-tls" not found
Aug 05 16:40:28.457410 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:28.457346    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xts8t\""
Aug 05 16:40:28.465364 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:28.465350    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:40:28.593606 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:28.593579    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7456db797f-tp7x9"]
Aug 05 16:40:28.596352 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:40:28.596324    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02bcdafb_b382_4263_bf2e_2297dbd97504.slice/crio-e9dcfde30767962f086ade5d03ff2e3b98e271afc3e44d04c7146fafff333a6c WatchSource:0}: Error finding container e9dcfde30767962f086ade5d03ff2e3b98e271afc3e44d04c7146fafff333a6c: Status 404 returned error can't find the container with id e9dcfde30767962f086ade5d03ff2e3b98e271afc3e44d04c7146fafff333a6c
Aug 05 16:40:29.265627 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:29.265598    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dkx9l"
Aug 05 16:40:29.349493 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:29.349464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7456db797f-tp7x9" event={"ID":"02bcdafb-b382-4263-bf2e-2297dbd97504","Type":"ContainerStarted","Data":"8f79609a5cf63f6a5421326ec7193b4dd915d5e48e7876b9f74de7221ffebf0a"}
Aug 05 16:40:29.349493 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:29.349506    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7456db797f-tp7x9" event={"ID":"02bcdafb-b382-4263-bf2e-2297dbd97504","Type":"ContainerStarted","Data":"e9dcfde30767962f086ade5d03ff2e3b98e271afc3e44d04c7146fafff333a6c"}
Aug 05 16:40:29.349790 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:29.349612    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:40:29.375909 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:29.375862    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7456db797f-tp7x9" podStartSLOduration=100.375848689 podStartE2EDuration="1m40.375848689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:29.375290003 +0000 UTC m=+101.957361680" watchObservedRunningTime="2026-08-05 16:40:29.375848689 +0000 UTC m=+101.957920345"
Aug 05 16:40:34.845282 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:34.845240    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:34.845693 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:34.845328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:34.845693 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:34.845408    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:34.845693 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:34.845481    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls podName:b63a3f07-540b-4b01-ad28-79c751b1db81 nodeName:}" failed. No retries permitted until 2026-08-05 16:40:50.845464727 +0000 UTC m=+123.427536376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r6ckt" (UID: "b63a3f07-540b-4b01-ad28-79c751b1db81") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:40:34.845914 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:34.845895    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b63a3f07-540b-4b01-ad28-79c751b1db81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:48.470085 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:48.470050    2565 patch_prober.go:28] interesting pod/image-registry-7456db797f-tp7x9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 05 16:40:48.470452 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:48.470118    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7456db797f-tp7x9" podUID="02bcdafb-b382-4263-bf2e-2297dbd97504" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 16:40:50.357258 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:50.357229    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:40:50.856351 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:50.856318    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:50.858528 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:50.858498    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b63a3f07-540b-4b01-ad28-79c751b1db81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6ckt\" (UID: \"b63a3f07-540b-4b01-ad28-79c751b1db81\") " pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:51.101212 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:51.101182    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lp7bm\""
Aug 05 16:40:51.109070 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:51.109018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r6ckt"
Aug 05 16:40:51.231478 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:40:51.231443    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb63a3f07_540b_4b01_ad28_79c751b1db81.slice/crio-347f7b7df3e93c1fe5c61e6d8f7382c4fc4394a27b808b88504537c66b9f9cd8 WatchSource:0}: Error finding container 347f7b7df3e93c1fe5c61e6d8f7382c4fc4394a27b808b88504537c66b9f9cd8: Status 404 returned error can't find the container with id 347f7b7df3e93c1fe5c61e6d8f7382c4fc4394a27b808b88504537c66b9f9cd8
Aug 05 16:40:51.234200 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:51.234176    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r6ckt"]
Aug 05 16:40:51.415411 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:51.415335    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6ckt" event={"ID":"b63a3f07-540b-4b01-ad28-79c751b1db81","Type":"ContainerStarted","Data":"efd5dd8f8c195017d6ce2d9230aed8d3747862255ea3e7218a6aa299fc96f79f"}
Aug 05 16:40:51.415411 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:51.415395    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6ckt" event={"ID":"b63a3f07-540b-4b01-ad28-79c751b1db81","Type":"ContainerStarted","Data":"347f7b7df3e93c1fe5c61e6d8f7382c4fc4394a27b808b88504537c66b9f9cd8"}
Aug 05 16:40:52.423647 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:52.423612    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6ckt" event={"ID":"b63a3f07-540b-4b01-ad28-79c751b1db81","Type":"ContainerStarted","Data":"8bda235989d139dd5fe20858f5cbff6949757ff5e75045f18dd100bab8bb8191"}
Aug 05 16:40:53.547769 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.547745    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-msmpd"]
Aug 05 16:40:53.550897 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.550880    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.555727 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.555709    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 05 16:40:53.556058 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.556037    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 05 16:40:53.556058 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.556052    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 05 16:40:53.556235 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.556056    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6jkd7\""
Aug 05 16:40:53.556292 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.556276    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 05 16:40:53.556292 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.556277    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 05 16:40:53.556392 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.556358    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 05 16:40:53.575958 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.575940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d3c76437-61db-4e9b-adee-dc9f1fabd66c-root\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.576048 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.575969    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.576048 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.576000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-tls\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.576151 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.576067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-textfile\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.576151 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.576111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-accelerators-collector-config\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.576151 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.576138    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-wtmp\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.576256 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.576159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dwfs\" (UniqueName: \"kubernetes.io/projected/d3c76437-61db-4e9b-adee-dc9f1fabd66c-kube-api-access-9dwfs\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.576256 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.576174    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3c76437-61db-4e9b-adee-dc9f1fabd66c-sys\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.576256 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.576191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3c76437-61db-4e9b-adee-dc9f1fabd66c-metrics-client-ca\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.677233 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.677208    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-accelerators-collector-config\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.677233 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.677234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-wtmp\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.677400 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.677253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dwfs\" (UniqueName: \"kubernetes.io/projected/d3c76437-61db-4e9b-adee-dc9f1fabd66c-kube-api-access-9dwfs\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.677400 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.677269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3c76437-61db-4e9b-adee-dc9f1fabd66c-sys\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.677400 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.677288    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3c76437-61db-4e9b-adee-dc9f1fabd66c-metrics-client-ca\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.677400 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.677319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d3c76437-61db-4e9b-adee-dc9f1fabd66c-root\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.677400 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.677351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.677400 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.677372    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3c76437-61db-4e9b-adee-dc9f1fabd66c-sys\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.677400 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.677385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-wtmp\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.677667 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.677393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-tls\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.677667 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.677431    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d3c76437-61db-4e9b-adee-dc9f1fabd66c-root\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.677667 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:53.677468    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Aug 05 16:40:53.677667 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.677465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-textfile\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.677667 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:40:53.677521    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-tls podName:d3c76437-61db-4e9b-adee-dc9f1fabd66c nodeName:}" failed. No retries permitted until 2026-08-05 16:40:54.177503015 +0000 UTC m=+126.759574658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-tls") pod "node-exporter-msmpd" (UID: "d3c76437-61db-4e9b-adee-dc9f1fabd66c") : secret "node-exporter-tls" not found
Aug 05 16:40:53.677819 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.677759    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-textfile\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.677853 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.677822    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-accelerators-collector-config\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.677901 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.677881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3c76437-61db-4e9b-adee-dc9f1fabd66c-metrics-client-ca\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.679518 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.679503    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:53.686047 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:53.686027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dwfs\" (UniqueName: \"kubernetes.io/projected/d3c76437-61db-4e9b-adee-dc9f1fabd66c-kube-api-access-9dwfs\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:54.182165 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:54.182133    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-tls\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:54.184474 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:54.184445    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d3c76437-61db-4e9b-adee-dc9f1fabd66c-node-exporter-tls\") pod \"node-exporter-msmpd\" (UID: \"d3c76437-61db-4e9b-adee-dc9f1fabd66c\") " pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:54.430374 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:54.430339    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6ckt" event={"ID":"b63a3f07-540b-4b01-ad28-79c751b1db81","Type":"ContainerStarted","Data":"0291e85b2d7f6b4708d689a61c731fd2da071213a50382dfc6dd13239c0b4ed0"}
Aug 05 16:40:54.458709 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:54.458634    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-msmpd"
Aug 05 16:40:54.469300 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:40:54.469266    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c76437_61db_4e9b_adee_dc9f1fabd66c.slice/crio-ad769f319235e1d6d91d1e6354559ce4a6cb9ba20041fd8f4de25ce58864a083 WatchSource:0}: Error finding container ad769f319235e1d6d91d1e6354559ce4a6cb9ba20041fd8f4de25ce58864a083: Status 404 returned error can't find the container with id ad769f319235e1d6d91d1e6354559ce4a6cb9ba20041fd8f4de25ce58864a083
Aug 05 16:40:54.479543 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:54.479502    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r6ckt" podStartSLOduration=34.352548611 podStartE2EDuration="36.479488092s" totalImagesPullingTime="2.126939481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:40:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:54.479160803 +0000 UTC m=+127.061232478" watchObservedRunningTime="2026-08-05 16:40:54.479488092 +0000 UTC m=+127.061559748"
Aug 05 16:40:55.434561 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:55.434518    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-msmpd" event={"ID":"d3c76437-61db-4e9b-adee-dc9f1fabd66c","Type":"ContainerStarted","Data":"ad769f319235e1d6d91d1e6354559ce4a6cb9ba20041fd8f4de25ce58864a083"}
Aug 05 16:40:56.442647 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:56.442614    2565 generic.go:356] "Generic (PLEG): container finished" podID="d3c76437-61db-4e9b-adee-dc9f1fabd66c" containerID="ecd7b661e13685ac7706f23d3c78ace0d97f55d1ffa44099292c25a55e9b1789" exitCode=0
Aug 05 16:40:56.443042 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:56.442693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-msmpd" event={"ID":"d3c76437-61db-4e9b-adee-dc9f1fabd66c","Type":"ContainerDied","Data":"ecd7b661e13685ac7706f23d3c78ace0d97f55d1ffa44099292c25a55e9b1789"}
Aug 05 16:40:57.448077 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:57.448038    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-msmpd" event={"ID":"d3c76437-61db-4e9b-adee-dc9f1fabd66c","Type":"ContainerStarted","Data":"fc4ec566374891a10614351075d78611ff01d4ff236502b11838684cbbbeea9d"}
Aug 05 16:40:57.448454 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:57.448089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-msmpd" event={"ID":"d3c76437-61db-4e9b-adee-dc9f1fabd66c","Type":"ContainerStarted","Data":"14577587cff783813a3de7f624ce50f975eada670bc16b5235db54969934b766"}
Aug 05 16:40:57.710407 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:57.710320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs\") pod \"network-metrics-daemon-pjntd\" (UID: \"57bcc436-b7a1-4fe4-a41c-3e531fdab605\") " pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:40:57.712631 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:57.712598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57bcc436-b7a1-4fe4-a41c-3e531fdab605-metrics-certs\") pod \"network-metrics-daemon-pjntd\" (UID: \"57bcc436-b7a1-4fe4-a41c-3e531fdab605\") " pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:40:57.967649 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:57.967575    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7qbz9\""
Aug 05 16:40:57.975930 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:57.975914    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjntd"
Aug 05 16:40:58.096124 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:58.096060    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-msmpd" podStartSLOduration=3.993007849 podStartE2EDuration="5.096040516s" totalImagesPullingTime="1.041789284s" totalInitContainerRuntime="61.243383ms" isStatefulPod=true podCreationTimestamp="2026-08-05 16:40:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:40:57.471366271 +0000 UTC m=+130.053437927" watchObservedRunningTime="2026-08-05 16:40:58.096040516 +0000 UTC m=+130.678112176"
Aug 05 16:40:58.096420 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:58.096404    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pjntd"]
Aug 05 16:40:58.099263 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:40:58.099237    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57bcc436_b7a1_4fe4_a41c_3e531fdab605.slice/crio-36b279ea15dc199447e5f76c7c836cc9cfa2784e32a41b49696cd5cfd7b9c0c6 WatchSource:0}: Error finding container 36b279ea15dc199447e5f76c7c836cc9cfa2784e32a41b49696cd5cfd7b9c0c6: Status 404 returned error can't find the container with id 36b279ea15dc199447e5f76c7c836cc9cfa2784e32a41b49696cd5cfd7b9c0c6
Aug 05 16:40:58.452369 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:58.452327    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pjntd" event={"ID":"57bcc436-b7a1-4fe4-a41c-3e531fdab605","Type":"ContainerStarted","Data":"36b279ea15dc199447e5f76c7c836cc9cfa2784e32a41b49696cd5cfd7b9c0c6"}
Aug 05 16:40:59.458237 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:40:59.458200    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pjntd" event={"ID":"57bcc436-b7a1-4fe4-a41c-3e531fdab605","Type":"ContainerStarted","Data":"f98af5c0bacf135d7dac3080e9432787c5d181abe23ea5363a422073bf0dc1f8"}
Aug 05 16:41:00.462436 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:00.462398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pjntd" event={"ID":"57bcc436-b7a1-4fe4-a41c-3e531fdab605","Type":"ContainerStarted","Data":"3e8971e32d7977f052bd2e5dc7008f5f1c2d9d877aaf2015b642016d324f14c5"}
Aug 05 16:41:00.482227 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:00.482174    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pjntd" podStartSLOduration=131.247812158 podStartE2EDuration="2m12.482155162s" totalImagesPullingTime="1.234343004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:41:00.481840243 +0000 UTC m=+133.063911961" watchObservedRunningTime="2026-08-05 16:41:00.482155162 +0000 UTC m=+133.064226818"
Aug 05 16:41:02.697540 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:02.697510    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7456db797f-tp7x9"]
Aug 05 16:41:04.590086 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:04.590048    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl" podUID="30fa8922-aa9e-409c-914f-35266f7b16a7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 05 16:41:14.590237 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:14.590191    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl" podUID="30fa8922-aa9e-409c-914f-35266f7b16a7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 05 16:41:24.589988 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:24.589951    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl" podUID="30fa8922-aa9e-409c-914f-35266f7b16a7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Aug 05 16:41:24.590501 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:24.590035    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl"
Aug 05 16:41:24.590668 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:24.590632    2565 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"bbf00fe32806f0f35463051547caa89847c09e6a60996f7fdf524733be128e6e"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Aug 05 16:41:24.590736 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:24.590695    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl" podUID="30fa8922-aa9e-409c-914f-35266f7b16a7" containerName="service-proxy" containerID="cri-o://bbf00fe32806f0f35463051547caa89847c09e6a60996f7fdf524733be128e6e" gracePeriod=30
Aug 05 16:41:25.540795 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:25.540762    2565 generic.go:356] "Generic (PLEG): container finished" podID="30fa8922-aa9e-409c-914f-35266f7b16a7" containerID="bbf00fe32806f0f35463051547caa89847c09e6a60996f7fdf524733be128e6e" exitCode=2
Aug 05 16:41:25.540977 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:25.540825    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl" event={"ID":"30fa8922-aa9e-409c-914f-35266f7b16a7","Type":"ContainerDied","Data":"bbf00fe32806f0f35463051547caa89847c09e6a60996f7fdf524733be128e6e"}
Aug 05 16:41:25.540977 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:25.540869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-654b458d44-mw8jl" event={"ID":"30fa8922-aa9e-409c-914f-35266f7b16a7","Type":"ContainerStarted","Data":"08b8bf1368808ed5a6afdd5c2ba0ef82eb8c84fec6ad0a78da655902f4ddc11f"}
Aug 05 16:41:27.386389 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:41:27.386284    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9hvbp" podUID="36075180-a7b5-4331-9929-41bf8e64d43d"
Aug 05 16:41:27.716047 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:27.715957    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7456db797f-tp7x9" podUID="02bcdafb-b382-4263-bf2e-2297dbd97504" containerName="registry" containerID="cri-o://8f79609a5cf63f6a5421326ec7193b4dd915d5e48e7876b9f74de7221ffebf0a" gracePeriod=30
Aug 05 16:41:27.946502 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:27.946479    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:41:28.035217 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.035140    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02bcdafb-b382-4263-bf2e-2297dbd97504-installation-pull-secrets\") pod \"02bcdafb-b382-4263-bf2e-2297dbd97504\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") "
Aug 05 16:41:28.035217 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.035177    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02bcdafb-b382-4263-bf2e-2297dbd97504-ca-trust-extracted\") pod \"02bcdafb-b382-4263-bf2e-2297dbd97504\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") "
Aug 05 16:41:28.035217 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.035204    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls\") pod \"02bcdafb-b382-4263-bf2e-2297dbd97504\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") "
Aug 05 16:41:28.035471 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.035230    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfwvg\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-kube-api-access-sfwvg\") pod \"02bcdafb-b382-4263-bf2e-2297dbd97504\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") "
Aug 05 16:41:28.035471 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.035257    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-bound-sa-token\") pod \"02bcdafb-b382-4263-bf2e-2297dbd97504\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") "
Aug 05 16:41:28.035471 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.035277    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-certificates\") pod \"02bcdafb-b382-4263-bf2e-2297dbd97504\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") "
Aug 05 16:41:28.035471 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.035296    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02bcdafb-b382-4263-bf2e-2297dbd97504-trusted-ca\") pod \"02bcdafb-b382-4263-bf2e-2297dbd97504\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") "
Aug 05 16:41:28.035471 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.035323    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02bcdafb-b382-4263-bf2e-2297dbd97504-image-registry-private-configuration\") pod \"02bcdafb-b382-4263-bf2e-2297dbd97504\" (UID: \"02bcdafb-b382-4263-bf2e-2297dbd97504\") "
Aug 05 16:41:28.035816 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.035785    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "02bcdafb-b382-4263-bf2e-2297dbd97504" (UID: "02bcdafb-b382-4263-bf2e-2297dbd97504"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:41:28.036029 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.035962    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02bcdafb-b382-4263-bf2e-2297dbd97504-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "02bcdafb-b382-4263-bf2e-2297dbd97504" (UID: "02bcdafb-b382-4263-bf2e-2297dbd97504"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:41:28.037812 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.037778    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02bcdafb-b382-4263-bf2e-2297dbd97504-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "02bcdafb-b382-4263-bf2e-2297dbd97504" (UID: "02bcdafb-b382-4263-bf2e-2297dbd97504"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:41:28.037914 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.037847    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "02bcdafb-b382-4263-bf2e-2297dbd97504" (UID: "02bcdafb-b382-4263-bf2e-2297dbd97504"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:41:28.037985 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.037943    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "02bcdafb-b382-4263-bf2e-2297dbd97504" (UID: "02bcdafb-b382-4263-bf2e-2297dbd97504"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:41:28.038043 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.038008    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02bcdafb-b382-4263-bf2e-2297dbd97504-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "02bcdafb-b382-4263-bf2e-2297dbd97504" (UID: "02bcdafb-b382-4263-bf2e-2297dbd97504"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:41:28.038092 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.038050    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-kube-api-access-sfwvg" (OuterVolumeSpecName: "kube-api-access-sfwvg") pod "02bcdafb-b382-4263-bf2e-2297dbd97504" (UID: "02bcdafb-b382-4263-bf2e-2297dbd97504"). InnerVolumeSpecName "kube-api-access-sfwvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:41:28.043922 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.043901    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02bcdafb-b382-4263-bf2e-2297dbd97504-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "02bcdafb-b382-4263-bf2e-2297dbd97504" (UID: "02bcdafb-b382-4263-bf2e-2297dbd97504"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:41:28.136027 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.136005    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/02bcdafb-b382-4263-bf2e-2297dbd97504-installation-pull-secrets\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:41:28.136027 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.136024    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/02bcdafb-b382-4263-bf2e-2297dbd97504-ca-trust-extracted\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:41:28.136186 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.136033    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-tls\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:41:28.136186 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.136043    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfwvg\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-kube-api-access-sfwvg\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:41:28.136186 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.136052    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/02bcdafb-b382-4263-bf2e-2297dbd97504-bound-sa-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:41:28.136186 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.136059    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/02bcdafb-b382-4263-bf2e-2297dbd97504-registry-certificates\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:41:28.136186 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.136069    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/02bcdafb-b382-4263-bf2e-2297dbd97504-trusted-ca\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:41:28.136186 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.136077    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/02bcdafb-b382-4263-bf2e-2297dbd97504-image-registry-private-configuration\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:41:28.550767 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.550734    2565 generic.go:356] "Generic (PLEG): container finished" podID="02bcdafb-b382-4263-bf2e-2297dbd97504" containerID="8f79609a5cf63f6a5421326ec7193b4dd915d5e48e7876b9f74de7221ffebf0a" exitCode=0
Aug 05 16:41:28.551210 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.550778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7456db797f-tp7x9" event={"ID":"02bcdafb-b382-4263-bf2e-2297dbd97504","Type":"ContainerDied","Data":"8f79609a5cf63f6a5421326ec7193b4dd915d5e48e7876b9f74de7221ffebf0a"}
Aug 05 16:41:28.551210 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.550782    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7456db797f-tp7x9"
Aug 05 16:41:28.551210 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.550820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7456db797f-tp7x9" event={"ID":"02bcdafb-b382-4263-bf2e-2297dbd97504","Type":"ContainerDied","Data":"e9dcfde30767962f086ade5d03ff2e3b98e271afc3e44d04c7146fafff333a6c"}
Aug 05 16:41:28.551210 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.550842    2565 scope.go:117] "RemoveContainer" containerID="8f79609a5cf63f6a5421326ec7193b4dd915d5e48e7876b9f74de7221ffebf0a"
Aug 05 16:41:28.560999 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.560985    2565 scope.go:117] "RemoveContainer" containerID="8f79609a5cf63f6a5421326ec7193b4dd915d5e48e7876b9f74de7221ffebf0a"
Aug 05 16:41:28.561257 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:41:28.561236    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f79609a5cf63f6a5421326ec7193b4dd915d5e48e7876b9f74de7221ffebf0a\": container with ID starting with 8f79609a5cf63f6a5421326ec7193b4dd915d5e48e7876b9f74de7221ffebf0a not found: ID does not exist" containerID="8f79609a5cf63f6a5421326ec7193b4dd915d5e48e7876b9f74de7221ffebf0a"
Aug 05 16:41:28.561302 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.561268    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f79609a5cf63f6a5421326ec7193b4dd915d5e48e7876b9f74de7221ffebf0a"} err="failed to get container status \"8f79609a5cf63f6a5421326ec7193b4dd915d5e48e7876b9f74de7221ffebf0a\": rpc error: code = NotFound desc = could not find container \"8f79609a5cf63f6a5421326ec7193b4dd915d5e48e7876b9f74de7221ffebf0a\": container with ID starting with 8f79609a5cf63f6a5421326ec7193b4dd915d5e48e7876b9f74de7221ffebf0a not found: ID does not exist"
Aug 05 16:41:28.574365 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.574342    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7456db797f-tp7x9"]
Aug 05 16:41:28.581788 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:28.581767    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7456db797f-tp7x9"]
Aug 05 16:41:29.950597 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:29.950562    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02bcdafb-b382-4263-bf2e-2297dbd97504" path="/var/lib/kubelet/pods/02bcdafb-b382-4263-bf2e-2297dbd97504/volumes"
Aug 05 16:41:32.365031 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:32.364986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:41:32.367206 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:32.367184    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36075180-a7b5-4331-9929-41bf8e64d43d-metrics-tls\") pod \"dns-default-9hvbp\" (UID: \"36075180-a7b5-4331-9929-41bf8e64d43d\") " pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:41:37.948962 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:37.948926    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:41:37.952785 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:37.952762    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p9jdc\""
Aug 05 16:41:37.960315 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:37.960300    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:41:38.090267 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:38.090240    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9hvbp"]
Aug 05 16:41:38.092509 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:41:38.092483    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36075180_a7b5_4331_9929_41bf8e64d43d.slice/crio-ec66f3fa2289b129b8af1049d46b3dd7edd6aed3368ad082517e470fe85efcef WatchSource:0}: Error finding container ec66f3fa2289b129b8af1049d46b3dd7edd6aed3368ad082517e470fe85efcef: Status 404 returned error can't find the container with id ec66f3fa2289b129b8af1049d46b3dd7edd6aed3368ad082517e470fe85efcef
Aug 05 16:41:38.584180 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:38.584135    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9hvbp" event={"ID":"36075180-a7b5-4331-9929-41bf8e64d43d","Type":"ContainerStarted","Data":"ec66f3fa2289b129b8af1049d46b3dd7edd6aed3368ad082517e470fe85efcef"}
Aug 05 16:41:40.593650 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:40.593563    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9hvbp" event={"ID":"36075180-a7b5-4331-9929-41bf8e64d43d","Type":"ContainerStarted","Data":"c3d7af68ebd29c3e31966f54b08c4ae554640679309a3f74162b102782668a4c"}
Aug 05 16:41:40.593650 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:40.593625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9hvbp" event={"ID":"36075180-a7b5-4331-9929-41bf8e64d43d","Type":"ContainerStarted","Data":"c9f630547df40019793358cf45ea0177c607c9625e03eb993238503fa2386ba9"}
Aug 05 16:41:40.594155 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:40.593686    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:41:40.613082 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:40.612953    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9hvbp" podStartSLOduration=135.02474273 podStartE2EDuration="2m16.612941318s" totalImagesPullingTime="1.588198588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:41:40.612659464 +0000 UTC m=+173.194731121" watchObservedRunningTime="2026-08-05 16:41:40.612941318 +0000 UTC m=+173.195012973"
Aug 05 16:41:50.599542 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:41:50.599510    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9hvbp"
Aug 05 16:43:47.842581 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:47.842544    2565 kubelet.go:1648] "Image garbage collection succeeded"
Aug 05 16:43:55.237789 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.237753    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"]
Aug 05 16:43:55.240057 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.237957    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02bcdafb-b382-4263-bf2e-2297dbd97504" containerName="registry"
Aug 05 16:43:55.240057 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.237968    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="02bcdafb-b382-4263-bf2e-2297dbd97504" containerName="registry"
Aug 05 16:43:55.240057 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.238018    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="02bcdafb-b382-4263-bf2e-2297dbd97504" containerName="registry"
Aug 05 16:43:55.240975 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.240959    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"
Aug 05 16:43:55.243499 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.243473    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 16:43:55.243625 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.243510    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vpzkn\""
Aug 05 16:43:55.244258 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.244242    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 16:43:55.251640 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.251619    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"]
Aug 05 16:43:55.326301 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.326276    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thqgq\" (UniqueName: \"kubernetes.io/projected/95d915f2-3866-4f83-aedb-81026cb57abf-kube-api-access-thqgq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2\" (UID: \"95d915f2-3866-4f83-aedb-81026cb57abf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"
Aug 05 16:43:55.326407 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.326330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95d915f2-3866-4f83-aedb-81026cb57abf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2\" (UID: \"95d915f2-3866-4f83-aedb-81026cb57abf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"
Aug 05 16:43:55.326407 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.326369    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95d915f2-3866-4f83-aedb-81026cb57abf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2\" (UID: \"95d915f2-3866-4f83-aedb-81026cb57abf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"
Aug 05 16:43:55.426838 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.426805    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95d915f2-3866-4f83-aedb-81026cb57abf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2\" (UID: \"95d915f2-3866-4f83-aedb-81026cb57abf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"
Aug 05 16:43:55.426927 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.426847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95d915f2-3866-4f83-aedb-81026cb57abf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2\" (UID: \"95d915f2-3866-4f83-aedb-81026cb57abf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"
Aug 05 16:43:55.426927 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.426887    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thqgq\" (UniqueName: \"kubernetes.io/projected/95d915f2-3866-4f83-aedb-81026cb57abf-kube-api-access-thqgq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2\" (UID: \"95d915f2-3866-4f83-aedb-81026cb57abf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"
Aug 05 16:43:55.427166 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.427151    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95d915f2-3866-4f83-aedb-81026cb57abf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2\" (UID: \"95d915f2-3866-4f83-aedb-81026cb57abf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"
Aug 05 16:43:55.427268 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.427251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95d915f2-3866-4f83-aedb-81026cb57abf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2\" (UID: \"95d915f2-3866-4f83-aedb-81026cb57abf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"
Aug 05 16:43:55.461766 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.461736    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thqgq\" (UniqueName: \"kubernetes.io/projected/95d915f2-3866-4f83-aedb-81026cb57abf-kube-api-access-thqgq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2\" (UID: \"95d915f2-3866-4f83-aedb-81026cb57abf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"
Aug 05 16:43:55.550001 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.549975    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"
Aug 05 16:43:55.709038 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.709008    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"]
Aug 05 16:43:55.712338 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:43:55.712313    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d915f2_3866_4f83_aedb_81026cb57abf.slice/crio-4a714412eb8533b97958b470af146e275f496079355257a7fba4a689b973f03e WatchSource:0}: Error finding container 4a714412eb8533b97958b470af146e275f496079355257a7fba4a689b973f03e: Status 404 returned error can't find the container with id 4a714412eb8533b97958b470af146e275f496079355257a7fba4a689b973f03e
Aug 05 16:43:55.714679 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:55.714663    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:43:56.008713 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:43:56.008631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2" event={"ID":"95d915f2-3866-4f83-aedb-81026cb57abf","Type":"ContainerStarted","Data":"4a714412eb8533b97958b470af146e275f496079355257a7fba4a689b973f03e"}
Aug 05 16:44:02.032055 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:02.032022    2565 generic.go:356] "Generic (PLEG): container finished" podID="95d915f2-3866-4f83-aedb-81026cb57abf" containerID="d93a8d970d49798b8d2432ee58b58fbc9d6a8944db26cd36f7064b64a341e45e" exitCode=0
Aug 05 16:44:02.032484 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:02.032091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2" event={"ID":"95d915f2-3866-4f83-aedb-81026cb57abf","Type":"ContainerDied","Data":"d93a8d970d49798b8d2432ee58b58fbc9d6a8944db26cd36f7064b64a341e45e"}
Aug 05 16:44:05.045587 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.045556    2565 generic.go:356] "Generic (PLEG): container finished" podID="95d915f2-3866-4f83-aedb-81026cb57abf" containerID="09568e9a0a9770a1c0eae78fd5384aaccca18090b61fada55c16278dfc7810a7" exitCode=0
Aug 05 16:44:05.045976 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.045600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2" event={"ID":"95d915f2-3866-4f83-aedb-81026cb57abf","Type":"ContainerDied","Data":"09568e9a0a9770a1c0eae78fd5384aaccca18090b61fada55c16278dfc7810a7"}
Aug 05 16:44:05.362017 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.361986    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ggzrd"]
Aug 05 16:44:05.365064 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.365047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ggzrd"
Aug 05 16:44:05.368014 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.367993    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bqtsw\""
Aug 05 16:44:05.371408 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.371247    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 05 16:44:05.371488 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.371465    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 05 16:44:05.387409 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.387387    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ggzrd"]
Aug 05 16:44:05.403017 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.402995    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d49mm\" (UniqueName: \"kubernetes.io/projected/fa488fe5-9bcc-420e-a9aa-18bb0327fd64-kube-api-access-d49mm\") pod \"cert-manager-55b4d954d5-ggzrd\" (UID: \"fa488fe5-9bcc-420e-a9aa-18bb0327fd64\") " pod="cert-manager/cert-manager-55b4d954d5-ggzrd"
Aug 05 16:44:05.403128 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.403024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa488fe5-9bcc-420e-a9aa-18bb0327fd64-bound-sa-token\") pod \"cert-manager-55b4d954d5-ggzrd\" (UID: \"fa488fe5-9bcc-420e-a9aa-18bb0327fd64\") " pod="cert-manager/cert-manager-55b4d954d5-ggzrd"
Aug 05 16:44:05.503824 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.503784    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d49mm\" (UniqueName: \"kubernetes.io/projected/fa488fe5-9bcc-420e-a9aa-18bb0327fd64-kube-api-access-d49mm\") pod \"cert-manager-55b4d954d5-ggzrd\" (UID: \"fa488fe5-9bcc-420e-a9aa-18bb0327fd64\") " pod="cert-manager/cert-manager-55b4d954d5-ggzrd"
Aug 05 16:44:05.504014 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.503837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa488fe5-9bcc-420e-a9aa-18bb0327fd64-bound-sa-token\") pod \"cert-manager-55b4d954d5-ggzrd\" (UID: \"fa488fe5-9bcc-420e-a9aa-18bb0327fd64\") " pod="cert-manager/cert-manager-55b4d954d5-ggzrd"
Aug 05 16:44:05.525577 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.525547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d49mm\" (UniqueName: \"kubernetes.io/projected/fa488fe5-9bcc-420e-a9aa-18bb0327fd64-kube-api-access-d49mm\") pod \"cert-manager-55b4d954d5-ggzrd\" (UID: \"fa488fe5-9bcc-420e-a9aa-18bb0327fd64\") " pod="cert-manager/cert-manager-55b4d954d5-ggzrd"
Aug 05 16:44:05.529091 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.529065    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa488fe5-9bcc-420e-a9aa-18bb0327fd64-bound-sa-token\") pod \"cert-manager-55b4d954d5-ggzrd\" (UID: \"fa488fe5-9bcc-420e-a9aa-18bb0327fd64\") " pod="cert-manager/cert-manager-55b4d954d5-ggzrd"
Aug 05 16:44:05.674351 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.674265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ggzrd"
Aug 05 16:44:05.833345 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:05.833300    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ggzrd"]
Aug 05 16:44:05.836739 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:44:05.836710    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa488fe5_9bcc_420e_a9aa_18bb0327fd64.slice/crio-b9999cc10de7f6060e908a6f4e492cd90c1273c0d141544008c3d9b120000ee5 WatchSource:0}: Error finding container b9999cc10de7f6060e908a6f4e492cd90c1273c0d141544008c3d9b120000ee5: Status 404 returned error can't find the container with id b9999cc10de7f6060e908a6f4e492cd90c1273c0d141544008c3d9b120000ee5
Aug 05 16:44:06.050146 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:06.050120    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ggzrd" event={"ID":"fa488fe5-9bcc-420e-a9aa-18bb0327fd64","Type":"ContainerStarted","Data":"b9999cc10de7f6060e908a6f4e492cd90c1273c0d141544008c3d9b120000ee5"}
Aug 05 16:44:12.075720 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:12.075689    2565 generic.go:356] "Generic (PLEG): container finished" podID="95d915f2-3866-4f83-aedb-81026cb57abf" containerID="9d9d4d7282698c163996db7fa4a55d284f76e40a2238a5ff720da22af973f5d7" exitCode=0
Aug 05 16:44:12.076136 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:12.075722    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2" event={"ID":"95d915f2-3866-4f83-aedb-81026cb57abf","Type":"ContainerDied","Data":"9d9d4d7282698c163996db7fa4a55d284f76e40a2238a5ff720da22af973f5d7"}
Aug 05 16:44:12.077026 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:12.077004    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ggzrd" event={"ID":"fa488fe5-9bcc-420e-a9aa-18bb0327fd64","Type":"ContainerStarted","Data":"f1283d79a0deb0e7cedcfe2b1ce956185f723b1d80514e201861e51892348c3a"}
Aug 05 16:44:12.113460 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:12.113423    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ggzrd" podStartSLOduration=1.289099413 podStartE2EDuration="7.113410187s" totalImagesPullingTime="5.824310774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:44:12.11279065 +0000 UTC m=+324.694862306" watchObservedRunningTime="2026-08-05 16:44:12.113410187 +0000 UTC m=+324.695481842"
Aug 05 16:44:13.204991 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:13.204969    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"
Aug 05 16:44:13.263838 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:13.263798    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thqgq\" (UniqueName: \"kubernetes.io/projected/95d915f2-3866-4f83-aedb-81026cb57abf-kube-api-access-thqgq\") pod \"95d915f2-3866-4f83-aedb-81026cb57abf\" (UID: \"95d915f2-3866-4f83-aedb-81026cb57abf\") "
Aug 05 16:44:13.263979 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:13.263889    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95d915f2-3866-4f83-aedb-81026cb57abf-bundle\") pod \"95d915f2-3866-4f83-aedb-81026cb57abf\" (UID: \"95d915f2-3866-4f83-aedb-81026cb57abf\") "
Aug 05 16:44:13.263979 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:13.263928    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95d915f2-3866-4f83-aedb-81026cb57abf-util\") pod \"95d915f2-3866-4f83-aedb-81026cb57abf\" (UID: \"95d915f2-3866-4f83-aedb-81026cb57abf\") "
Aug 05 16:44:13.264267 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:13.264244    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95d915f2-3866-4f83-aedb-81026cb57abf-bundle" (OuterVolumeSpecName: "bundle") pod "95d915f2-3866-4f83-aedb-81026cb57abf" (UID: "95d915f2-3866-4f83-aedb-81026cb57abf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:44:13.265938 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:13.265912    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95d915f2-3866-4f83-aedb-81026cb57abf-kube-api-access-thqgq" (OuterVolumeSpecName: "kube-api-access-thqgq") pod "95d915f2-3866-4f83-aedb-81026cb57abf" (UID: "95d915f2-3866-4f83-aedb-81026cb57abf"). InnerVolumeSpecName "kube-api-access-thqgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:44:13.267917 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:13.267889    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95d915f2-3866-4f83-aedb-81026cb57abf-util" (OuterVolumeSpecName: "util") pod "95d915f2-3866-4f83-aedb-81026cb57abf" (UID: "95d915f2-3866-4f83-aedb-81026cb57abf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:44:13.365049 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:13.364959    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95d915f2-3866-4f83-aedb-81026cb57abf-util\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:44:13.365049 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:13.365000    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thqgq\" (UniqueName: \"kubernetes.io/projected/95d915f2-3866-4f83-aedb-81026cb57abf-kube-api-access-thqgq\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:44:13.365049 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:13.365011    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95d915f2-3866-4f83-aedb-81026cb57abf-bundle\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:44:14.084882 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:14.084846    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2" event={"ID":"95d915f2-3866-4f83-aedb-81026cb57abf","Type":"ContainerDied","Data":"4a714412eb8533b97958b470af146e275f496079355257a7fba4a689b973f03e"}
Aug 05 16:44:14.085027 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:14.084900    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a714412eb8533b97958b470af146e275f496079355257a7fba4a689b973f03e"
Aug 05 16:44:14.085027 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:14.084861    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff6zc2"
Aug 05 16:44:25.323662 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.323625    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"]
Aug 05 16:44:25.324129 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.323837    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95d915f2-3866-4f83-aedb-81026cb57abf" containerName="pull"
Aug 05 16:44:25.324129 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.323847    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="95d915f2-3866-4f83-aedb-81026cb57abf" containerName="pull"
Aug 05 16:44:25.324129 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.323857    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95d915f2-3866-4f83-aedb-81026cb57abf" containerName="util"
Aug 05 16:44:25.324129 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.323862    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="95d915f2-3866-4f83-aedb-81026cb57abf" containerName="util"
Aug 05 16:44:25.324129 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.323871    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95d915f2-3866-4f83-aedb-81026cb57abf" containerName="extract"
Aug 05 16:44:25.324129 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.323878    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="95d915f2-3866-4f83-aedb-81026cb57abf" containerName="extract"
Aug 05 16:44:25.324129 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.323920    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="95d915f2-3866-4f83-aedb-81026cb57abf" containerName="extract"
Aug 05 16:44:25.331056 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.331031    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"
Aug 05 16:44:25.333945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.333923    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vpzkn\""
Aug 05 16:44:25.334071 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.333959    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 16:44:25.334071 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.334033    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 16:44:25.336802 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.336781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"]
Aug 05 16:44:25.450726 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.450679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp\" (UID: \"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"
Aug 05 16:44:25.450912 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.450848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcbgk\" (UniqueName: \"kubernetes.io/projected/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-kube-api-access-vcbgk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp\" (UID: \"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"
Aug 05 16:44:25.450912 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.450898    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp\" (UID: \"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"
Aug 05 16:44:25.551906 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.551846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcbgk\" (UniqueName: \"kubernetes.io/projected/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-kube-api-access-vcbgk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp\" (UID: \"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"
Aug 05 16:44:25.551906 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.551910    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp\" (UID: \"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"
Aug 05 16:44:25.552192 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.551960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp\" (UID: \"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"
Aug 05 16:44:25.552385 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.552364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp\" (UID: \"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"
Aug 05 16:44:25.552455 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.552394    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp\" (UID: \"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"
Aug 05 16:44:25.560313 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.560289    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcbgk\" (UniqueName: \"kubernetes.io/projected/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-kube-api-access-vcbgk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp\" (UID: \"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"
Aug 05 16:44:25.639881 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.639795    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"
Aug 05 16:44:25.766970 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:25.766943    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"]
Aug 05 16:44:25.769877 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:44:25.769851    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e7cb1ac_1bb5_495e_bb8b_badfca96ad0b.slice/crio-95d2ead2223d8687e09aaff568a9673e14ea0604c57bdf4481f9b630cc8ccffe WatchSource:0}: Error finding container 95d2ead2223d8687e09aaff568a9673e14ea0604c57bdf4481f9b630cc8ccffe: Status 404 returned error can't find the container with id 95d2ead2223d8687e09aaff568a9673e14ea0604c57bdf4481f9b630cc8ccffe
Aug 05 16:44:26.126188 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:26.126149    2565 generic.go:356] "Generic (PLEG): container finished" podID="0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b" containerID="d90a519509de74c60a3a2084290dad22da5c582274ebbd6ab88cbc9acacf2e04" exitCode=0
Aug 05 16:44:26.126352 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:26.126198    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp" event={"ID":"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b","Type":"ContainerDied","Data":"d90a519509de74c60a3a2084290dad22da5c582274ebbd6ab88cbc9acacf2e04"}
Aug 05 16:44:26.126352 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:26.126235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp" event={"ID":"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b","Type":"ContainerStarted","Data":"95d2ead2223d8687e09aaff568a9673e14ea0604c57bdf4481f9b630cc8ccffe"}
Aug 05 16:44:27.131570 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:27.131539    2565 generic.go:356] "Generic (PLEG): container finished" podID="0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b" containerID="c53a9b5a561425fb144783341f556a2584f5eaf072f2635c73f923c7f1dc9a43" exitCode=0
Aug 05 16:44:27.131886 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:27.131599    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp" event={"ID":"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b","Type":"ContainerDied","Data":"c53a9b5a561425fb144783341f556a2584f5eaf072f2635c73f923c7f1dc9a43"}
Aug 05 16:44:28.136552 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:28.136517    2565 generic.go:356] "Generic (PLEG): container finished" podID="0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b" containerID="db0502317854f1f4a8880c61eb949fe4f8d8a6373e5122b348cc7010dc61f517" exitCode=0
Aug 05 16:44:28.136925 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:28.136603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp" event={"ID":"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b","Type":"ContainerDied","Data":"db0502317854f1f4a8880c61eb949fe4f8d8a6373e5122b348cc7010dc61f517"}
Aug 05 16:44:29.270577 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:29.270553    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"
Aug 05 16:44:29.380586 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:29.380534    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-util\") pod \"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b\" (UID: \"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b\") "
Aug 05 16:44:29.380794 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:29.380623    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-bundle\") pod \"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b\" (UID: \"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b\") "
Aug 05 16:44:29.380794 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:29.380657    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcbgk\" (UniqueName: \"kubernetes.io/projected/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-kube-api-access-vcbgk\") pod \"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b\" (UID: \"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b\") "
Aug 05 16:44:29.381382 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:29.381356    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-bundle" (OuterVolumeSpecName: "bundle") pod "0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b" (UID: "0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:44:29.382680 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:29.382661    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-kube-api-access-vcbgk" (OuterVolumeSpecName: "kube-api-access-vcbgk") pod "0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b" (UID: "0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b"). InnerVolumeSpecName "kube-api-access-vcbgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:44:29.386567 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:29.386546    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-util" (OuterVolumeSpecName: "util") pod "0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b" (UID: "0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:44:29.481219 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:29.481148    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcbgk\" (UniqueName: \"kubernetes.io/projected/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-kube-api-access-vcbgk\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:44:29.481219 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:29.481176    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-util\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:44:29.481219 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:29.481185    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b-bundle\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:44:30.145404 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:30.145370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp" event={"ID":"0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b","Type":"ContainerDied","Data":"95d2ead2223d8687e09aaff568a9673e14ea0604c57bdf4481f9b630cc8ccffe"}
Aug 05 16:44:30.145563 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:30.145417    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95d2ead2223d8687e09aaff568a9673e14ea0604c57bdf4481f9b630cc8ccffe"
Aug 05 16:44:30.145563 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:30.145376    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvd4hp"
Aug 05 16:44:38.836497 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.836466    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"]
Aug 05 16:44:38.836919 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.836712    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b" containerName="pull"
Aug 05 16:44:38.836919 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.836723    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b" containerName="pull"
Aug 05 16:44:38.836919 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.836739    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b" containerName="util"
Aug 05 16:44:38.836919 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.836744    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b" containerName="util"
Aug 05 16:44:38.836919 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.836753    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b" containerName="extract"
Aug 05 16:44:38.836919 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.836759    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b" containerName="extract"
Aug 05 16:44:38.836919 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.836796    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e7cb1ac-1bb5-495e-bb8b-badfca96ad0b" containerName="extract"
Aug 05 16:44:38.839856 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.839841    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:38.843581 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.843564    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 05 16:44:38.844929 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.844907    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 05 16:44:38.844929 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.844919    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 05 16:44:38.845086 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.844929    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 05 16:44:38.845209 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.845194    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-knfx2\""
Aug 05 16:44:38.893504 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.893468    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"]
Aug 05 16:44:38.952435 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.952391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4th82\" (UniqueName: \"kubernetes.io/projected/46ae273b-7295-437f-aa9e-8ce7c2267d12-kube-api-access-4th82\") pod \"opendatahub-operator-controller-manager-7b469b89cc-bw6xd\" (UID: \"46ae273b-7295-437f-aa9e-8ce7c2267d12\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:38.952435 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.952441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/46ae273b-7295-437f-aa9e-8ce7c2267d12-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-bw6xd\" (UID: \"46ae273b-7295-437f-aa9e-8ce7c2267d12\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:38.952679 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.952462    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46ae273b-7295-437f-aa9e-8ce7c2267d12-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-bw6xd\" (UID: \"46ae273b-7295-437f-aa9e-8ce7c2267d12\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:38.952679 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.952551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/46ae273b-7295-437f-aa9e-8ce7c2267d12-manifests\") pod \"opendatahub-operator-controller-manager-7b469b89cc-bw6xd\" (UID: \"46ae273b-7295-437f-aa9e-8ce7c2267d12\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:38.952679 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:38.952588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46ae273b-7295-437f-aa9e-8ce7c2267d12-tmp\") pod \"opendatahub-operator-controller-manager-7b469b89cc-bw6xd\" (UID: \"46ae273b-7295-437f-aa9e-8ce7c2267d12\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:39.053351 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:39.053303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4th82\" (UniqueName: \"kubernetes.io/projected/46ae273b-7295-437f-aa9e-8ce7c2267d12-kube-api-access-4th82\") pod \"opendatahub-operator-controller-manager-7b469b89cc-bw6xd\" (UID: \"46ae273b-7295-437f-aa9e-8ce7c2267d12\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:39.053351 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:39.053360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/46ae273b-7295-437f-aa9e-8ce7c2267d12-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-bw6xd\" (UID: \"46ae273b-7295-437f-aa9e-8ce7c2267d12\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:39.053611 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:39.053379    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46ae273b-7295-437f-aa9e-8ce7c2267d12-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-bw6xd\" (UID: \"46ae273b-7295-437f-aa9e-8ce7c2267d12\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:39.053611 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:39.053539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/46ae273b-7295-437f-aa9e-8ce7c2267d12-manifests\") pod \"opendatahub-operator-controller-manager-7b469b89cc-bw6xd\" (UID: \"46ae273b-7295-437f-aa9e-8ce7c2267d12\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:39.053611 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:39.053569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46ae273b-7295-437f-aa9e-8ce7c2267d12-tmp\") pod \"opendatahub-operator-controller-manager-7b469b89cc-bw6xd\" (UID: \"46ae273b-7295-437f-aa9e-8ce7c2267d12\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:39.054017 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:39.053981    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/46ae273b-7295-437f-aa9e-8ce7c2267d12-manifests\") pod \"opendatahub-operator-controller-manager-7b469b89cc-bw6xd\" (UID: \"46ae273b-7295-437f-aa9e-8ce7c2267d12\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:39.055685 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:39.055665    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46ae273b-7295-437f-aa9e-8ce7c2267d12-tmp\") pod \"opendatahub-operator-controller-manager-7b469b89cc-bw6xd\" (UID: \"46ae273b-7295-437f-aa9e-8ce7c2267d12\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:39.055810 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:39.055793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46ae273b-7295-437f-aa9e-8ce7c2267d12-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-bw6xd\" (UID: \"46ae273b-7295-437f-aa9e-8ce7c2267d12\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:39.055891 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:39.055873    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/46ae273b-7295-437f-aa9e-8ce7c2267d12-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b469b89cc-bw6xd\" (UID: \"46ae273b-7295-437f-aa9e-8ce7c2267d12\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:39.063224 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:39.063204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4th82\" (UniqueName: \"kubernetes.io/projected/46ae273b-7295-437f-aa9e-8ce7c2267d12-kube-api-access-4th82\") pod \"opendatahub-operator-controller-manager-7b469b89cc-bw6xd\" (UID: \"46ae273b-7295-437f-aa9e-8ce7c2267d12\") " pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:39.149171 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:39.149080    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:39.295484 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:39.295459    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"]
Aug 05 16:44:39.298416 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:44:39.298387    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ae273b_7295_437f_aa9e_8ce7c2267d12.slice/crio-cfdef6c9a1f2973067934b548ce8a66c7d62b0f7afa7cdae58d14a386fadc377 WatchSource:0}: Error finding container cfdef6c9a1f2973067934b548ce8a66c7d62b0f7afa7cdae58d14a386fadc377: Status 404 returned error can't find the container with id cfdef6c9a1f2973067934b548ce8a66c7d62b0f7afa7cdae58d14a386fadc377
Aug 05 16:44:40.181841 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:40.181807    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd" event={"ID":"46ae273b-7295-437f-aa9e-8ce7c2267d12","Type":"ContainerStarted","Data":"cfdef6c9a1f2973067934b548ce8a66c7d62b0f7afa7cdae58d14a386fadc377"}
Aug 05 16:44:43.196294 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:43.196262    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd" event={"ID":"46ae273b-7295-437f-aa9e-8ce7c2267d12","Type":"ContainerStarted","Data":"ae5a9722dd50717170cb72c7e8b7280ccd4a01817e643d23cefc339a9a03f7b6"}
Aug 05 16:44:44.201801 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:44.201767    2565 generic.go:356] "Generic (PLEG): container finished" podID="46ae273b-7295-437f-aa9e-8ce7c2267d12" containerID="ae5a9722dd50717170cb72c7e8b7280ccd4a01817e643d23cefc339a9a03f7b6" exitCode=0
Aug 05 16:44:44.202179 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:44.201840    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd" event={"ID":"46ae273b-7295-437f-aa9e-8ce7c2267d12","Type":"ContainerDied","Data":"ae5a9722dd50717170cb72c7e8b7280ccd4a01817e643d23cefc339a9a03f7b6"}
Aug 05 16:44:45.208176 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:45.208139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd" event={"ID":"46ae273b-7295-437f-aa9e-8ce7c2267d12","Type":"ContainerStarted","Data":"fee7c589a858e080410e7c8992116d8a392e58ccd92d58deee28940e72dabcca"}
Aug 05 16:44:45.208556 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:45.208277    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:45.267528 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:45.267477    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd" podStartSLOduration=2.656767048 podStartE2EDuration="7.267458323s" totalImagesPullingTime="3.536193844s" totalInitContainerRuntime="1.074497431s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:44:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:44:45.266780972 +0000 UTC m=+357.848852627" watchObservedRunningTime="2026-08-05 16:44:45.267458323 +0000 UTC m=+357.849529978"
Aug 05 16:44:56.214750 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:56.214713    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b469b89cc-bw6xd"
Aug 05 16:44:58.561779 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:58.561743    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hwwbv"]
Aug 05 16:44:58.570025 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:58.570005    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hwwbv"
Aug 05 16:44:58.573161 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:58.573137    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-q6ssp\""
Aug 05 16:44:58.573451 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:58.573424    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Aug 05 16:44:58.579564 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:58.579542    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hwwbv"]
Aug 05 16:44:58.696401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:58.696352    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp252\" (UniqueName: \"kubernetes.io/projected/aca483ee-433c-4c86-847c-8f7795f0b77e-kube-api-access-gp252\") pod \"odh-model-controller-7998c67dc4-hwwbv\" (UID: \"aca483ee-433c-4c86-847c-8f7795f0b77e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hwwbv"
Aug 05 16:44:58.696579 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:58.696409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aca483ee-433c-4c86-847c-8f7795f0b77e-cert\") pod \"odh-model-controller-7998c67dc4-hwwbv\" (UID: \"aca483ee-433c-4c86-847c-8f7795f0b77e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hwwbv"
Aug 05 16:44:58.796887 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:58.796850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aca483ee-433c-4c86-847c-8f7795f0b77e-cert\") pod \"odh-model-controller-7998c67dc4-hwwbv\" (UID: \"aca483ee-433c-4c86-847c-8f7795f0b77e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hwwbv"
Aug 05 16:44:58.797074 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:58.796939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp252\" (UniqueName: \"kubernetes.io/projected/aca483ee-433c-4c86-847c-8f7795f0b77e-kube-api-access-gp252\") pod \"odh-model-controller-7998c67dc4-hwwbv\" (UID: \"aca483ee-433c-4c86-847c-8f7795f0b77e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hwwbv"
Aug 05 16:44:58.797074 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:44:58.796999    2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Aug 05 16:44:58.797074 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:44:58.797071    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aca483ee-433c-4c86-847c-8f7795f0b77e-cert podName:aca483ee-433c-4c86-847c-8f7795f0b77e nodeName:}" failed. No retries permitted until 2026-08-05 16:44:59.297054636 +0000 UTC m=+371.879126270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/aca483ee-433c-4c86-847c-8f7795f0b77e-cert") pod "odh-model-controller-7998c67dc4-hwwbv" (UID: "aca483ee-433c-4c86-847c-8f7795f0b77e") : secret "odh-model-controller-webhook-cert" not found
Aug 05 16:44:58.805601 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:58.805580    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp252\" (UniqueName: \"kubernetes.io/projected/aca483ee-433c-4c86-847c-8f7795f0b77e-kube-api-access-gp252\") pod \"odh-model-controller-7998c67dc4-hwwbv\" (UID: \"aca483ee-433c-4c86-847c-8f7795f0b77e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hwwbv"
Aug 05 16:44:59.276662 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.276633    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6n7pc"]
Aug 05 16:44:59.279708 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.279695    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6n7pc"
Aug 05 16:44:59.282465 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.282443    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Aug 05 16:44:59.282465 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.282449    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-b88fk\""
Aug 05 16:44:59.290324 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.290302    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6n7pc"]
Aug 05 16:44:59.300249 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.300226    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aca483ee-433c-4c86-847c-8f7795f0b77e-cert\") pod \"odh-model-controller-7998c67dc4-hwwbv\" (UID: \"aca483ee-433c-4c86-847c-8f7795f0b77e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hwwbv"
Aug 05 16:44:59.302490 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.302473    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aca483ee-433c-4c86-847c-8f7795f0b77e-cert\") pod \"odh-model-controller-7998c67dc4-hwwbv\" (UID: \"aca483ee-433c-4c86-847c-8f7795f0b77e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hwwbv"
Aug 05 16:44:59.400735 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.400704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/760b8ac3-fc68-4b63-aed9-5d659186013a-tls-certs\") pod \"model-serving-api-54d89bd5fc-6n7pc\" (UID: \"760b8ac3-fc68-4b63-aed9-5d659186013a\") " pod="opendatahub/model-serving-api-54d89bd5fc-6n7pc"
Aug 05 16:44:59.400883 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.400749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rwbp\" (UniqueName: \"kubernetes.io/projected/760b8ac3-fc68-4b63-aed9-5d659186013a-kube-api-access-8rwbp\") pod \"model-serving-api-54d89bd5fc-6n7pc\" (UID: \"760b8ac3-fc68-4b63-aed9-5d659186013a\") " pod="opendatahub/model-serving-api-54d89bd5fc-6n7pc"
Aug 05 16:44:59.480171 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.480134    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hwwbv"
Aug 05 16:44:59.501510 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.501486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/760b8ac3-fc68-4b63-aed9-5d659186013a-tls-certs\") pod \"model-serving-api-54d89bd5fc-6n7pc\" (UID: \"760b8ac3-fc68-4b63-aed9-5d659186013a\") " pod="opendatahub/model-serving-api-54d89bd5fc-6n7pc"
Aug 05 16:44:59.501631 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.501524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rwbp\" (UniqueName: \"kubernetes.io/projected/760b8ac3-fc68-4b63-aed9-5d659186013a-kube-api-access-8rwbp\") pod \"model-serving-api-54d89bd5fc-6n7pc\" (UID: \"760b8ac3-fc68-4b63-aed9-5d659186013a\") " pod="opendatahub/model-serving-api-54d89bd5fc-6n7pc"
Aug 05 16:44:59.504163 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.504139    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/760b8ac3-fc68-4b63-aed9-5d659186013a-tls-certs\") pod \"model-serving-api-54d89bd5fc-6n7pc\" (UID: \"760b8ac3-fc68-4b63-aed9-5d659186013a\") " pod="opendatahub/model-serving-api-54d89bd5fc-6n7pc"
Aug 05 16:44:59.512737 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.512716    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rwbp\" (UniqueName: \"kubernetes.io/projected/760b8ac3-fc68-4b63-aed9-5d659186013a-kube-api-access-8rwbp\") pod \"model-serving-api-54d89bd5fc-6n7pc\" (UID: \"760b8ac3-fc68-4b63-aed9-5d659186013a\") " pod="opendatahub/model-serving-api-54d89bd5fc-6n7pc"
Aug 05 16:44:59.589468 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.589438    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6n7pc"
Aug 05 16:44:59.612564 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.612530    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hwwbv"]
Aug 05 16:44:59.616494 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:44:59.616455    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca483ee_433c_4c86_847c_8f7795f0b77e.slice/crio-d2a8e2ae81aa897cd760ce3010eceadccd4505ffc855c9d6d851b08f16f42c9e WatchSource:0}: Error finding container d2a8e2ae81aa897cd760ce3010eceadccd4505ffc855c9d6d851b08f16f42c9e: Status 404 returned error can't find the container with id d2a8e2ae81aa897cd760ce3010eceadccd4505ffc855c9d6d851b08f16f42c9e
Aug 05 16:44:59.719931 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:44:59.719905    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6n7pc"]
Aug 05 16:44:59.722088 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:44:59.722065    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760b8ac3_fc68_4b63_aed9_5d659186013a.slice/crio-79f2097152af245d8afe7870325e0ec9497d3d03fc2b0dc7985dbb644a16cbcf WatchSource:0}: Error finding container 79f2097152af245d8afe7870325e0ec9497d3d03fc2b0dc7985dbb644a16cbcf: Status 404 returned error can't find the container with id 79f2097152af245d8afe7870325e0ec9497d3d03fc2b0dc7985dbb644a16cbcf
Aug 05 16:45:00.263663 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:00.263627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hwwbv" event={"ID":"aca483ee-433c-4c86-847c-8f7795f0b77e","Type":"ContainerStarted","Data":"d2a8e2ae81aa897cd760ce3010eceadccd4505ffc855c9d6d851b08f16f42c9e"}
Aug 05 16:45:00.264628 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:00.264606    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6n7pc" event={"ID":"760b8ac3-fc68-4b63-aed9-5d659186013a","Type":"ContainerStarted","Data":"79f2097152af245d8afe7870325e0ec9497d3d03fc2b0dc7985dbb644a16cbcf"}
Aug 05 16:45:01.672625 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.672582    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv"]
Aug 05 16:45:01.679542 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.679476    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv"
Aug 05 16:45:01.683858 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.683705    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 05 16:45:01.683858 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.683718    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4nsxk\""
Aug 05 16:45:01.683858 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.683759    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 05 16:45:01.683858 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.683713    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 05 16:45:01.684194 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.684004    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 05 16:45:01.711846 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.711780    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv"]
Aug 05 16:45:01.821225 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.821184    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93a27b55-38da-4d1c-b91c-4b9bd5cefec9-tmp\") pod \"kube-auth-proxy-558bb69c48-tw9pv\" (UID: \"93a27b55-38da-4d1c-b91c-4b9bd5cefec9\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv"
Aug 05 16:45:01.821410 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.821240    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93a27b55-38da-4d1c-b91c-4b9bd5cefec9-tls-certs\") pod \"kube-auth-proxy-558bb69c48-tw9pv\" (UID: \"93a27b55-38da-4d1c-b91c-4b9bd5cefec9\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv"
Aug 05 16:45:01.821410 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.821289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s77b9\" (UniqueName: \"kubernetes.io/projected/93a27b55-38da-4d1c-b91c-4b9bd5cefec9-kube-api-access-s77b9\") pod \"kube-auth-proxy-558bb69c48-tw9pv\" (UID: \"93a27b55-38da-4d1c-b91c-4b9bd5cefec9\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv"
Aug 05 16:45:01.922477 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.922445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s77b9\" (UniqueName: \"kubernetes.io/projected/93a27b55-38da-4d1c-b91c-4b9bd5cefec9-kube-api-access-s77b9\") pod \"kube-auth-proxy-558bb69c48-tw9pv\" (UID: \"93a27b55-38da-4d1c-b91c-4b9bd5cefec9\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv"
Aug 05 16:45:01.922684 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.922517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93a27b55-38da-4d1c-b91c-4b9bd5cefec9-tmp\") pod \"kube-auth-proxy-558bb69c48-tw9pv\" (UID: \"93a27b55-38da-4d1c-b91c-4b9bd5cefec9\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv"
Aug 05 16:45:01.922684 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.922552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93a27b55-38da-4d1c-b91c-4b9bd5cefec9-tls-certs\") pod \"kube-auth-proxy-558bb69c48-tw9pv\" (UID: \"93a27b55-38da-4d1c-b91c-4b9bd5cefec9\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv"
Aug 05 16:45:01.924997 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.924965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93a27b55-38da-4d1c-b91c-4b9bd5cefec9-tmp\") pod \"kube-auth-proxy-558bb69c48-tw9pv\" (UID: \"93a27b55-38da-4d1c-b91c-4b9bd5cefec9\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv"
Aug 05 16:45:01.925339 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.925315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93a27b55-38da-4d1c-b91c-4b9bd5cefec9-tls-certs\") pod \"kube-auth-proxy-558bb69c48-tw9pv\" (UID: \"93a27b55-38da-4d1c-b91c-4b9bd5cefec9\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv"
Aug 05 16:45:01.933643 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.933619    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s77b9\" (UniqueName: \"kubernetes.io/projected/93a27b55-38da-4d1c-b91c-4b9bd5cefec9-kube-api-access-s77b9\") pod \"kube-auth-proxy-558bb69c48-tw9pv\" (UID: \"93a27b55-38da-4d1c-b91c-4b9bd5cefec9\") " pod="openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv"
Aug 05 16:45:01.991812 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:01.991781    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv"
Aug 05 16:45:03.237251 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.237218    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"]
Aug 05 16:45:03.247534 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.247504    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.251791 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.251768    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 05 16:45:03.251935 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.251795    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 05 16:45:03.251935 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.251827    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 05 16:45:03.251935 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.251926    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 05 16:45:03.252377 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.252322    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5dmv6\""
Aug 05 16:45:03.261126 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.261086    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"]
Aug 05 16:45:03.436630 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.436594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.436630 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.436636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6sq6\" (UniqueName: \"kubernetes.io/projected/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-kube-api-access-b6sq6\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.436876 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.436665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.436876 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.436712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.436876 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.436753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.436876 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.436808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.437036 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.436880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.538011 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.537926    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.538011 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.537980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.538235 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.538018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.538235 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.538046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.538235 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.538066    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6sq6\" (UniqueName: \"kubernetes.io/projected/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-kube-api-access-b6sq6\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.538235 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.538109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.538235 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.538147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.538840 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.538812    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.540618 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.540594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.540917 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.540894    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.540964 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.540937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.541019 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.540961    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.548881 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.548851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.549179 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.549161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6sq6\" (UniqueName: \"kubernetes.io/projected/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-kube-api-access-b6sq6\") pod \"istiod-openshift-gateway-7b7995d5cd-j6t6p\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.558847 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.558826    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:03.842980 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.842948    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"]
Aug 05 16:45:03.846773 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:45:03.846748    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dcb0a77_ad29_4f3e_ab7a_9a82ecc9aeb3.slice/crio-f67b53be91628a24c6ec3c1a048b4aaf62d0a99ea9c2552af12d07efd25c9f08 WatchSource:0}: Error finding container f67b53be91628a24c6ec3c1a048b4aaf62d0a99ea9c2552af12d07efd25c9f08: Status 404 returned error can't find the container with id f67b53be91628a24c6ec3c1a048b4aaf62d0a99ea9c2552af12d07efd25c9f08
Aug 05 16:45:03.861972 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:03.861897    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv"]
Aug 05 16:45:03.864531 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:45:03.864509    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a27b55_38da_4d1c_b91c_4b9bd5cefec9.slice/crio-78495b1623c7ce46d4f78ce4b207dc110b55c9fd707494b2d10cdada83118772 WatchSource:0}: Error finding container 78495b1623c7ce46d4f78ce4b207dc110b55c9fd707494b2d10cdada83118772: Status 404 returned error can't find the container with id 78495b1623c7ce46d4f78ce4b207dc110b55c9fd707494b2d10cdada83118772
Aug 05 16:45:04.287143 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:04.287113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6n7pc" event={"ID":"760b8ac3-fc68-4b63-aed9-5d659186013a","Type":"ContainerStarted","Data":"2904944f17c3073f9daee44f90eaf62312e541637803da5178d783634b419fc5"}
Aug 05 16:45:04.287577 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:04.287235    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-6n7pc"
Aug 05 16:45:04.288130 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:04.288113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv" event={"ID":"93a27b55-38da-4d1c-b91c-4b9bd5cefec9","Type":"ContainerStarted","Data":"78495b1623c7ce46d4f78ce4b207dc110b55c9fd707494b2d10cdada83118772"}
Aug 05 16:45:04.289310 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:04.289293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hwwbv" event={"ID":"aca483ee-433c-4c86-847c-8f7795f0b77e","Type":"ContainerStarted","Data":"082f1ef6c4c680cf0033fd6c40fc2768d51baaf8562739fce67403d377c80f1b"}
Aug 05 16:45:04.289360 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:04.289337    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-hwwbv"
Aug 05 16:45:04.295401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:04.295371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p" event={"ID":"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3","Type":"ContainerStarted","Data":"f67b53be91628a24c6ec3c1a048b4aaf62d0a99ea9c2552af12d07efd25c9f08"}
Aug 05 16:45:04.310471 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:04.310424    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-6n7pc" podStartSLOduration=1.292039485 podStartE2EDuration="5.310409619s" totalImagesPullingTime="4.018370134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:44:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:45:04.309152403 +0000 UTC m=+376.891224077" watchObservedRunningTime="2026-08-05 16:45:04.310409619 +0000 UTC m=+376.892481274"
Aug 05 16:45:04.346579 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:04.346524    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-hwwbv" podStartSLOduration=2.269088807 podStartE2EDuration="6.346509606s" totalImagesPullingTime="4.077420799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:45:04.343753109 +0000 UTC m=+376.925824766" watchObservedRunningTime="2026-08-05 16:45:04.346509606 +0000 UTC m=+376.928581263"
Aug 05 16:45:07.446703 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:07.446662    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:45:07.447003 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:07.446749    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:45:08.319039 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:08.316936    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p" event={"ID":"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3","Type":"ContainerStarted","Data":"2a0e05f62bdc1184f76b17d3b95dec8f724f684cc9b4c6ca8f669b2ed4df6fb3"}
Aug 05 16:45:08.319039 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:08.318501    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:08.320034 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:08.319999    2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-j6t6p container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 16:45:08.320163 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:08.320058    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p" podUID="5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 16:45:08.320354 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:08.320318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv" event={"ID":"93a27b55-38da-4d1c-b91c-4b9bd5cefec9","Type":"ContainerStarted","Data":"2862f640310119069b364cca5b616da6a5f03aeff64947d5d91ff9486084da66"}
Aug 05 16:45:08.351813 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:08.351757    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p" podStartSLOduration=1.754611443 podStartE2EDuration="5.351735978s" totalImagesPullingTime="3.597124535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:45:08.351434752 +0000 UTC m=+380.933506432" watchObservedRunningTime="2026-08-05 16:45:08.351735978 +0000 UTC m=+380.933807635"
Aug 05 16:45:08.379306 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:08.379200    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-558bb69c48-tw9pv" podStartSLOduration=3.8499987300000003 podStartE2EDuration="7.379180604s" totalImagesPullingTime="3.529181874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:45:08.376864007 +0000 UTC m=+380.958935664" watchObservedRunningTime="2026-08-05 16:45:08.379180604 +0000 UTC m=+380.961252268"
Aug 05 16:45:09.328775 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:09.328745    2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-j6t6p container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 16:45:09.329173 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:09.328793    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p" podUID="5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 16:45:10.011006 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.010975    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8"]
Aug 05 16:45:10.013696 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.013678    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8"
Aug 05 16:45:10.019320 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.019296    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jwd8x\""
Aug 05 16:45:10.019408 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.019328    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Aug 05 16:45:10.032388 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.032363    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz"]
Aug 05 16:45:10.035539 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.035521    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz"
Aug 05 16:45:10.039148 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.039128    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8"]
Aug 05 16:45:10.043089 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.043067    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Aug 05 16:45:10.043227 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.043206    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-579pt\""
Aug 05 16:45:10.076159 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.076136    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz"]
Aug 05 16:45:10.091635 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.091607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj98h\" (UniqueName: \"kubernetes.io/projected/c3f769e6-47f6-4ef5-bd99-1f1e109d9560-kube-api-access-hj98h\") pod \"kserve-controller-manager-d6f4b65b8-wtcf8\" (UID: \"c3f769e6-47f6-4ef5-bd99-1f1e109d9560\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8"
Aug 05 16:45:10.091750 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.091641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg6rq\" (UniqueName: \"kubernetes.io/projected/3b0e3360-4f3f-4448-8912-1935834449a2-kube-api-access-mg6rq\") pod \"llmisvc-controller-manager-777c6bd7d5-pfffz\" (UID: \"3b0e3360-4f3f-4448-8912-1935834449a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz"
Aug 05 16:45:10.091750 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.091684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b0e3360-4f3f-4448-8912-1935834449a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pfffz\" (UID: \"3b0e3360-4f3f-4448-8912-1935834449a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz"
Aug 05 16:45:10.091750 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.091717    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3f769e6-47f6-4ef5-bd99-1f1e109d9560-cert\") pod \"kserve-controller-manager-d6f4b65b8-wtcf8\" (UID: \"c3f769e6-47f6-4ef5-bd99-1f1e109d9560\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8"
Aug 05 16:45:10.158144 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.158111    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"]
Aug 05 16:45:10.161172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.161158    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.164317 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.164299    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-47jkc\""
Aug 05 16:45:10.181279 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.181254    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"]
Aug 05 16:45:10.192754 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.192730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvgvj\" (UniqueName: \"kubernetes.io/projected/63cf83c5-a91f-4968-9544-a41ce0330473-kube-api-access-pvgvj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.192873 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.192765    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63cf83c5-a91f-4968-9544-a41ce0330473-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.192873 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.192794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63cf83c5-a91f-4968-9544-a41ce0330473-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.192873 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.192839    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3f769e6-47f6-4ef5-bd99-1f1e109d9560-cert\") pod \"kserve-controller-manager-d6f4b65b8-wtcf8\" (UID: \"c3f769e6-47f6-4ef5-bd99-1f1e109d9560\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8"
Aug 05 16:45:10.192996 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.192876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63cf83c5-a91f-4968-9544-a41ce0330473-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.192996 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.192898    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cf83c5-a91f-4968-9544-a41ce0330473-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.192996 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.192921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63cf83c5-a91f-4968-9544-a41ce0330473-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.192996 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.192946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj98h\" (UniqueName: \"kubernetes.io/projected/c3f769e6-47f6-4ef5-bd99-1f1e109d9560-kube-api-access-hj98h\") pod \"kserve-controller-manager-d6f4b65b8-wtcf8\" (UID: \"c3f769e6-47f6-4ef5-bd99-1f1e109d9560\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8"
Aug 05 16:45:10.192996 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.192967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63cf83c5-a91f-4968-9544-a41ce0330473-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.192996 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.192994    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6rq\" (UniqueName: \"kubernetes.io/projected/3b0e3360-4f3f-4448-8912-1935834449a2-kube-api-access-mg6rq\") pod \"llmisvc-controller-manager-777c6bd7d5-pfffz\" (UID: \"3b0e3360-4f3f-4448-8912-1935834449a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz"
Aug 05 16:45:10.193278 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.193032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cf83c5-a91f-4968-9544-a41ce0330473-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.193278 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.193061    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63cf83c5-a91f-4968-9544-a41ce0330473-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.193278 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.193126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b0e3360-4f3f-4448-8912-1935834449a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pfffz\" (UID: \"3b0e3360-4f3f-4448-8912-1935834449a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz"
Aug 05 16:45:10.193278 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:45:10.193230    2565 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Aug 05 16:45:10.193278 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:45:10.193276    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b0e3360-4f3f-4448-8912-1935834449a2-cert podName:3b0e3360-4f3f-4448-8912-1935834449a2 nodeName:}" failed. No retries permitted until 2026-08-05 16:45:10.693258617 +0000 UTC m=+383.275330253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3b0e3360-4f3f-4448-8912-1935834449a2-cert") pod "llmisvc-controller-manager-777c6bd7d5-pfffz" (UID: "3b0e3360-4f3f-4448-8912-1935834449a2") : secret "llmisvc-webhook-server-cert" not found
Aug 05 16:45:10.195299 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.195279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3f769e6-47f6-4ef5-bd99-1f1e109d9560-cert\") pod \"kserve-controller-manager-d6f4b65b8-wtcf8\" (UID: \"c3f769e6-47f6-4ef5-bd99-1f1e109d9560\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8"
Aug 05 16:45:10.206375 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.206348    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj98h\" (UniqueName: \"kubernetes.io/projected/c3f769e6-47f6-4ef5-bd99-1f1e109d9560-kube-api-access-hj98h\") pod \"kserve-controller-manager-d6f4b65b8-wtcf8\" (UID: \"c3f769e6-47f6-4ef5-bd99-1f1e109d9560\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8"
Aug 05 16:45:10.208083 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.208066    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg6rq\" (UniqueName: \"kubernetes.io/projected/3b0e3360-4f3f-4448-8912-1935834449a2-kube-api-access-mg6rq\") pod \"llmisvc-controller-manager-777c6bd7d5-pfffz\" (UID: \"3b0e3360-4f3f-4448-8912-1935834449a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz"
Aug 05 16:45:10.293668 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.293598    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cf83c5-a91f-4968-9544-a41ce0330473-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.293668 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.293630    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63cf83c5-a91f-4968-9544-a41ce0330473-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.293863 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.293670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvgvj\" (UniqueName: \"kubernetes.io/projected/63cf83c5-a91f-4968-9544-a41ce0330473-kube-api-access-pvgvj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.293863 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.293696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63cf83c5-a91f-4968-9544-a41ce0330473-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.293863 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.293716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63cf83c5-a91f-4968-9544-a41ce0330473-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.293863 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.293749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63cf83c5-a91f-4968-9544-a41ce0330473-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.293863 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.293774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cf83c5-a91f-4968-9544-a41ce0330473-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.293863 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.293799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63cf83c5-a91f-4968-9544-a41ce0330473-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.293863 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.293851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63cf83c5-a91f-4968-9544-a41ce0330473-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.294259 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.294175    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cf83c5-a91f-4968-9544-a41ce0330473-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.294259 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.294199    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63cf83c5-a91f-4968-9544-a41ce0330473-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.294370 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.294284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63cf83c5-a91f-4968-9544-a41ce0330473-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.294370 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.294308    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63cf83c5-a91f-4968-9544-a41ce0330473-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.294453 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.294417    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63cf83c5-a91f-4968-9544-a41ce0330473-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.296144 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.296124    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63cf83c5-a91f-4968-9544-a41ce0330473-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.296267 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.296151    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63cf83c5-a91f-4968-9544-a41ce0330473-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.316293 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.316265    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63cf83c5-a91f-4968-9544-a41ce0330473-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.323218 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.323194    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8"
Aug 05 16:45:10.326733 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.326711    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvgvj\" (UniqueName: \"kubernetes.io/projected/63cf83c5-a91f-4968-9544-a41ce0330473-kube-api-access-pvgvj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62\" (UID: \"63cf83c5-a91f-4968-9544-a41ce0330473\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.334647 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.334627    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:10.470564 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.470515    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:10.520789 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.520758    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8"]
Aug 05 16:45:10.522457 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:45:10.522423    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f769e6_47f6_4ef5_bd99_1f1e109d9560.slice/crio-542c6d60164165886cac6186e679240f1026359571d044005fa105977189e2a4 WatchSource:0}: Error finding container 542c6d60164165886cac6186e679240f1026359571d044005fa105977189e2a4: Status 404 returned error can't find the container with id 542c6d60164165886cac6186e679240f1026359571d044005fa105977189e2a4
Aug 05 16:45:10.691013 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.690980    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"]
Aug 05 16:45:10.696829 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.696810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b0e3360-4f3f-4448-8912-1935834449a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pfffz\" (UID: \"3b0e3360-4f3f-4448-8912-1935834449a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz"
Aug 05 16:45:10.699057 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.699029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b0e3360-4f3f-4448-8912-1935834449a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pfffz\" (UID: \"3b0e3360-4f3f-4448-8912-1935834449a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz"
Aug 05 16:45:10.705188 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:45:10.705167    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63cf83c5_a91f_4968_9544_a41ce0330473.slice/crio-bd9e5cf56f9d9f7bc8de7e9eebf496217c92d519b3a73d2102a51b933899bee8 WatchSource:0}: Error finding container bd9e5cf56f9d9f7bc8de7e9eebf496217c92d519b3a73d2102a51b933899bee8: Status 404 returned error can't find the container with id bd9e5cf56f9d9f7bc8de7e9eebf496217c92d519b3a73d2102a51b933899bee8
Aug 05 16:45:10.946844 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:10.946759    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz"
Aug 05 16:45:11.077816 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:11.077792    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz"]
Aug 05 16:45:11.079958 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:45:11.079931    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3b0e3360_4f3f_4448_8912_1935834449a2.slice/crio-ee9ad8e1eb19e568dafa2262a9cf69d370d6ae32db09f57700cb794d743f4d27 WatchSource:0}: Error finding container ee9ad8e1eb19e568dafa2262a9cf69d370d6ae32db09f57700cb794d743f4d27: Status 404 returned error can't find the container with id ee9ad8e1eb19e568dafa2262a9cf69d370d6ae32db09f57700cb794d743f4d27
Aug 05 16:45:11.338363 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:11.338331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz" event={"ID":"3b0e3360-4f3f-4448-8912-1935834449a2","Type":"ContainerStarted","Data":"ee9ad8e1eb19e568dafa2262a9cf69d370d6ae32db09f57700cb794d743f4d27"}
Aug 05 16:45:11.339459 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:11.339436    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62" event={"ID":"63cf83c5-a91f-4968-9544-a41ce0330473","Type":"ContainerStarted","Data":"bd9e5cf56f9d9f7bc8de7e9eebf496217c92d519b3a73d2102a51b933899bee8"}
Aug 05 16:45:11.340565 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:11.340532    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8" event={"ID":"c3f769e6-47f6-4ef5-bd99-1f1e109d9560","Type":"ContainerStarted","Data":"542c6d60164165886cac6186e679240f1026359571d044005fa105977189e2a4"}
Aug 05 16:45:11.875015 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:11.874979    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"]
Aug 05 16:45:12.346389 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:12.346348    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p" podUID="5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" containerName="discovery" containerID="cri-o://2a0e05f62bdc1184f76b17d3b95dec8f724f684cc9b4c6ca8f669b2ed4df6fb3" gracePeriod=30
Aug 05 16:45:13.351711 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.351686    2565 generic.go:356] "Generic (PLEG): container finished" podID="5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" containerID="2a0e05f62bdc1184f76b17d3b95dec8f724f684cc9b4c6ca8f669b2ed4df6fb3" exitCode=0
Aug 05 16:45:13.352032 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.351764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p" event={"ID":"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3","Type":"ContainerDied","Data":"2a0e05f62bdc1184f76b17d3b95dec8f724f684cc9b4c6ca8f669b2ed4df6fb3"}
Aug 05 16:45:13.364619 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.364599    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:13.420938 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.420908    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6sq6\" (UniqueName: \"kubernetes.io/projected/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-kube-api-access-b6sq6\") pod \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") "
Aug 05 16:45:13.421127 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.420948    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-local-certs\") pod \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") "
Aug 05 16:45:13.421127 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.420982    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-csr-dns-cert\") pod \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") "
Aug 05 16:45:13.421127 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.421015    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-csr-ca-configmap\") pod \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") "
Aug 05 16:45:13.421127 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.421038    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-kubeconfig\") pod \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") "
Aug 05 16:45:13.421127 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.421081    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-cacerts\") pod \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") "
Aug 05 16:45:13.421363 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.421169    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-token\") pod \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\" (UID: \"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3\") "
Aug 05 16:45:13.421820 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.421691    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" (UID: "5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:45:13.423937 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.423868    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" (UID: "5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:45:13.424111 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.424070    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" (UID: "5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:45:13.424578 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.424494    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-token" (OuterVolumeSpecName: "istio-token") pod "5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" (UID: "5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:45:13.424699 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.424676    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-cacerts" (OuterVolumeSpecName: "cacerts") pod "5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" (UID: "5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:45:13.424870 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.424833    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-kube-api-access-b6sq6" (OuterVolumeSpecName: "kube-api-access-b6sq6") pod "5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" (UID: "5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3"). InnerVolumeSpecName "kube-api-access-b6sq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:45:13.425352 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.425320    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-local-certs" (OuterVolumeSpecName: "local-certs") pod "5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" (UID: "5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:45:13.522446 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.522407    2565 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-cacerts\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:45:13.522446 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.522442    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:45:13.522632 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.522455    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6sq6\" (UniqueName: \"kubernetes.io/projected/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-kube-api-access-b6sq6\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:45:13.522632 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.522465    2565 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-local-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:45:13.522632 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.522473    2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-csr-dns-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:45:13.522632 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.522483    2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-csr-ca-configmap\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:45:13.522632 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:13.522495    2565 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3-istio-kubeconfig\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:45:14.358055 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:14.358020    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"
Aug 05 16:45:14.358055 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:14.358038    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p" event={"ID":"5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3","Type":"ContainerDied","Data":"f67b53be91628a24c6ec3c1a048b4aaf62d0a99ea9c2552af12d07efd25c9f08"}
Aug 05 16:45:14.358555 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:14.358090    2565 scope.go:117] "RemoveContainer" containerID="2a0e05f62bdc1184f76b17d3b95dec8f724f684cc9b4c6ca8f669b2ed4df6fb3"
Aug 05 16:45:14.388178 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:14.388151    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"]
Aug 05 16:45:14.409191 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:14.409168    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p"]
Aug 05 16:45:14.567803 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:14.567762    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:45:14.567924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:14.567844    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:45:14.567924 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:14.567880    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:45:15.301851 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:15.301812    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-hwwbv"
Aug 05 16:45:15.304131 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:15.304092    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-6n7pc"
Aug 05 16:45:15.365323 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:15.365282    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8" event={"ID":"c3f769e6-47f6-4ef5-bd99-1f1e109d9560","Type":"ContainerStarted","Data":"b9f67d38739d1a877f61fd56fd4f66f0de834190d4c28bf01c97aefd8fb22f7c"}
Aug 05 16:45:15.366044 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:15.366022    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8"
Aug 05 16:45:15.368010 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:15.367983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz" event={"ID":"3b0e3360-4f3f-4448-8912-1935834449a2","Type":"ContainerStarted","Data":"324303688e38d1c14eeaa301415b5bacb125fadd068e42b6705a74d6cf6cedee"}
Aug 05 16:45:15.368217 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:15.368173    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz"
Aug 05 16:45:15.370155 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:15.370085    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62" event={"ID":"63cf83c5-a91f-4968-9544-a41ce0330473","Type":"ContainerStarted","Data":"a6881125c72fc639e6e6c6b6e33ab32070ab3b41ee0c5a11f19d00a99cbbc3f4"}
Aug 05 16:45:15.386668 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:15.386585    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8" podStartSLOduration=2.382089054 podStartE2EDuration="6.38657102s" totalImagesPullingTime="4.004481966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:45:15.384422763 +0000 UTC m=+387.966494414" watchObservedRunningTime="2026-08-05 16:45:15.38657102 +0000 UTC m=+387.968642676"
Aug 05 16:45:15.411780 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:15.411737    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62" podStartSLOduration=1.551410543 podStartE2EDuration="5.411724347s" totalImagesPullingTime="3.860313804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:45:15.410869225 +0000 UTC m=+387.992940882" watchObservedRunningTime="2026-08-05 16:45:15.411724347 +0000 UTC m=+387.993795981"
Aug 05 16:45:15.432385 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:15.432338    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz" podStartSLOduration=2.327041745 podStartE2EDuration="6.432319562s" totalImagesPullingTime="4.105277817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:45:15.431727963 +0000 UTC m=+388.013799619" watchObservedRunningTime="2026-08-05 16:45:15.432319562 +0000 UTC m=+388.014391221"
Aug 05 16:45:15.470625 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:15.470592    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:15.952550 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:15.952515    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" path="/var/lib/kubelet/pods/5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3/volumes"
Aug 05 16:45:16.475946 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:16.475918    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:17.380254 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:17.380221    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:17.380931 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:17.380911    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62"
Aug 05 16:45:18.335306 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:18.335269    2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-j6t6p container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.20:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Aug 05 16:45:18.335768 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:18.335335    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6t6p" podUID="5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.20:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Aug 05 16:45:46.377562 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:46.377531    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pfffz"
Aug 05 16:45:47.385027 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:45:47.385001    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wtcf8"
Aug 05 16:46:02.637143 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.637092    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"]
Aug 05 16:46:02.637587 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.637395    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" containerName="discovery"
Aug 05 16:46:02.637587 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.637406    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" containerName="discovery"
Aug 05 16:46:02.637587 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.637468    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dcb0a77-ad29-4f3e-ab7a-9a82ecc9aeb3" containerName="discovery"
Aug 05 16:46:02.647426 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.647406    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"
Aug 05 16:46:02.652407 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.652383    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"]
Aug 05 16:46:02.653405 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.653382    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vpzkn\""
Aug 05 16:46:02.653532 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.653382    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 16:46:02.654586 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.654563    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 16:46:02.729423 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.729386    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"]
Aug 05 16:46:02.732839 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.732816    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"
Aug 05 16:46:02.743799 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.743773    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"]
Aug 05 16:46:02.798719 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.798686    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"]
Aug 05 16:46:02.802058 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.802042    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"
Aug 05 16:46:02.812265 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.812240    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzd8j\" (UniqueName: \"kubernetes.io/projected/fd825172-7596-4f5f-b8b7-5bb18466e0a3-kube-api-access-tzd8j\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd\" (UID: \"fd825172-7596-4f5f-b8b7-5bb18466e0a3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"
Aug 05 16:46:02.812386 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.812283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd825172-7596-4f5f-b8b7-5bb18466e0a3-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd\" (UID: \"fd825172-7596-4f5f-b8b7-5bb18466e0a3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"
Aug 05 16:46:02.812386 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.812307    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd825172-7596-4f5f-b8b7-5bb18466e0a3-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd\" (UID: \"fd825172-7596-4f5f-b8b7-5bb18466e0a3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"
Aug 05 16:46:02.814758 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.814736    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"]
Aug 05 16:46:02.892071 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.891994    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"]
Aug 05 16:46:02.895518 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.895503    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"
Aug 05 16:46:02.905265 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.905246    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"]
Aug 05 16:46:02.913056 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.913032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c327347a-fd93-464b-a94d-1d7369b20952-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs\" (UID: \"c327347a-fd93-464b-a94d-1d7369b20952\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"
Aug 05 16:46:02.913194 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.913065    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzd8j\" (UniqueName: \"kubernetes.io/projected/fd825172-7596-4f5f-b8b7-5bb18466e0a3-kube-api-access-tzd8j\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd\" (UID: \"fd825172-7596-4f5f-b8b7-5bb18466e0a3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"
Aug 05 16:46:02.913194 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.913086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1905819-4164-41a5-adf1-cbec97417098-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6\" (UID: \"c1905819-4164-41a5-adf1-cbec97417098\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"
Aug 05 16:46:02.913194 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.913148    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1905819-4164-41a5-adf1-cbec97417098-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6\" (UID: \"c1905819-4164-41a5-adf1-cbec97417098\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"
Aug 05 16:46:02.913375 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.913283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd825172-7596-4f5f-b8b7-5bb18466e0a3-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd\" (UID: \"fd825172-7596-4f5f-b8b7-5bb18466e0a3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"
Aug 05 16:46:02.913375 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.913310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd825172-7596-4f5f-b8b7-5bb18466e0a3-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd\" (UID: \"fd825172-7596-4f5f-b8b7-5bb18466e0a3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"
Aug 05 16:46:02.913375 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.913347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxdng\" (UniqueName: \"kubernetes.io/projected/c1905819-4164-41a5-adf1-cbec97417098-kube-api-access-nxdng\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6\" (UID: \"c1905819-4164-41a5-adf1-cbec97417098\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"
Aug 05 16:46:02.913538 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.913378    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c327347a-fd93-464b-a94d-1d7369b20952-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs\" (UID: \"c327347a-fd93-464b-a94d-1d7369b20952\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"
Aug 05 16:46:02.913538 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.913472    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd6xn\" (UniqueName: \"kubernetes.io/projected/c327347a-fd93-464b-a94d-1d7369b20952-kube-api-access-bd6xn\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs\" (UID: \"c327347a-fd93-464b-a94d-1d7369b20952\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"
Aug 05 16:46:02.913649 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.913553    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd825172-7596-4f5f-b8b7-5bb18466e0a3-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd\" (UID: \"fd825172-7596-4f5f-b8b7-5bb18466e0a3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"
Aug 05 16:46:02.913649 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.913614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd825172-7596-4f5f-b8b7-5bb18466e0a3-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd\" (UID: \"fd825172-7596-4f5f-b8b7-5bb18466e0a3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"
Aug 05 16:46:02.925730 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.925707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzd8j\" (UniqueName: \"kubernetes.io/projected/fd825172-7596-4f5f-b8b7-5bb18466e0a3-kube-api-access-tzd8j\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd\" (UID: \"fd825172-7596-4f5f-b8b7-5bb18466e0a3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"
Aug 05 16:46:02.957652 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:02.957620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"
Aug 05 16:46:03.014590 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.014559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd6xn\" (UniqueName: \"kubernetes.io/projected/c327347a-fd93-464b-a94d-1d7369b20952-kube-api-access-bd6xn\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs\" (UID: \"c327347a-fd93-464b-a94d-1d7369b20952\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"
Aug 05 16:46:03.014735 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.014608    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c327347a-fd93-464b-a94d-1d7369b20952-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs\" (UID: \"c327347a-fd93-464b-a94d-1d7369b20952\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"
Aug 05 16:46:03.014735 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.014640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf6f7f35-f5a5-4059-b9af-947e7071e90c-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w\" (UID: \"cf6f7f35-f5a5-4059-b9af-947e7071e90c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"
Aug 05 16:46:03.014735 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.014671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgl8r\" (UniqueName: \"kubernetes.io/projected/cf6f7f35-f5a5-4059-b9af-947e7071e90c-kube-api-access-fgl8r\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w\" (UID: \"cf6f7f35-f5a5-4059-b9af-947e7071e90c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"
Aug 05 16:46:03.014735 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.014710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1905819-4164-41a5-adf1-cbec97417098-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6\" (UID: \"c1905819-4164-41a5-adf1-cbec97417098\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"
Aug 05 16:46:03.014947 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.014737    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1905819-4164-41a5-adf1-cbec97417098-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6\" (UID: \"c1905819-4164-41a5-adf1-cbec97417098\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"
Aug 05 16:46:03.014947 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.014773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf6f7f35-f5a5-4059-b9af-947e7071e90c-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w\" (UID: \"cf6f7f35-f5a5-4059-b9af-947e7071e90c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"
Aug 05 16:46:03.014947 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.014806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxdng\" (UniqueName: \"kubernetes.io/projected/c1905819-4164-41a5-adf1-cbec97417098-kube-api-access-nxdng\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6\" (UID: \"c1905819-4164-41a5-adf1-cbec97417098\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"
Aug 05 16:46:03.014947 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.014836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c327347a-fd93-464b-a94d-1d7369b20952-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs\" (UID: \"c327347a-fd93-464b-a94d-1d7369b20952\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"
Aug 05 16:46:03.015576 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.015307    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c327347a-fd93-464b-a94d-1d7369b20952-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs\" (UID: \"c327347a-fd93-464b-a94d-1d7369b20952\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"
Aug 05 16:46:03.015576 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.015331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1905819-4164-41a5-adf1-cbec97417098-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6\" (UID: \"c1905819-4164-41a5-adf1-cbec97417098\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"
Aug 05 16:46:03.015576 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.015530    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1905819-4164-41a5-adf1-cbec97417098-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6\" (UID: \"c1905819-4164-41a5-adf1-cbec97417098\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"
Aug 05 16:46:03.015730 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.015579    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c327347a-fd93-464b-a94d-1d7369b20952-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs\" (UID: \"c327347a-fd93-464b-a94d-1d7369b20952\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"
Aug 05 16:46:03.024783 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.024755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd6xn\" (UniqueName: \"kubernetes.io/projected/c327347a-fd93-464b-a94d-1d7369b20952-kube-api-access-bd6xn\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs\" (UID: \"c327347a-fd93-464b-a94d-1d7369b20952\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"
Aug 05 16:46:03.024885 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.024754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxdng\" (UniqueName: \"kubernetes.io/projected/c1905819-4164-41a5-adf1-cbec97417098-kube-api-access-nxdng\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6\" (UID: \"c1905819-4164-41a5-adf1-cbec97417098\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"
Aug 05 16:46:03.041406 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.041377    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"
Aug 05 16:46:03.091932 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.091899    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"]
Aug 05 16:46:03.093491 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:46:03.093453    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd825172_7596_4f5f_b8b7_5bb18466e0a3.slice/crio-b26a0d400e07c6965fac9e75c1dd9d4817bc1de152acfe73189e22fbe0014134 WatchSource:0}: Error finding container b26a0d400e07c6965fac9e75c1dd9d4817bc1de152acfe73189e22fbe0014134: Status 404 returned error can't find the container with id b26a0d400e07c6965fac9e75c1dd9d4817bc1de152acfe73189e22fbe0014134
Aug 05 16:46:03.111145 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.111118    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"
Aug 05 16:46:03.115229 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.115205    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf6f7f35-f5a5-4059-b9af-947e7071e90c-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w\" (UID: \"cf6f7f35-f5a5-4059-b9af-947e7071e90c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"
Aug 05 16:46:03.115330 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.115240    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgl8r\" (UniqueName: \"kubernetes.io/projected/cf6f7f35-f5a5-4059-b9af-947e7071e90c-kube-api-access-fgl8r\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w\" (UID: \"cf6f7f35-f5a5-4059-b9af-947e7071e90c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"
Aug 05 16:46:03.115330 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.115272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf6f7f35-f5a5-4059-b9af-947e7071e90c-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w\" (UID: \"cf6f7f35-f5a5-4059-b9af-947e7071e90c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"
Aug 05 16:46:03.115617 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.115597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf6f7f35-f5a5-4059-b9af-947e7071e90c-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w\" (UID: \"cf6f7f35-f5a5-4059-b9af-947e7071e90c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"
Aug 05 16:46:03.115693 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.115613    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf6f7f35-f5a5-4059-b9af-947e7071e90c-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w\" (UID: \"cf6f7f35-f5a5-4059-b9af-947e7071e90c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"
Aug 05 16:46:03.126084 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.126059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgl8r\" (UniqueName: \"kubernetes.io/projected/cf6f7f35-f5a5-4059-b9af-947e7071e90c-kube-api-access-fgl8r\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w\" (UID: \"cf6f7f35-f5a5-4059-b9af-947e7071e90c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"
Aug 05 16:46:03.190074 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.190043    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"]
Aug 05 16:46:03.192252 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:46:03.192222    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc327347a_fd93_464b_a94d_1d7369b20952.slice/crio-4f7cbbb27a40a5241276e563701f812fc7258e731f0516bad3cfeab22cf6de9d WatchSource:0}: Error finding container 4f7cbbb27a40a5241276e563701f812fc7258e731f0516bad3cfeab22cf6de9d: Status 404 returned error can't find the container with id 4f7cbbb27a40a5241276e563701f812fc7258e731f0516bad3cfeab22cf6de9d
Aug 05 16:46:03.204607 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.204481    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"
Aug 05 16:46:03.257723 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.257693    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"]
Aug 05 16:46:03.273155 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:46:03.273124    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1905819_4164_41a5_adf1_cbec97417098.slice/crio-76e18ff0debe537b67fbc9a071e02ec699c540910aa8236803cc931a080e29ab WatchSource:0}: Error finding container 76e18ff0debe537b67fbc9a071e02ec699c540910aa8236803cc931a080e29ab: Status 404 returned error can't find the container with id 76e18ff0debe537b67fbc9a071e02ec699c540910aa8236803cc931a080e29ab
Aug 05 16:46:03.352058 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.352025    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"]
Aug 05 16:46:03.411406 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:46:03.411324    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf6f7f35_f5a5_4059_b9af_947e7071e90c.slice/crio-bc15e107ab34f5d29dcf0d905e70f6372099e0411eae8993a5abc53c68e40b84 WatchSource:0}: Error finding container bc15e107ab34f5d29dcf0d905e70f6372099e0411eae8993a5abc53c68e40b84: Status 404 returned error can't find the container with id bc15e107ab34f5d29dcf0d905e70f6372099e0411eae8993a5abc53c68e40b84
Aug 05 16:46:03.568235 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.568201    2565 generic.go:356] "Generic (PLEG): container finished" podID="c1905819-4164-41a5-adf1-cbec97417098" containerID="fa73cf489a8c84a5eeaa20b4ccc5dd648fb16e7db3906165bc98e8139d97128b" exitCode=0
Aug 05 16:46:03.568418 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.568280    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6" event={"ID":"c1905819-4164-41a5-adf1-cbec97417098","Type":"ContainerDied","Data":"fa73cf489a8c84a5eeaa20b4ccc5dd648fb16e7db3906165bc98e8139d97128b"}
Aug 05 16:46:03.568418 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.568329    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6" event={"ID":"c1905819-4164-41a5-adf1-cbec97417098","Type":"ContainerStarted","Data":"76e18ff0debe537b67fbc9a071e02ec699c540910aa8236803cc931a080e29ab"}
Aug 05 16:46:03.569746 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.569714    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd825172-7596-4f5f-b8b7-5bb18466e0a3" containerID="10b744fea91e5d303c7f2f0a4767b0f7b1774ec25c6f73a889fcc334bc3bdfc6" exitCode=0
Aug 05 16:46:03.569818 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.569798    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd" event={"ID":"fd825172-7596-4f5f-b8b7-5bb18466e0a3","Type":"ContainerDied","Data":"10b744fea91e5d303c7f2f0a4767b0f7b1774ec25c6f73a889fcc334bc3bdfc6"}
Aug 05 16:46:03.569875 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.569842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd" event={"ID":"fd825172-7596-4f5f-b8b7-5bb18466e0a3","Type":"ContainerStarted","Data":"b26a0d400e07c6965fac9e75c1dd9d4817bc1de152acfe73189e22fbe0014134"}
Aug 05 16:46:03.571439 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.571419    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf6f7f35-f5a5-4059-b9af-947e7071e90c" containerID="33dc446d9908fba2af47a7bf7ffa695aadba40cac78c493e3d1a6985a374d538" exitCode=0
Aug 05 16:46:03.571548 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.571437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w" event={"ID":"cf6f7f35-f5a5-4059-b9af-947e7071e90c","Type":"ContainerDied","Data":"33dc446d9908fba2af47a7bf7ffa695aadba40cac78c493e3d1a6985a374d538"}
Aug 05 16:46:03.571548 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.571473    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w" event={"ID":"cf6f7f35-f5a5-4059-b9af-947e7071e90c","Type":"ContainerStarted","Data":"bc15e107ab34f5d29dcf0d905e70f6372099e0411eae8993a5abc53c68e40b84"}
Aug 05 16:46:03.573135 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.573115    2565 generic.go:356] "Generic (PLEG): container finished" podID="c327347a-fd93-464b-a94d-1d7369b20952" containerID="84f43c12b1f31db2226edfab79b839e04b817a2db82aaf9a85498c35956bdd07" exitCode=0
Aug 05 16:46:03.573214 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.573147    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs" event={"ID":"c327347a-fd93-464b-a94d-1d7369b20952","Type":"ContainerDied","Data":"84f43c12b1f31db2226edfab79b839e04b817a2db82aaf9a85498c35956bdd07"}
Aug 05 16:46:03.573214 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:03.573181    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs" event={"ID":"c327347a-fd93-464b-a94d-1d7369b20952","Type":"ContainerStarted","Data":"4f7cbbb27a40a5241276e563701f812fc7258e731f0516bad3cfeab22cf6de9d"}
Aug 05 16:46:04.579202 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:04.579173    2565 generic.go:356] "Generic (PLEG): container finished" podID="c327347a-fd93-464b-a94d-1d7369b20952" containerID="46062d2155bdefb1ac34f6f406125c114f0cef04a09775afe0e715acdd180a03" exitCode=0
Aug 05 16:46:04.579534 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:04.579254    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs" event={"ID":"c327347a-fd93-464b-a94d-1d7369b20952","Type":"ContainerDied","Data":"46062d2155bdefb1ac34f6f406125c114f0cef04a09775afe0e715acdd180a03"}
Aug 05 16:46:04.581008 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:04.580987    2565 generic.go:356] "Generic (PLEG): container finished" podID="c1905819-4164-41a5-adf1-cbec97417098" containerID="71938f81bce8f273a01401c53a4f517d0b1b3bcfb5c47f7233bf7b03bff70160" exitCode=0
Aug 05 16:46:04.581110 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:04.581050    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6" event={"ID":"c1905819-4164-41a5-adf1-cbec97417098","Type":"ContainerDied","Data":"71938f81bce8f273a01401c53a4f517d0b1b3bcfb5c47f7233bf7b03bff70160"}
Aug 05 16:46:05.590218 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:05.590188    2565 generic.go:356] "Generic (PLEG): container finished" podID="c1905819-4164-41a5-adf1-cbec97417098" containerID="f719fd6b73297e27e9548cb5b22abef34d1be83ced93c58d6a1148b52e6a02aa" exitCode=0
Aug 05 16:46:05.590666 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:05.590273    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6" event={"ID":"c1905819-4164-41a5-adf1-cbec97417098","Type":"ContainerDied","Data":"f719fd6b73297e27e9548cb5b22abef34d1be83ced93c58d6a1148b52e6a02aa"}
Aug 05 16:46:05.591921 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:05.591900    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd825172-7596-4f5f-b8b7-5bb18466e0a3" containerID="171c85feff03b2e5fb18cf36046edc5c3cd6748f6559b074117c382623aa4549" exitCode=0
Aug 05 16:46:05.592006 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:05.591982    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd" event={"ID":"fd825172-7596-4f5f-b8b7-5bb18466e0a3","Type":"ContainerDied","Data":"171c85feff03b2e5fb18cf36046edc5c3cd6748f6559b074117c382623aa4549"}
Aug 05 16:46:05.593700 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:05.593678    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf6f7f35-f5a5-4059-b9af-947e7071e90c" containerID="e7209951ebe7ca3ff479e4e633fcac66b0a955971614ffed2ed4131205196f74" exitCode=0
Aug 05 16:46:05.593755 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:05.593707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w" event={"ID":"cf6f7f35-f5a5-4059-b9af-947e7071e90c","Type":"ContainerDied","Data":"e7209951ebe7ca3ff479e4e633fcac66b0a955971614ffed2ed4131205196f74"}
Aug 05 16:46:05.595814 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:05.595794    2565 generic.go:356] "Generic (PLEG): container finished" podID="c327347a-fd93-464b-a94d-1d7369b20952" containerID="0ff59adfc1b8943ea66f1a10d6ffdb368bb8bed3de13a079b5630a85d930c708" exitCode=0
Aug 05 16:46:05.595885 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:05.595850    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs" event={"ID":"c327347a-fd93-464b-a94d-1d7369b20952","Type":"ContainerDied","Data":"0ff59adfc1b8943ea66f1a10d6ffdb368bb8bed3de13a079b5630a85d930c708"}
Aug 05 16:46:06.602410 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.602375    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd825172-7596-4f5f-b8b7-5bb18466e0a3" containerID="543838439fbee4a16c1036166e84400180b671776b080430c907ce39d336d021" exitCode=0
Aug 05 16:46:06.602783 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.602460    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd" event={"ID":"fd825172-7596-4f5f-b8b7-5bb18466e0a3","Type":"ContainerDied","Data":"543838439fbee4a16c1036166e84400180b671776b080430c907ce39d336d021"}
Aug 05 16:46:06.604393 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.604364    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf6f7f35-f5a5-4059-b9af-947e7071e90c" containerID="efc84a722c8fb063fcd86074c42ad3e6e6cff3d274f58c596e3c827d184fe398" exitCode=0
Aug 05 16:46:06.604516 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.604426    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w" event={"ID":"cf6f7f35-f5a5-4059-b9af-947e7071e90c","Type":"ContainerDied","Data":"efc84a722c8fb063fcd86074c42ad3e6e6cff3d274f58c596e3c827d184fe398"}
Aug 05 16:46:06.739575 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.739546    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"
Aug 05 16:46:06.771691 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.771665    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"
Aug 05 16:46:06.847601 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.847564    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd6xn\" (UniqueName: \"kubernetes.io/projected/c327347a-fd93-464b-a94d-1d7369b20952-kube-api-access-bd6xn\") pod \"c327347a-fd93-464b-a94d-1d7369b20952\" (UID: \"c327347a-fd93-464b-a94d-1d7369b20952\") "
Aug 05 16:46:06.847807 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.847616    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c327347a-fd93-464b-a94d-1d7369b20952-bundle\") pod \"c327347a-fd93-464b-a94d-1d7369b20952\" (UID: \"c327347a-fd93-464b-a94d-1d7369b20952\") "
Aug 05 16:46:06.847807 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.847731    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c327347a-fd93-464b-a94d-1d7369b20952-util\") pod \"c327347a-fd93-464b-a94d-1d7369b20952\" (UID: \"c327347a-fd93-464b-a94d-1d7369b20952\") "
Aug 05 16:46:06.848340 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.848316    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c327347a-fd93-464b-a94d-1d7369b20952-bundle" (OuterVolumeSpecName: "bundle") pod "c327347a-fd93-464b-a94d-1d7369b20952" (UID: "c327347a-fd93-464b-a94d-1d7369b20952"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:46:06.849662 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.849633    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c327347a-fd93-464b-a94d-1d7369b20952-kube-api-access-bd6xn" (OuterVolumeSpecName: "kube-api-access-bd6xn") pod "c327347a-fd93-464b-a94d-1d7369b20952" (UID: "c327347a-fd93-464b-a94d-1d7369b20952"). InnerVolumeSpecName "kube-api-access-bd6xn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:46:06.852878 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.852831    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c327347a-fd93-464b-a94d-1d7369b20952-util" (OuterVolumeSpecName: "util") pod "c327347a-fd93-464b-a94d-1d7369b20952" (UID: "c327347a-fd93-464b-a94d-1d7369b20952"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:46:06.948964 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.948930    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxdng\" (UniqueName: \"kubernetes.io/projected/c1905819-4164-41a5-adf1-cbec97417098-kube-api-access-nxdng\") pod \"c1905819-4164-41a5-adf1-cbec97417098\" (UID: \"c1905819-4164-41a5-adf1-cbec97417098\") "
Aug 05 16:46:06.949137 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.948985    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1905819-4164-41a5-adf1-cbec97417098-util\") pod \"c1905819-4164-41a5-adf1-cbec97417098\" (UID: \"c1905819-4164-41a5-adf1-cbec97417098\") "
Aug 05 16:46:06.949137 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.949125    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1905819-4164-41a5-adf1-cbec97417098-bundle\") pod \"c1905819-4164-41a5-adf1-cbec97417098\" (UID: \"c1905819-4164-41a5-adf1-cbec97417098\") "
Aug 05 16:46:06.949350 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.949331    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c327347a-fd93-464b-a94d-1d7369b20952-util\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:06.949413 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.949355    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd6xn\" (UniqueName: \"kubernetes.io/projected/c327347a-fd93-464b-a94d-1d7369b20952-kube-api-access-bd6xn\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:06.949413 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.949370    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c327347a-fd93-464b-a94d-1d7369b20952-bundle\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:06.949505 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.949482    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1905819-4164-41a5-adf1-cbec97417098-bundle" (OuterVolumeSpecName: "bundle") pod "c1905819-4164-41a5-adf1-cbec97417098" (UID: "c1905819-4164-41a5-adf1-cbec97417098"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:46:06.951023 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.951003    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1905819-4164-41a5-adf1-cbec97417098-kube-api-access-nxdng" (OuterVolumeSpecName: "kube-api-access-nxdng") pod "c1905819-4164-41a5-adf1-cbec97417098" (UID: "c1905819-4164-41a5-adf1-cbec97417098"). InnerVolumeSpecName "kube-api-access-nxdng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:46:06.957080 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:06.957055    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1905819-4164-41a5-adf1-cbec97417098-util" (OuterVolumeSpecName: "util") pod "c1905819-4164-41a5-adf1-cbec97417098" (UID: "c1905819-4164-41a5-adf1-cbec97417098"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:46:07.050567 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.050527    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxdng\" (UniqueName: \"kubernetes.io/projected/c1905819-4164-41a5-adf1-cbec97417098-kube-api-access-nxdng\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:07.050567 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.050559    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1905819-4164-41a5-adf1-cbec97417098-util\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:07.050567 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.050571    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1905819-4164-41a5-adf1-cbec97417098-bundle\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:07.610274 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.610241    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6"
Aug 05 16:46:07.610274 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.610263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a04pnb6" event={"ID":"c1905819-4164-41a5-adf1-cbec97417098","Type":"ContainerDied","Data":"76e18ff0debe537b67fbc9a071e02ec699c540910aa8236803cc931a080e29ab"}
Aug 05 16:46:07.610766 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.610316    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76e18ff0debe537b67fbc9a071e02ec699c540910aa8236803cc931a080e29ab"
Aug 05 16:46:07.612164 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.612141    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs"
Aug 05 16:46:07.612265 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.612093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053k4cqs" event={"ID":"c327347a-fd93-464b-a94d-1d7369b20952","Type":"ContainerDied","Data":"4f7cbbb27a40a5241276e563701f812fc7258e731f0516bad3cfeab22cf6de9d"}
Aug 05 16:46:07.612265 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.612215    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f7cbbb27a40a5241276e563701f812fc7258e731f0516bad3cfeab22cf6de9d"
Aug 05 16:46:07.781743 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.781719    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"
Aug 05 16:46:07.783709 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.783692    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"
Aug 05 16:46:07.958223 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.958151    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf6f7f35-f5a5-4059-b9af-947e7071e90c-bundle\") pod \"cf6f7f35-f5a5-4059-b9af-947e7071e90c\" (UID: \"cf6f7f35-f5a5-4059-b9af-947e7071e90c\") "
Aug 05 16:46:07.958223 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.958198    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzd8j\" (UniqueName: \"kubernetes.io/projected/fd825172-7596-4f5f-b8b7-5bb18466e0a3-kube-api-access-tzd8j\") pod \"fd825172-7596-4f5f-b8b7-5bb18466e0a3\" (UID: \"fd825172-7596-4f5f-b8b7-5bb18466e0a3\") "
Aug 05 16:46:07.958223 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.958222    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd825172-7596-4f5f-b8b7-5bb18466e0a3-bundle\") pod \"fd825172-7596-4f5f-b8b7-5bb18466e0a3\" (UID: \"fd825172-7596-4f5f-b8b7-5bb18466e0a3\") "
Aug 05 16:46:07.958478 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.958254    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgl8r\" (UniqueName: \"kubernetes.io/projected/cf6f7f35-f5a5-4059-b9af-947e7071e90c-kube-api-access-fgl8r\") pod \"cf6f7f35-f5a5-4059-b9af-947e7071e90c\" (UID: \"cf6f7f35-f5a5-4059-b9af-947e7071e90c\") "
Aug 05 16:46:07.958478 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.958272    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf6f7f35-f5a5-4059-b9af-947e7071e90c-util\") pod \"cf6f7f35-f5a5-4059-b9af-947e7071e90c\" (UID: \"cf6f7f35-f5a5-4059-b9af-947e7071e90c\") "
Aug 05 16:46:07.958478 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.958313    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd825172-7596-4f5f-b8b7-5bb18466e0a3-util\") pod \"fd825172-7596-4f5f-b8b7-5bb18466e0a3\" (UID: \"fd825172-7596-4f5f-b8b7-5bb18466e0a3\") "
Aug 05 16:46:07.958684 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.958658    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6f7f35-f5a5-4059-b9af-947e7071e90c-bundle" (OuterVolumeSpecName: "bundle") pod "cf6f7f35-f5a5-4059-b9af-947e7071e90c" (UID: "cf6f7f35-f5a5-4059-b9af-947e7071e90c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:46:07.958873 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.958844    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd825172-7596-4f5f-b8b7-5bb18466e0a3-bundle" (OuterVolumeSpecName: "bundle") pod "fd825172-7596-4f5f-b8b7-5bb18466e0a3" (UID: "fd825172-7596-4f5f-b8b7-5bb18466e0a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:46:07.960454 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.960431    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6f7f35-f5a5-4059-b9af-947e7071e90c-kube-api-access-fgl8r" (OuterVolumeSpecName: "kube-api-access-fgl8r") pod "cf6f7f35-f5a5-4059-b9af-947e7071e90c" (UID: "cf6f7f35-f5a5-4059-b9af-947e7071e90c"). InnerVolumeSpecName "kube-api-access-fgl8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:46:07.960679 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.960661    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd825172-7596-4f5f-b8b7-5bb18466e0a3-kube-api-access-tzd8j" (OuterVolumeSpecName: "kube-api-access-tzd8j") pod "fd825172-7596-4f5f-b8b7-5bb18466e0a3" (UID: "fd825172-7596-4f5f-b8b7-5bb18466e0a3"). InnerVolumeSpecName "kube-api-access-tzd8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:46:07.964794 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.964765    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6f7f35-f5a5-4059-b9af-947e7071e90c-util" (OuterVolumeSpecName: "util") pod "cf6f7f35-f5a5-4059-b9af-947e7071e90c" (UID: "cf6f7f35-f5a5-4059-b9af-947e7071e90c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:46:07.967333 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:07.967288    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd825172-7596-4f5f-b8b7-5bb18466e0a3-util" (OuterVolumeSpecName: "util") pod "fd825172-7596-4f5f-b8b7-5bb18466e0a3" (UID: "fd825172-7596-4f5f-b8b7-5bb18466e0a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:46:08.059167 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:08.059131    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf6f7f35-f5a5-4059-b9af-947e7071e90c-bundle\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:08.059167 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:08.059163    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzd8j\" (UniqueName: \"kubernetes.io/projected/fd825172-7596-4f5f-b8b7-5bb18466e0a3-kube-api-access-tzd8j\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:08.059167 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:08.059175    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd825172-7596-4f5f-b8b7-5bb18466e0a3-bundle\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:08.059391 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:08.059184    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgl8r\" (UniqueName: \"kubernetes.io/projected/cf6f7f35-f5a5-4059-b9af-947e7071e90c-kube-api-access-fgl8r\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:08.059391 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:08.059193    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf6f7f35-f5a5-4059-b9af-947e7071e90c-util\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:08.059391 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:08.059201    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd825172-7596-4f5f-b8b7-5bb18466e0a3-util\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:08.617988 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:08.617959    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd"
Aug 05 16:46:08.618482 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:08.617964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbfh9jd" event={"ID":"fd825172-7596-4f5f-b8b7-5bb18466e0a3","Type":"ContainerDied","Data":"b26a0d400e07c6965fac9e75c1dd9d4817bc1de152acfe73189e22fbe0014134"}
Aug 05 16:46:08.618482 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:08.618127    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b26a0d400e07c6965fac9e75c1dd9d4817bc1de152acfe73189e22fbe0014134"
Aug 05 16:46:08.619737 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:08.619717    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w" event={"ID":"cf6f7f35-f5a5-4059-b9af-947e7071e90c","Type":"ContainerDied","Data":"bc15e107ab34f5d29dcf0d905e70f6372099e0411eae8993a5abc53c68e40b84"}
Aug 05 16:46:08.619737 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:08.619739    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cw8l8w"
Aug 05 16:46:08.619930 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:08.619750    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc15e107ab34f5d29dcf0d905e70f6372099e0411eae8993a5abc53c68e40b84"
Aug 05 16:46:14.669873 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.669799    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-bwsr4"]
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670064    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1905819-4164-41a5-adf1-cbec97417098" containerName="pull"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670075    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1905819-4164-41a5-adf1-cbec97417098" containerName="pull"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670083    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6f7f35-f5a5-4059-b9af-947e7071e90c" containerName="extract"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670088    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6f7f35-f5a5-4059-b9af-947e7071e90c" containerName="extract"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670109    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c327347a-fd93-464b-a94d-1d7369b20952" containerName="pull"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670115    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c327347a-fd93-464b-a94d-1d7369b20952" containerName="pull"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670125    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd825172-7596-4f5f-b8b7-5bb18466e0a3" containerName="pull"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670130    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd825172-7596-4f5f-b8b7-5bb18466e0a3" containerName="pull"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670138    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd825172-7596-4f5f-b8b7-5bb18466e0a3" containerName="util"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670143    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd825172-7596-4f5f-b8b7-5bb18466e0a3" containerName="util"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670151    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6f7f35-f5a5-4059-b9af-947e7071e90c" containerName="util"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670156    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6f7f35-f5a5-4059-b9af-947e7071e90c" containerName="util"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670164    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6f7f35-f5a5-4059-b9af-947e7071e90c" containerName="pull"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670169    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6f7f35-f5a5-4059-b9af-947e7071e90c" containerName="pull"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670174    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd825172-7596-4f5f-b8b7-5bb18466e0a3" containerName="extract"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670178    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd825172-7596-4f5f-b8b7-5bb18466e0a3" containerName="extract"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670185    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c327347a-fd93-464b-a94d-1d7369b20952" containerName="util"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670190    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c327347a-fd93-464b-a94d-1d7369b20952" containerName="util"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670196    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c327347a-fd93-464b-a94d-1d7369b20952" containerName="extract"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670201    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c327347a-fd93-464b-a94d-1d7369b20952" containerName="extract"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670209    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1905819-4164-41a5-adf1-cbec97417098" containerName="extract"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670215    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1905819-4164-41a5-adf1-cbec97417098" containerName="extract"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670220    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1905819-4164-41a5-adf1-cbec97417098" containerName="util"
Aug 05 16:46:14.670231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670225    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1905819-4164-41a5-adf1-cbec97417098" containerName="util"
Aug 05 16:46:14.670948 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670267    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c327347a-fd93-464b-a94d-1d7369b20952" containerName="extract"
Aug 05 16:46:14.670948 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670274    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1905819-4164-41a5-adf1-cbec97417098" containerName="extract"
Aug 05 16:46:14.670948 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670279    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd825172-7596-4f5f-b8b7-5bb18466e0a3" containerName="extract"
Aug 05 16:46:14.670948 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.670283    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6f7f35-f5a5-4059-b9af-947e7071e90c" containerName="extract"
Aug 05 16:46:14.673060 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.673044    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-bwsr4"
Aug 05 16:46:14.677025 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.676996    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 05 16:46:14.677177 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.677151    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 05 16:46:14.677246 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.677233    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5qkv9\""
Aug 05 16:46:14.677889 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.677869    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Aug 05 16:46:14.697468 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.697441    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-bwsr4"]
Aug 05 16:46:14.706313 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.706286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dgxq\" (UniqueName: \"kubernetes.io/projected/63f7f563-275c-4c42-890b-31e5fc3ed06b-kube-api-access-8dgxq\") pod \"dns-operator-controller-manager-5985564776-bwsr4\" (UID: \"63f7f563-275c-4c42-890b-31e5fc3ed06b\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-bwsr4"
Aug 05 16:46:14.806959 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.806926    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dgxq\" (UniqueName: \"kubernetes.io/projected/63f7f563-275c-4c42-890b-31e5fc3ed06b-kube-api-access-8dgxq\") pod \"dns-operator-controller-manager-5985564776-bwsr4\" (UID: \"63f7f563-275c-4c42-890b-31e5fc3ed06b\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-bwsr4"
Aug 05 16:46:14.820892 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.820862    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dgxq\" (UniqueName: \"kubernetes.io/projected/63f7f563-275c-4c42-890b-31e5fc3ed06b-kube-api-access-8dgxq\") pod \"dns-operator-controller-manager-5985564776-bwsr4\" (UID: \"63f7f563-275c-4c42-890b-31e5fc3ed06b\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-bwsr4"
Aug 05 16:46:14.983242 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:14.983146    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-bwsr4"
Aug 05 16:46:15.122240 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:15.122210    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-bwsr4"]
Aug 05 16:46:15.124837 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:46:15.124808    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f7f563_275c_4c42_890b_31e5fc3ed06b.slice/crio-d0ac5d520b7cf7df2fc99a0bd8d8c0eda6b219d3905c1b88283fb82ecf77599f WatchSource:0}: Error finding container d0ac5d520b7cf7df2fc99a0bd8d8c0eda6b219d3905c1b88283fb82ecf77599f: Status 404 returned error can't find the container with id d0ac5d520b7cf7df2fc99a0bd8d8c0eda6b219d3905c1b88283fb82ecf77599f
Aug 05 16:46:15.654891 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:15.654854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-bwsr4" event={"ID":"63f7f563-275c-4c42-890b-31e5fc3ed06b","Type":"ContainerStarted","Data":"d0ac5d520b7cf7df2fc99a0bd8d8c0eda6b219d3905c1b88283fb82ecf77599f"}
Aug 05 16:46:16.632749 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:16.632712    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"]
Aug 05 16:46:16.637220 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:16.637198    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"
Aug 05 16:46:16.640185 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:16.640165    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fmfgq\""
Aug 05 16:46:16.646887 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:16.646862    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"]
Aug 05 16:46:16.722451 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:16.722410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfqsr\" (UniqueName: \"kubernetes.io/projected/3f065bd4-81d1-4f55-a3f0-c7de237a8c3b-kube-api-access-dfqsr\") pod \"limitador-operator-controller-manager-6c549b6d85-fz6xw\" (UID: \"3f065bd4-81d1-4f55-a3f0-c7de237a8c3b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"
Aug 05 16:46:16.823840 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:16.823803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfqsr\" (UniqueName: \"kubernetes.io/projected/3f065bd4-81d1-4f55-a3f0-c7de237a8c3b-kube-api-access-dfqsr\") pod \"limitador-operator-controller-manager-6c549b6d85-fz6xw\" (UID: \"3f065bd4-81d1-4f55-a3f0-c7de237a8c3b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"
Aug 05 16:46:16.835014 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:16.834979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfqsr\" (UniqueName: \"kubernetes.io/projected/3f065bd4-81d1-4f55-a3f0-c7de237a8c3b-kube-api-access-dfqsr\") pod \"limitador-operator-controller-manager-6c549b6d85-fz6xw\" (UID: \"3f065bd4-81d1-4f55-a3f0-c7de237a8c3b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"
Aug 05 16:46:16.947704 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:16.947618    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"
Aug 05 16:46:17.123314 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:17.123288    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"]
Aug 05 16:46:17.124472 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:46:17.124444    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f065bd4_81d1_4f55_a3f0_c7de237a8c3b.slice/crio-77de1342f8569d9b626fe57e357ed08633758384406a6b641a16ce93040b350e WatchSource:0}: Error finding container 77de1342f8569d9b626fe57e357ed08633758384406a6b641a16ce93040b350e: Status 404 returned error can't find the container with id 77de1342f8569d9b626fe57e357ed08633758384406a6b641a16ce93040b350e
Aug 05 16:46:17.666187 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:17.666154    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw" event={"ID":"3f065bd4-81d1-4f55-a3f0-c7de237a8c3b","Type":"ContainerStarted","Data":"77de1342f8569d9b626fe57e357ed08633758384406a6b641a16ce93040b350e"}
Aug 05 16:46:19.668214 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:19.668187    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-zndpx"]
Aug 05 16:46:19.671318 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:19.671303    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-zndpx"
Aug 05 16:46:19.675347 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:19.675330    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4bbmz\""
Aug 05 16:46:19.677867 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:19.677842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw" event={"ID":"3f065bd4-81d1-4f55-a3f0-c7de237a8c3b","Type":"ContainerStarted","Data":"5b42525fc1d69ae797fc9adb97c8ae0088f267042ac3283f13c71b6c700ee942"}
Aug 05 16:46:19.678000 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:19.677980    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"
Aug 05 16:46:19.688004 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:19.687977    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-zndpx"]
Aug 05 16:46:19.742708 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:19.742674    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgmhb\" (UniqueName: \"kubernetes.io/projected/b1c517e7-78c8-414d-aa70-0e75c6445b21-kube-api-access-tgmhb\") pod \"authorino-operator-68d88948d8-zndpx\" (UID: \"b1c517e7-78c8-414d-aa70-0e75c6445b21\") " pod="kuadrant-system/authorino-operator-68d88948d8-zndpx"
Aug 05 16:46:19.766054 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:19.766000    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw" podStartSLOduration=1.300739484 podStartE2EDuration="3.765983007s" totalImagesPullingTime="2.465243523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:46:19.764291918 +0000 UTC m=+452.346363576" watchObservedRunningTime="2026-08-05 16:46:19.765983007 +0000 UTC m=+452.348054662"
Aug 05 16:46:19.843863 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:19.843788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgmhb\" (UniqueName: \"kubernetes.io/projected/b1c517e7-78c8-414d-aa70-0e75c6445b21-kube-api-access-tgmhb\") pod \"authorino-operator-68d88948d8-zndpx\" (UID: \"b1c517e7-78c8-414d-aa70-0e75c6445b21\") " pod="kuadrant-system/authorino-operator-68d88948d8-zndpx"
Aug 05 16:46:19.871092 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:19.871059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgmhb\" (UniqueName: \"kubernetes.io/projected/b1c517e7-78c8-414d-aa70-0e75c6445b21-kube-api-access-tgmhb\") pod \"authorino-operator-68d88948d8-zndpx\" (UID: \"b1c517e7-78c8-414d-aa70-0e75c6445b21\") " pod="kuadrant-system/authorino-operator-68d88948d8-zndpx"
Aug 05 16:46:19.981579 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:19.981545    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-zndpx"
Aug 05 16:46:20.112154 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:20.112128    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-zndpx"]
Aug 05 16:46:20.114169 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:46:20.114142    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c517e7_78c8_414d_aa70_0e75c6445b21.slice/crio-ee62b8636160110d9beada69701edcc53d8e9c00b37c7a24d067335b9bbcacea WatchSource:0}: Error finding container ee62b8636160110d9beada69701edcc53d8e9c00b37c7a24d067335b9bbcacea: Status 404 returned error can't find the container with id ee62b8636160110d9beada69701edcc53d8e9c00b37c7a24d067335b9bbcacea
Aug 05 16:46:20.684193 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:20.684160    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-zndpx" event={"ID":"b1c517e7-78c8-414d-aa70-0e75c6445b21","Type":"ContainerStarted","Data":"ee62b8636160110d9beada69701edcc53d8e9c00b37c7a24d067335b9bbcacea"}
Aug 05 16:46:22.697171 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:22.697137    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-zndpx" event={"ID":"b1c517e7-78c8-414d-aa70-0e75c6445b21","Type":"ContainerStarted","Data":"8e1e62212a2d2a505fb93a03adc1475cdd1e9997c471364488be0fbb6a6fb164"}
Aug 05 16:46:22.697559 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:22.697269    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-zndpx"
Aug 05 16:46:22.721606 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:22.721554    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-zndpx" podStartSLOduration=2.19808205 podStartE2EDuration="3.721539017s" totalImagesPullingTime="1.523456967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:46:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:46:22.719552627 +0000 UTC m=+455.301624293" watchObservedRunningTime="2026-08-05 16:46:22.721539017 +0000 UTC m=+455.303610674"
Aug 05 16:46:23.888775 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:23.888737    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"]
Aug 05 16:46:23.891990 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:23.891973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:23.895500 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:23.895478    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-69w5h\""
Aug 05 16:46:23.906511 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:23.906489    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"]
Aug 05 16:46:24.075376 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:24.075334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7492c523-3ce4-48f1-b66a-ec0c48d089b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-m2jjp\" (UID: \"7492c523-3ce4-48f1-b66a-ec0c48d089b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:24.075554 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:24.075455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjxk9\" (UniqueName: \"kubernetes.io/projected/7492c523-3ce4-48f1-b66a-ec0c48d089b5-kube-api-access-gjxk9\") pod \"kuadrant-operator-controller-manager-58fc56757c-m2jjp\" (UID: \"7492c523-3ce4-48f1-b66a-ec0c48d089b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:24.176796 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:24.176707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7492c523-3ce4-48f1-b66a-ec0c48d089b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-m2jjp\" (UID: \"7492c523-3ce4-48f1-b66a-ec0c48d089b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:24.176796 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:24.176773    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjxk9\" (UniqueName: \"kubernetes.io/projected/7492c523-3ce4-48f1-b66a-ec0c48d089b5-kube-api-access-gjxk9\") pod \"kuadrant-operator-controller-manager-58fc56757c-m2jjp\" (UID: \"7492c523-3ce4-48f1-b66a-ec0c48d089b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:24.177164 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:24.177137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7492c523-3ce4-48f1-b66a-ec0c48d089b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-m2jjp\" (UID: \"7492c523-3ce4-48f1-b66a-ec0c48d089b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:24.193062 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:24.193040    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjxk9\" (UniqueName: \"kubernetes.io/projected/7492c523-3ce4-48f1-b66a-ec0c48d089b5-kube-api-access-gjxk9\") pod \"kuadrant-operator-controller-manager-58fc56757c-m2jjp\" (UID: \"7492c523-3ce4-48f1-b66a-ec0c48d089b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:24.201818 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:24.201794    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:24.339759 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:24.339732    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"]
Aug 05 16:46:24.342157 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:46:24.342132    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7492c523_3ce4_48f1_b66a_ec0c48d089b5.slice/crio-58b8719b03ed4c01f2abae7f084d73f21b1ce849c2feb8c4bdff626feba1b6fa WatchSource:0}: Error finding container 58b8719b03ed4c01f2abae7f084d73f21b1ce849c2feb8c4bdff626feba1b6fa: Status 404 returned error can't find the container with id 58b8719b03ed4c01f2abae7f084d73f21b1ce849c2feb8c4bdff626feba1b6fa
Aug 05 16:46:24.708116 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:24.708062    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp" event={"ID":"7492c523-3ce4-48f1-b66a-ec0c48d089b5","Type":"ContainerStarted","Data":"58b8719b03ed4c01f2abae7f084d73f21b1ce849c2feb8c4bdff626feba1b6fa"}
Aug 05 16:46:28.737677 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:28.737640    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp" event={"ID":"7492c523-3ce4-48f1-b66a-ec0c48d089b5","Type":"ContainerStarted","Data":"01593b2e962b39570095ab6d0a59a7ebd2b9589a2ecb03c1a16686144c532dc5"}
Aug 05 16:46:28.738154 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:28.737712    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:28.762785 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:28.762724    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp" podStartSLOduration=2.1422207699999998 podStartE2EDuration="5.762703179s" totalImagesPullingTime="3.620482409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:46:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:46:28.761470737 +0000 UTC m=+461.343542394" watchObservedRunningTime="2026-08-05 16:46:28.762703179 +0000 UTC m=+461.344774837"
Aug 05 16:46:29.745510 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:29.745411    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-bwsr4" event={"ID":"63f7f563-275c-4c42-890b-31e5fc3ed06b","Type":"ContainerStarted","Data":"2be65cb65972ffbae88fda7162c0af6ebe9375a963962e68643d74d8c3281059"}
Aug 05 16:46:29.745881 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:29.745681    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-bwsr4"
Aug 05 16:46:29.765872 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:29.765817    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-bwsr4" podStartSLOduration=1.562080237 podStartE2EDuration="15.765801011s" totalImagesPullingTime="14.203720774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:46:29.764582942 +0000 UTC m=+462.346654599" watchObservedRunningTime="2026-08-05 16:46:29.765801011 +0000 UTC m=+462.347872666"
Aug 05 16:46:30.687002 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:30.686973    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"
Aug 05 16:46:33.704880 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:33.704847    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-zndpx"
Aug 05 16:46:39.747612 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:39.747573    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:40.753252 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:40.753217    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-bwsr4"
Aug 05 16:46:41.956064 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:41.956027    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"]
Aug 05 16:46:41.956555 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:41.956269    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp" podUID="7492c523-3ce4-48f1-b66a-ec0c48d089b5" containerName="manager" containerID="cri-o://01593b2e962b39570095ab6d0a59a7ebd2b9589a2ecb03c1a16686144c532dc5" gracePeriod=2
Aug 05 16:46:41.973045 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:41.973015    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"]
Aug 05 16:46:41.984199 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:46:41.984155    2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"7492c523-3ce4-48f1-b66a-ec0c48d089b5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-m2jjp\": pods \"kuadrant-operator-controller-manager-58fc56757c-m2jjp\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:42.027162 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.027127    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"]
Aug 05 16:46:42.027476 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.027431    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw" podUID="3f065bd4-81d1-4f55-a3f0-c7de237a8c3b" containerName="manager" containerID="cri-o://5b42525fc1d69ae797fc9adb97c8ae0088f267042ac3283f13c71b6c700ee942" gracePeriod=2
Aug 05 16:46:42.067202 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:46:42.067151    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-m2jjp\" is forbidden: User \"system:node:ip-10-0-138-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-233.ec2.internal' and this object" podUID="7492c523-3ce4-48f1-b66a-ec0c48d089b5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:42.067921 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.067886    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"]
Aug 05 16:46:42.069860 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.069835    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"]
Aug 05 16:46:42.070298 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.070281    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7492c523-3ce4-48f1-b66a-ec0c48d089b5" containerName="manager"
Aug 05 16:46:42.070375 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.070300    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7492c523-3ce4-48f1-b66a-ec0c48d089b5" containerName="manager"
Aug 05 16:46:42.070375 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.070329    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f065bd4-81d1-4f55-a3f0-c7de237a8c3b" containerName="manager"
Aug 05 16:46:42.070375 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.070338    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f065bd4-81d1-4f55-a3f0-c7de237a8c3b" containerName="manager"
Aug 05 16:46:42.070491 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.070408    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7492c523-3ce4-48f1-b66a-ec0c48d089b5" containerName="manager"
Aug 05 16:46:42.070491 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.070418    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f065bd4-81d1-4f55-a3f0-c7de237a8c3b" containerName="manager"
Aug 05 16:46:42.091594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.091558    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"]
Aug 05 16:46:42.091751 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.091710    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"
Aug 05 16:46:42.094477 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:46:42.094441    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-m2jjp\" is forbidden: User \"system:node:ip-10-0-138-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-233.ec2.internal' and this object" podUID="7492c523-3ce4-48f1-b66a-ec0c48d089b5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:42.105052 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.104976    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c80e93de-485c-48a0-8288-93957a32d862-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-8bjlk\" (UID: \"c80e93de-485c-48a0-8288-93957a32d862\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"
Aug 05 16:46:42.105052 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.105024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwpxc\" (UniqueName: \"kubernetes.io/projected/c80e93de-485c-48a0-8288-93957a32d862-kube-api-access-xwpxc\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-8bjlk\" (UID: \"c80e93de-485c-48a0-8288-93957a32d862\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"
Aug 05 16:46:42.107530 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.107506    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"]
Aug 05 16:46:42.107629 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.107613    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"
Aug 05 16:46:42.118865 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.118838    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"]
Aug 05 16:46:42.168235 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:46:42.168198    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-m2jjp\" is forbidden: User \"system:node:ip-10-0-138-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-233.ec2.internal' and this object" podUID="7492c523-3ce4-48f1-b66a-ec0c48d089b5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:42.205451 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.205395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e77c21-97f6-4b67-9c31-abba97d476f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-b475n\" (UID: \"47e77c21-97f6-4b67-9c31-abba97d476f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"
Aug 05 16:46:42.205594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.205455    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c80e93de-485c-48a0-8288-93957a32d862-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-8bjlk\" (UID: \"c80e93de-485c-48a0-8288-93957a32d862\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"
Aug 05 16:46:42.205642 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.205588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwpxc\" (UniqueName: \"kubernetes.io/projected/c80e93de-485c-48a0-8288-93957a32d862-kube-api-access-xwpxc\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-8bjlk\" (UID: \"c80e93de-485c-48a0-8288-93957a32d862\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"
Aug 05 16:46:42.205642 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.205618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm6cr\" (UniqueName: \"kubernetes.io/projected/47e77c21-97f6-4b67-9c31-abba97d476f4-kube-api-access-vm6cr\") pod \"kuadrant-operator-controller-manager-58fc56757c-b475n\" (UID: \"47e77c21-97f6-4b67-9c31-abba97d476f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"
Aug 05 16:46:42.205944 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.205911    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c80e93de-485c-48a0-8288-93957a32d862-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-8bjlk\" (UID: \"c80e93de-485c-48a0-8288-93957a32d862\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"
Aug 05 16:46:42.218417 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.218390    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwpxc\" (UniqueName: \"kubernetes.io/projected/c80e93de-485c-48a0-8288-93957a32d862-kube-api-access-xwpxc\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-8bjlk\" (UID: \"c80e93de-485c-48a0-8288-93957a32d862\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"
Aug 05 16:46:42.299800 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.299763    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:42.302362 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:46:42.302338    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-m2jjp\" is forbidden: User \"system:node:ip-10-0-138-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-233.ec2.internal' and this object" podUID="7492c523-3ce4-48f1-b66a-ec0c48d089b5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:42.306692 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.306674    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjxk9\" (UniqueName: \"kubernetes.io/projected/7492c523-3ce4-48f1-b66a-ec0c48d089b5-kube-api-access-gjxk9\") pod \"7492c523-3ce4-48f1-b66a-ec0c48d089b5\" (UID: \"7492c523-3ce4-48f1-b66a-ec0c48d089b5\") "
Aug 05 16:46:42.306763 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.306752    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7492c523-3ce4-48f1-b66a-ec0c48d089b5-extensions-socket-volume\") pod \"7492c523-3ce4-48f1-b66a-ec0c48d089b5\" (UID: \"7492c523-3ce4-48f1-b66a-ec0c48d089b5\") "
Aug 05 16:46:42.306856 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.306842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm6cr\" (UniqueName: \"kubernetes.io/projected/47e77c21-97f6-4b67-9c31-abba97d476f4-kube-api-access-vm6cr\") pod \"kuadrant-operator-controller-manager-58fc56757c-b475n\" (UID: \"47e77c21-97f6-4b67-9c31-abba97d476f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"
Aug 05 16:46:42.306923 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.306900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e77c21-97f6-4b67-9c31-abba97d476f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-b475n\" (UID: \"47e77c21-97f6-4b67-9c31-abba97d476f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"
Aug 05 16:46:42.307276 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.307254    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e77c21-97f6-4b67-9c31-abba97d476f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-b475n\" (UID: \"47e77c21-97f6-4b67-9c31-abba97d476f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"
Aug 05 16:46:42.307366 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.307273    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7492c523-3ce4-48f1-b66a-ec0c48d089b5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7492c523-3ce4-48f1-b66a-ec0c48d089b5" (UID: "7492c523-3ce4-48f1-b66a-ec0c48d089b5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:46:42.308776 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.308759    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7492c523-3ce4-48f1-b66a-ec0c48d089b5-kube-api-access-gjxk9" (OuterVolumeSpecName: "kube-api-access-gjxk9") pod "7492c523-3ce4-48f1-b66a-ec0c48d089b5" (UID: "7492c523-3ce4-48f1-b66a-ec0c48d089b5"). InnerVolumeSpecName "kube-api-access-gjxk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:46:42.315685 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.315664    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm6cr\" (UniqueName: \"kubernetes.io/projected/47e77c21-97f6-4b67-9c31-abba97d476f4-kube-api-access-vm6cr\") pod \"kuadrant-operator-controller-manager-58fc56757c-b475n\" (UID: \"47e77c21-97f6-4b67-9c31-abba97d476f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"
Aug 05 16:46:42.323808 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.323790    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"
Aug 05 16:46:42.328190 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:46:42.328167    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-fz6xw\" is forbidden: User \"system:node:ip-10-0-138-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-233.ec2.internal' and this object" podUID="3f065bd4-81d1-4f55-a3f0-c7de237a8c3b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"
Aug 05 16:46:42.330286 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:46:42.330265    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-m2jjp\" is forbidden: User \"system:node:ip-10-0-138-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-233.ec2.internal' and this object" podUID="7492c523-3ce4-48f1-b66a-ec0c48d089b5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:42.407978 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.407943    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfqsr\" (UniqueName: \"kubernetes.io/projected/3f065bd4-81d1-4f55-a3f0-c7de237a8c3b-kube-api-access-dfqsr\") pod \"3f065bd4-81d1-4f55-a3f0-c7de237a8c3b\" (UID: \"3f065bd4-81d1-4f55-a3f0-c7de237a8c3b\") "
Aug 05 16:46:42.408155 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.408143    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7492c523-3ce4-48f1-b66a-ec0c48d089b5-extensions-socket-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:42.408212 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.408157    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjxk9\" (UniqueName: \"kubernetes.io/projected/7492c523-3ce4-48f1-b66a-ec0c48d089b5-kube-api-access-gjxk9\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:42.409947 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.409923    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f065bd4-81d1-4f55-a3f0-c7de237a8c3b-kube-api-access-dfqsr" (OuterVolumeSpecName: "kube-api-access-dfqsr") pod "3f065bd4-81d1-4f55-a3f0-c7de237a8c3b" (UID: "3f065bd4-81d1-4f55-a3f0-c7de237a8c3b"). InnerVolumeSpecName "kube-api-access-dfqsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:46:42.422085 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.422063    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"
Aug 05 16:46:42.428243 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.428226    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"
Aug 05 16:46:42.508829 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.508775    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfqsr\" (UniqueName: \"kubernetes.io/projected/3f065bd4-81d1-4f55-a3f0-c7de237a8c3b-kube-api-access-dfqsr\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:42.595198 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.595168    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"]
Aug 05 16:46:42.598856 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:46:42.598829    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80e93de_485c_48a0_8288_93957a32d862.slice/crio-b2f3905526ae6c0691f522475088ac99d7ca16a51409fe989edf327447774331 WatchSource:0}: Error finding container b2f3905526ae6c0691f522475088ac99d7ca16a51409fe989edf327447774331: Status 404 returned error can't find the container with id b2f3905526ae6c0691f522475088ac99d7ca16a51409fe989edf327447774331
Aug 05 16:46:42.623966 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.623928    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"]
Aug 05 16:46:42.627827 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:46:42.627801    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e77c21_97f6_4b67_9c31_abba97d476f4.slice/crio-a5e1ef3043b5f3f43585f9202499b69bc17f4c85a0c09870eb15cbc85cf8ede2 WatchSource:0}: Error finding container a5e1ef3043b5f3f43585f9202499b69bc17f4c85a0c09870eb15cbc85cf8ede2: Status 404 returned error can't find the container with id a5e1ef3043b5f3f43585f9202499b69bc17f4c85a0c09870eb15cbc85cf8ede2
Aug 05 16:46:42.819548 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.819506    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n" event={"ID":"47e77c21-97f6-4b67-9c31-abba97d476f4","Type":"ContainerStarted","Data":"08ca8287f9d561ac73621cbe152c90cc5c332c564c0d1560094fe563f6c68940"}
Aug 05 16:46:42.819744 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.819706    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"
Aug 05 16:46:42.819811 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.819762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n" event={"ID":"47e77c21-97f6-4b67-9c31-abba97d476f4","Type":"ContainerStarted","Data":"a5e1ef3043b5f3f43585f9202499b69bc17f4c85a0c09870eb15cbc85cf8ede2"}
Aug 05 16:46:42.820910 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.820884    2565 generic.go:356] "Generic (PLEG): container finished" podID="3f065bd4-81d1-4f55-a3f0-c7de237a8c3b" containerID="5b42525fc1d69ae797fc9adb97c8ae0088f267042ac3283f13c71b6c700ee942" exitCode=0
Aug 05 16:46:42.821030 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.820942    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"
Aug 05 16:46:42.821030 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.820958    2565 scope.go:117] "RemoveContainer" containerID="5b42525fc1d69ae797fc9adb97c8ae0088f267042ac3283f13c71b6c700ee942"
Aug 05 16:46:42.822512 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.822486    2565 generic.go:356] "Generic (PLEG): container finished" podID="7492c523-3ce4-48f1-b66a-ec0c48d089b5" containerID="01593b2e962b39570095ab6d0a59a7ebd2b9589a2ecb03c1a16686144c532dc5" exitCode=0
Aug 05 16:46:42.822617 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.822527    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:42.824511 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.824491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk" event={"ID":"c80e93de-485c-48a0-8288-93957a32d862","Type":"ContainerStarted","Data":"c4622f8ed97ceebd9cfd01ec0107bfbf62f55e319fe73d9ddff0e3d645f82bcf"}
Aug 05 16:46:42.824598 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.824532    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk" event={"ID":"c80e93de-485c-48a0-8288-93957a32d862","Type":"ContainerStarted","Data":"b2f3905526ae6c0691f522475088ac99d7ca16a51409fe989edf327447774331"}
Aug 05 16:46:42.824653 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.824640    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"
Aug 05 16:46:42.831239 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.831225    2565 scope.go:117] "RemoveContainer" containerID="5b42525fc1d69ae797fc9adb97c8ae0088f267042ac3283f13c71b6c700ee942"
Aug 05 16:46:42.831505 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:46:42.831481    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b42525fc1d69ae797fc9adb97c8ae0088f267042ac3283f13c71b6c700ee942\": container with ID starting with 5b42525fc1d69ae797fc9adb97c8ae0088f267042ac3283f13c71b6c700ee942 not found: ID does not exist" containerID="5b42525fc1d69ae797fc9adb97c8ae0088f267042ac3283f13c71b6c700ee942"
Aug 05 16:46:42.831553 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.831516    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b42525fc1d69ae797fc9adb97c8ae0088f267042ac3283f13c71b6c700ee942"} err="failed to get container status \"5b42525fc1d69ae797fc9adb97c8ae0088f267042ac3283f13c71b6c700ee942\": rpc error: code = NotFound desc = could not find container \"5b42525fc1d69ae797fc9adb97c8ae0088f267042ac3283f13c71b6c700ee942\": container with ID starting with 5b42525fc1d69ae797fc9adb97c8ae0088f267042ac3283f13c71b6c700ee942 not found: ID does not exist"
Aug 05 16:46:42.831553 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.831540    2565 scope.go:117] "RemoveContainer" containerID="01593b2e962b39570095ab6d0a59a7ebd2b9589a2ecb03c1a16686144c532dc5"
Aug 05 16:46:42.840901 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.840884    2565 scope.go:117] "RemoveContainer" containerID="01593b2e962b39570095ab6d0a59a7ebd2b9589a2ecb03c1a16686144c532dc5"
Aug 05 16:46:42.841359 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:46:42.841336    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01593b2e962b39570095ab6d0a59a7ebd2b9589a2ecb03c1a16686144c532dc5\": container with ID starting with 01593b2e962b39570095ab6d0a59a7ebd2b9589a2ecb03c1a16686144c532dc5 not found: ID does not exist" containerID="01593b2e962b39570095ab6d0a59a7ebd2b9589a2ecb03c1a16686144c532dc5"
Aug 05 16:46:42.841482 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.841364    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01593b2e962b39570095ab6d0a59a7ebd2b9589a2ecb03c1a16686144c532dc5"} err="failed to get container status \"01593b2e962b39570095ab6d0a59a7ebd2b9589a2ecb03c1a16686144c532dc5\": rpc error: code = NotFound desc = could not find container \"01593b2e962b39570095ab6d0a59a7ebd2b9589a2ecb03c1a16686144c532dc5\": container with ID starting with 01593b2e962b39570095ab6d0a59a7ebd2b9589a2ecb03c1a16686144c532dc5 not found: ID does not exist"
Aug 05 16:46:42.843240 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:46:42.843214    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-fz6xw\" is forbidden: User \"system:node:ip-10-0-138-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-233.ec2.internal' and this object" podUID="3f065bd4-81d1-4f55-a3f0-c7de237a8c3b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"
Aug 05 16:46:42.843401 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.843367    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n" podStartSLOduration=0.843355397 podStartE2EDuration="843.355397ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:46:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:46:42.841163652 +0000 UTC m=+475.423235308" watchObservedRunningTime="2026-08-05 16:46:42.843355397 +0000 UTC m=+475.425427052"
Aug 05 16:46:42.845842 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:46:42.845822    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-m2jjp\" is forbidden: User \"system:node:ip-10-0-138-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-233.ec2.internal' and this object" podUID="7492c523-3ce4-48f1-b66a-ec0c48d089b5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:42.875783 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:42.875729    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk" podStartSLOduration=0.875712823 podStartE2EDuration="875.712823ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:46:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:46:42.875249512 +0000 UTC m=+475.457321168" watchObservedRunningTime="2026-08-05 16:46:42.875712823 +0000 UTC m=+475.457784479"
Aug 05 16:46:42.877412 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:46:42.877386    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-fz6xw\" is forbidden: User \"system:node:ip-10-0-138-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-233.ec2.internal' and this object" podUID="3f065bd4-81d1-4f55-a3f0-c7de237a8c3b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fz6xw"
Aug 05 16:46:42.879074 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:46:42.879054    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-m2jjp\" is forbidden: User \"system:node:ip-10-0-138-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-233.ec2.internal' and this object" podUID="7492c523-3ce4-48f1-b66a-ec0c48d089b5" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-m2jjp"
Aug 05 16:46:43.951799 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:43.951765    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f065bd4-81d1-4f55-a3f0-c7de237a8c3b" path="/var/lib/kubelet/pods/3f065bd4-81d1-4f55-a3f0-c7de237a8c3b/volumes"
Aug 05 16:46:43.952160 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:43.952090    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7492c523-3ce4-48f1-b66a-ec0c48d089b5" path="/var/lib/kubelet/pods/7492c523-3ce4-48f1-b66a-ec0c48d089b5/volumes"
Aug 05 16:46:53.833505 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:53.833465    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"
Aug 05 16:46:53.833956 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:53.833544    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"
Aug 05 16:46:53.935227 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:53.935193    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"]
Aug 05 16:46:53.935438 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:53.935415    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n" podUID="47e77c21-97f6-4b67-9c31-abba97d476f4" containerName="manager" containerID="cri-o://08ca8287f9d561ac73621cbe152c90cc5c332c564c0d1560094fe563f6c68940" gracePeriod=10
Aug 05 16:46:54.178461 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.178438    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"
Aug 05 16:46:54.194002 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.193979    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e77c21-97f6-4b67-9c31-abba97d476f4-extensions-socket-volume\") pod \"47e77c21-97f6-4b67-9c31-abba97d476f4\" (UID: \"47e77c21-97f6-4b67-9c31-abba97d476f4\") "
Aug 05 16:46:54.194163 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.194032    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm6cr\" (UniqueName: \"kubernetes.io/projected/47e77c21-97f6-4b67-9c31-abba97d476f4-kube-api-access-vm6cr\") pod \"47e77c21-97f6-4b67-9c31-abba97d476f4\" (UID: \"47e77c21-97f6-4b67-9c31-abba97d476f4\") "
Aug 05 16:46:54.194345 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.194321    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47e77c21-97f6-4b67-9c31-abba97d476f4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "47e77c21-97f6-4b67-9c31-abba97d476f4" (UID: "47e77c21-97f6-4b67-9c31-abba97d476f4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:46:54.196072 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.196045    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47e77c21-97f6-4b67-9c31-abba97d476f4-kube-api-access-vm6cr" (OuterVolumeSpecName: "kube-api-access-vm6cr") pod "47e77c21-97f6-4b67-9c31-abba97d476f4" (UID: "47e77c21-97f6-4b67-9c31-abba97d476f4"). InnerVolumeSpecName "kube-api-access-vm6cr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:46:54.295266 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.295239    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47e77c21-97f6-4b67-9c31-abba97d476f4-extensions-socket-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:54.295266 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.295264    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm6cr\" (UniqueName: \"kubernetes.io/projected/47e77c21-97f6-4b67-9c31-abba97d476f4-kube-api-access-vm6cr\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:46:54.883188 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.883151    2565 generic.go:356] "Generic (PLEG): container finished" podID="47e77c21-97f6-4b67-9c31-abba97d476f4" containerID="08ca8287f9d561ac73621cbe152c90cc5c332c564c0d1560094fe563f6c68940" exitCode=0
Aug 05 16:46:54.883551 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.883200    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"
Aug 05 16:46:54.883551 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.883236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n" event={"ID":"47e77c21-97f6-4b67-9c31-abba97d476f4","Type":"ContainerDied","Data":"08ca8287f9d561ac73621cbe152c90cc5c332c564c0d1560094fe563f6c68940"}
Aug 05 16:46:54.883551 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.883290    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n" event={"ID":"47e77c21-97f6-4b67-9c31-abba97d476f4","Type":"ContainerDied","Data":"a5e1ef3043b5f3f43585f9202499b69bc17f4c85a0c09870eb15cbc85cf8ede2"}
Aug 05 16:46:54.883551 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.883313    2565 scope.go:117] "RemoveContainer" containerID="08ca8287f9d561ac73621cbe152c90cc5c332c564c0d1560094fe563f6c68940"
Aug 05 16:46:54.891702 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.891687    2565 scope.go:117] "RemoveContainer" containerID="08ca8287f9d561ac73621cbe152c90cc5c332c564c0d1560094fe563f6c68940"
Aug 05 16:46:54.891929 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:46:54.891911    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08ca8287f9d561ac73621cbe152c90cc5c332c564c0d1560094fe563f6c68940\": container with ID starting with 08ca8287f9d561ac73621cbe152c90cc5c332c564c0d1560094fe563f6c68940 not found: ID does not exist" containerID="08ca8287f9d561ac73621cbe152c90cc5c332c564c0d1560094fe563f6c68940"
Aug 05 16:46:54.891974 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.891936    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ca8287f9d561ac73621cbe152c90cc5c332c564c0d1560094fe563f6c68940"} err="failed to get container status \"08ca8287f9d561ac73621cbe152c90cc5c332c564c0d1560094fe563f6c68940\": rpc error: code = NotFound desc = could not find container \"08ca8287f9d561ac73621cbe152c90cc5c332c564c0d1560094fe563f6c68940\": container with ID starting with 08ca8287f9d561ac73621cbe152c90cc5c332c564c0d1560094fe563f6c68940 not found: ID does not exist"
Aug 05 16:46:54.905611 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.905592    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"]
Aug 05 16:46:54.909929 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:54.909908    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-b475n"]
Aug 05 16:46:55.955151 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:46:55.954008    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47e77c21-97f6-4b67-9c31-abba97d476f4" path="/var/lib/kubelet/pods/47e77c21-97f6-4b67-9c31-abba97d476f4/volumes"
Aug 05 16:47:10.428169 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.428135    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"]
Aug 05 16:47:10.428510 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.428424    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e77c21-97f6-4b67-9c31-abba97d476f4" containerName="manager"
Aug 05 16:47:10.428510 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.428435    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e77c21-97f6-4b67-9c31-abba97d476f4" containerName="manager"
Aug 05 16:47:10.428510 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.428496    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="47e77c21-97f6-4b67-9c31-abba97d476f4" containerName="manager"
Aug 05 16:47:10.432483 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.432467    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.435208 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.435191    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-w45fh\""
Aug 05 16:47:10.447885 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.447864    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"]
Aug 05 16:47:10.520047 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.520013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b74ce519-2869-4fb6-8a25-546889825c39-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.520224 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.520059    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b74ce519-2869-4fb6-8a25-546889825c39-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.520224 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.520080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52rbb\" (UniqueName: \"kubernetes.io/projected/b74ce519-2869-4fb6-8a25-546889825c39-kube-api-access-52rbb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.520224 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.520111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b74ce519-2869-4fb6-8a25-546889825c39-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.520224 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.520131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b74ce519-2869-4fb6-8a25-546889825c39-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.520224 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.520156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b74ce519-2869-4fb6-8a25-546889825c39-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.520224 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.520176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b74ce519-2869-4fb6-8a25-546889825c39-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.520421 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.520236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b74ce519-2869-4fb6-8a25-546889825c39-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.520421 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.520270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b74ce519-2869-4fb6-8a25-546889825c39-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.621053 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.621021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b74ce519-2869-4fb6-8a25-546889825c39-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.621297 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.621068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b74ce519-2869-4fb6-8a25-546889825c39-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.621297 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.621089    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b74ce519-2869-4fb6-8a25-546889825c39-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.621297 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.621224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b74ce519-2869-4fb6-8a25-546889825c39-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.621297 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.621287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b74ce519-2869-4fb6-8a25-546889825c39-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.621662 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.621320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52rbb\" (UniqueName: \"kubernetes.io/projected/b74ce519-2869-4fb6-8a25-546889825c39-kube-api-access-52rbb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.621662 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.621351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b74ce519-2869-4fb6-8a25-546889825c39-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.621662 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.621383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b74ce519-2869-4fb6-8a25-546889825c39-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.621662 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.621432    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b74ce519-2869-4fb6-8a25-546889825c39-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.621662 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.621492    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b74ce519-2869-4fb6-8a25-546889825c39-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.621662 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.621651    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b74ce519-2869-4fb6-8a25-546889825c39-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.622161 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.622141    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b74ce519-2869-4fb6-8a25-546889825c39-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.622246 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.622168    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b74ce519-2869-4fb6-8a25-546889825c39-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.622375 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.621776    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b74ce519-2869-4fb6-8a25-546889825c39-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.623595 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.623571    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b74ce519-2869-4fb6-8a25-546889825c39-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.623789 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.623772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b74ce519-2869-4fb6-8a25-546889825c39-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.634239 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.634177    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b74ce519-2869-4fb6-8a25-546889825c39-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.634797 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.634458    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52rbb\" (UniqueName: \"kubernetes.io/projected/b74ce519-2869-4fb6-8a25-546889825c39-kube-api-access-52rbb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vmm6m\" (UID: \"b74ce519-2869-4fb6-8a25-546889825c39\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.741881 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.741794    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:10.880321 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.880292    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"]
Aug 05 16:47:10.880979 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:47:10.880951    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb74ce519_2869_4fb6_8a25_546889825c39.slice/crio-477d46b86951bbbffa40e6cecf2b7e6ad9bb7675d55c63f528e0a8b44317bc9f WatchSource:0}: Error finding container 477d46b86951bbbffa40e6cecf2b7e6ad9bb7675d55c63f528e0a8b44317bc9f: Status 404 returned error can't find the container with id 477d46b86951bbbffa40e6cecf2b7e6ad9bb7675d55c63f528e0a8b44317bc9f
Aug 05 16:47:10.882896 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.882870    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:47:10.882949 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.882931    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:47:10.882983 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.882961    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:47:10.958591 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.958555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m" event={"ID":"b74ce519-2869-4fb6-8a25-546889825c39","Type":"ContainerStarted","Data":"d1c47f5af830e94f78b555d69a6cde666c2a3bc6f9e8d1804716bff8ee0e0b9e"}
Aug 05 16:47:10.958750 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.958612    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m" event={"ID":"b74ce519-2869-4fb6-8a25-546889825c39","Type":"ContainerStarted","Data":"477d46b86951bbbffa40e6cecf2b7e6ad9bb7675d55c63f528e0a8b44317bc9f"}
Aug 05 16:47:10.984221 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:10.984165    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m" podStartSLOduration=0.984148006 podStartE2EDuration="984.148006ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:47:10.982784493 +0000 UTC m=+503.564856184" watchObservedRunningTime="2026-08-05 16:47:10.984148006 +0000 UTC m=+503.566219661"
Aug 05 16:47:11.742839 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:11.742803    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:11.747555 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:11.747530    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:11.962642 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:11.962608    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:11.963631 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:11.963614    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:47:12.076992 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.076953    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"]
Aug 05 16:47:12.080076 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.080055    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"
Aug 05 16:47:12.082410 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.082391    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g7n27\""
Aug 05 16:47:12.082722 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.082702    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 05 16:47:12.090698 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.090679    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"]
Aug 05 16:47:12.135343 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.135311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e9475877-e4a7-4ddd-8b4d-cd06683abd1b-config-file\") pod \"limitador-limitador-859c4d96d6-pt2zp\" (UID: \"e9475877-e4a7-4ddd-8b4d-cd06683abd1b\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"
Aug 05 16:47:12.135343 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.135347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqqdl\" (UniqueName: \"kubernetes.io/projected/e9475877-e4a7-4ddd-8b4d-cd06683abd1b-kube-api-access-nqqdl\") pod \"limitador-limitador-859c4d96d6-pt2zp\" (UID: \"e9475877-e4a7-4ddd-8b4d-cd06683abd1b\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"
Aug 05 16:47:12.162255 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.161552    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"]
Aug 05 16:47:12.235951 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.235919    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqqdl\" (UniqueName: \"kubernetes.io/projected/e9475877-e4a7-4ddd-8b4d-cd06683abd1b-kube-api-access-nqqdl\") pod \"limitador-limitador-859c4d96d6-pt2zp\" (UID: \"e9475877-e4a7-4ddd-8b4d-cd06683abd1b\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"
Aug 05 16:47:12.236211 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.236032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e9475877-e4a7-4ddd-8b4d-cd06683abd1b-config-file\") pod \"limitador-limitador-859c4d96d6-pt2zp\" (UID: \"e9475877-e4a7-4ddd-8b4d-cd06683abd1b\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"
Aug 05 16:47:12.236785 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.236762    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e9475877-e4a7-4ddd-8b4d-cd06683abd1b-config-file\") pod \"limitador-limitador-859c4d96d6-pt2zp\" (UID: \"e9475877-e4a7-4ddd-8b4d-cd06683abd1b\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"
Aug 05 16:47:12.245688 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.245660    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqqdl\" (UniqueName: \"kubernetes.io/projected/e9475877-e4a7-4ddd-8b4d-cd06683abd1b-kube-api-access-nqqdl\") pod \"limitador-limitador-859c4d96d6-pt2zp\" (UID: \"e9475877-e4a7-4ddd-8b4d-cd06683abd1b\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"
Aug 05 16:47:12.390942 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.390852    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"
Aug 05 16:47:12.528934 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.528901    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"]
Aug 05 16:47:12.530665 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:47:12.530637    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9475877_e4a7_4ddd_8b4d_cd06683abd1b.slice/crio-df9f814c5d75cd19bc3f3e4f3209669ee4195ee2c5645147dcf55e9331dfb82b WatchSource:0}: Error finding container df9f814c5d75cd19bc3f3e4f3209669ee4195ee2c5645147dcf55e9331dfb82b: Status 404 returned error can't find the container with id df9f814c5d75cd19bc3f3e4f3209669ee4195ee2c5645147dcf55e9331dfb82b
Aug 05 16:47:12.947086 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.947051    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-vjkll"]
Aug 05 16:47:12.951420 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.951398    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-vjkll"
Aug 05 16:47:12.954084 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.954061    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-d2pgd\""
Aug 05 16:47:12.961189 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.961167    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-vjkll"]
Aug 05 16:47:12.967980 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:12.967920    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp" event={"ID":"e9475877-e4a7-4ddd-8b4d-cd06683abd1b","Type":"ContainerStarted","Data":"df9f814c5d75cd19bc3f3e4f3209669ee4195ee2c5645147dcf55e9331dfb82b"}
Aug 05 16:47:13.042482 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:13.042451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp7nt\" (UniqueName: \"kubernetes.io/projected/3062cb04-a273-4ad0-b32d-c56d862d1f96-kube-api-access-sp7nt\") pod \"authorino-b54df94b4-vjkll\" (UID: \"3062cb04-a273-4ad0-b32d-c56d862d1f96\") " pod="kuadrant-system/authorino-b54df94b4-vjkll"
Aug 05 16:47:13.143818 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:13.143781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp7nt\" (UniqueName: \"kubernetes.io/projected/3062cb04-a273-4ad0-b32d-c56d862d1f96-kube-api-access-sp7nt\") pod \"authorino-b54df94b4-vjkll\" (UID: \"3062cb04-a273-4ad0-b32d-c56d862d1f96\") " pod="kuadrant-system/authorino-b54df94b4-vjkll"
Aug 05 16:47:13.154357 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:13.154323    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp7nt\" (UniqueName: \"kubernetes.io/projected/3062cb04-a273-4ad0-b32d-c56d862d1f96-kube-api-access-sp7nt\") pod \"authorino-b54df94b4-vjkll\" (UID: \"3062cb04-a273-4ad0-b32d-c56d862d1f96\") " pod="kuadrant-system/authorino-b54df94b4-vjkll"
Aug 05 16:47:13.261219 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:13.261123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-vjkll"
Aug 05 16:47:13.388322 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:13.388298    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-vjkll"]
Aug 05 16:47:13.393082 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:47:13.393048    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3062cb04_a273_4ad0_b32d_c56d862d1f96.slice/crio-b748f3ca76a953674d6b6f880c4817b9deedf51993d371dbff709904245f5b37 WatchSource:0}: Error finding container b748f3ca76a953674d6b6f880c4817b9deedf51993d371dbff709904245f5b37: Status 404 returned error can't find the container with id b748f3ca76a953674d6b6f880c4817b9deedf51993d371dbff709904245f5b37
Aug 05 16:47:13.973817 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:13.973782    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-vjkll" event={"ID":"3062cb04-a273-4ad0-b32d-c56d862d1f96","Type":"ContainerStarted","Data":"b748f3ca76a953674d6b6f880c4817b9deedf51993d371dbff709904245f5b37"}
Aug 05 16:47:16.991058 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:16.990981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-vjkll" event={"ID":"3062cb04-a273-4ad0-b32d-c56d862d1f96","Type":"ContainerStarted","Data":"b08cf423ffb825d47cb82655610e194c82be702e602fb0e13c4285ba20906209"}
Aug 05 16:47:17.026731 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:17.026683    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-vjkll" podStartSLOduration=1.739119686 podStartE2EDuration="5.026668971s" totalImagesPullingTime="3.287549285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:47:17.025117004 +0000 UTC m=+509.607188657" watchObservedRunningTime="2026-08-05 16:47:17.026668971 +0000 UTC m=+509.608740627"
Aug 05 16:47:18.339166 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:18.339133    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-vjkll"]
Aug 05 16:47:18.999376 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:18.999337    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-vjkll" podUID="3062cb04-a273-4ad0-b32d-c56d862d1f96" containerName="authorino" containerID="cri-o://b08cf423ffb825d47cb82655610e194c82be702e602fb0e13c4285ba20906209" gracePeriod=30
Aug 05 16:47:19.237356 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:19.237336    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-vjkll"
Aug 05 16:47:19.295729 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:19.295650    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sp7nt\" (UniqueName: \"kubernetes.io/projected/3062cb04-a273-4ad0-b32d-c56d862d1f96-kube-api-access-sp7nt\") pod \"3062cb04-a273-4ad0-b32d-c56d862d1f96\" (UID: \"3062cb04-a273-4ad0-b32d-c56d862d1f96\") "
Aug 05 16:47:19.297677 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:19.297655    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3062cb04-a273-4ad0-b32d-c56d862d1f96-kube-api-access-sp7nt" (OuterVolumeSpecName: "kube-api-access-sp7nt") pod "3062cb04-a273-4ad0-b32d-c56d862d1f96" (UID: "3062cb04-a273-4ad0-b32d-c56d862d1f96"). InnerVolumeSpecName "kube-api-access-sp7nt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:47:19.396357 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:19.396325    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp7nt\" (UniqueName: \"kubernetes.io/projected/3062cb04-a273-4ad0-b32d-c56d862d1f96-kube-api-access-sp7nt\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:47:20.005383 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:20.005347    2565 generic.go:356] "Generic (PLEG): container finished" podID="3062cb04-a273-4ad0-b32d-c56d862d1f96" containerID="b08cf423ffb825d47cb82655610e194c82be702e602fb0e13c4285ba20906209" exitCode=0
Aug 05 16:47:20.005530 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:20.005390    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-vjkll"
Aug 05 16:47:20.005530 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:20.005431    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-vjkll" event={"ID":"3062cb04-a273-4ad0-b32d-c56d862d1f96","Type":"ContainerDied","Data":"b08cf423ffb825d47cb82655610e194c82be702e602fb0e13c4285ba20906209"}
Aug 05 16:47:20.005530 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:20.005475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-vjkll" event={"ID":"3062cb04-a273-4ad0-b32d-c56d862d1f96","Type":"ContainerDied","Data":"b748f3ca76a953674d6b6f880c4817b9deedf51993d371dbff709904245f5b37"}
Aug 05 16:47:20.005530 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:20.005492    2565 scope.go:117] "RemoveContainer" containerID="b08cf423ffb825d47cb82655610e194c82be702e602fb0e13c4285ba20906209"
Aug 05 16:47:20.013540 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:20.013523    2565 scope.go:117] "RemoveContainer" containerID="b08cf423ffb825d47cb82655610e194c82be702e602fb0e13c4285ba20906209"
Aug 05 16:47:20.013782 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:47:20.013763    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b08cf423ffb825d47cb82655610e194c82be702e602fb0e13c4285ba20906209\": container with ID starting with b08cf423ffb825d47cb82655610e194c82be702e602fb0e13c4285ba20906209 not found: ID does not exist" containerID="b08cf423ffb825d47cb82655610e194c82be702e602fb0e13c4285ba20906209"
Aug 05 16:47:20.013841 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:20.013795    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b08cf423ffb825d47cb82655610e194c82be702e602fb0e13c4285ba20906209"} err="failed to get container status \"b08cf423ffb825d47cb82655610e194c82be702e602fb0e13c4285ba20906209\": rpc error: code = NotFound desc = could not find container \"b08cf423ffb825d47cb82655610e194c82be702e602fb0e13c4285ba20906209\": container with ID starting with b08cf423ffb825d47cb82655610e194c82be702e602fb0e13c4285ba20906209 not found: ID does not exist"
Aug 05 16:47:20.024189 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:20.024168    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-vjkll"]
Aug 05 16:47:20.028816 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:20.028794    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-vjkll"]
Aug 05 16:47:21.952008 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:21.951976    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3062cb04-a273-4ad0-b32d-c56d862d1f96" path="/var/lib/kubelet/pods/3062cb04-a273-4ad0-b32d-c56d862d1f96/volumes"
Aug 05 16:47:24.026232 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:24.026196    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp" event={"ID":"e9475877-e4a7-4ddd-8b4d-cd06683abd1b","Type":"ContainerStarted","Data":"8d6a2d095e5e70c9346b867ec94965c8263506469f6c8e347bac448f210ee569"}
Aug 05 16:47:24.026604 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:24.026325    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"
Aug 05 16:47:24.045962 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:24.045914    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp" podStartSLOduration=1.5769934380000001 podStartE2EDuration="12.045899932s" totalImagesPullingTime="10.468906494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:47:24.043677701 +0000 UTC m=+516.625749357" watchObservedRunningTime="2026-08-05 16:47:24.045899932 +0000 UTC m=+516.627971588"
Aug 05 16:47:27.363916 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:27.363882    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"]
Aug 05 16:47:27.364294 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:27.364081    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp" podUID="e9475877-e4a7-4ddd-8b4d-cd06683abd1b" containerName="limitador" containerID="cri-o://8d6a2d095e5e70c9346b867ec94965c8263506469f6c8e347bac448f210ee569" gracePeriod=30
Aug 05 16:47:27.916761 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:27.916739    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"
Aug 05 16:47:28.047723 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:28.047635    2565 generic.go:356] "Generic (PLEG): container finished" podID="e9475877-e4a7-4ddd-8b4d-cd06683abd1b" containerID="8d6a2d095e5e70c9346b867ec94965c8263506469f6c8e347bac448f210ee569" exitCode=0
Aug 05 16:47:28.047723 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:28.047682    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"
Aug 05 16:47:28.047723 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:28.047709    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp" event={"ID":"e9475877-e4a7-4ddd-8b4d-cd06683abd1b","Type":"ContainerDied","Data":"8d6a2d095e5e70c9346b867ec94965c8263506469f6c8e347bac448f210ee569"}
Aug 05 16:47:28.047961 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:28.047761    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-pt2zp" event={"ID":"e9475877-e4a7-4ddd-8b4d-cd06683abd1b","Type":"ContainerDied","Data":"df9f814c5d75cd19bc3f3e4f3209669ee4195ee2c5645147dcf55e9331dfb82b"}
Aug 05 16:47:28.047961 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:28.047790    2565 scope.go:117] "RemoveContainer" containerID="8d6a2d095e5e70c9346b867ec94965c8263506469f6c8e347bac448f210ee569"
Aug 05 16:47:28.055943 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:28.055923    2565 scope.go:117] "RemoveContainer" containerID="8d6a2d095e5e70c9346b867ec94965c8263506469f6c8e347bac448f210ee569"
Aug 05 16:47:28.056189 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:47:28.056170    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d6a2d095e5e70c9346b867ec94965c8263506469f6c8e347bac448f210ee569\": container with ID starting with 8d6a2d095e5e70c9346b867ec94965c8263506469f6c8e347bac448f210ee569 not found: ID does not exist" containerID="8d6a2d095e5e70c9346b867ec94965c8263506469f6c8e347bac448f210ee569"
Aug 05 16:47:28.056230 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:28.056201    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d6a2d095e5e70c9346b867ec94965c8263506469f6c8e347bac448f210ee569"} err="failed to get container status \"8d6a2d095e5e70c9346b867ec94965c8263506469f6c8e347bac448f210ee569\": rpc error: code = NotFound desc = could not find container \"8d6a2d095e5e70c9346b867ec94965c8263506469f6c8e347bac448f210ee569\": container with ID starting with 8d6a2d095e5e70c9346b867ec94965c8263506469f6c8e347bac448f210ee569 not found: ID does not exist"
Aug 05 16:47:28.066470 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:28.066454    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqqdl\" (UniqueName: \"kubernetes.io/projected/e9475877-e4a7-4ddd-8b4d-cd06683abd1b-kube-api-access-nqqdl\") pod \"e9475877-e4a7-4ddd-8b4d-cd06683abd1b\" (UID: \"e9475877-e4a7-4ddd-8b4d-cd06683abd1b\") "
Aug 05 16:47:28.066537 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:28.066507    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e9475877-e4a7-4ddd-8b4d-cd06683abd1b-config-file\") pod \"e9475877-e4a7-4ddd-8b4d-cd06683abd1b\" (UID: \"e9475877-e4a7-4ddd-8b4d-cd06683abd1b\") "
Aug 05 16:47:28.066882 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:28.066860    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9475877-e4a7-4ddd-8b4d-cd06683abd1b-config-file" (OuterVolumeSpecName: "config-file") pod "e9475877-e4a7-4ddd-8b4d-cd06683abd1b" (UID: "e9475877-e4a7-4ddd-8b4d-cd06683abd1b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:47:28.068427 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:28.068406    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9475877-e4a7-4ddd-8b4d-cd06683abd1b-kube-api-access-nqqdl" (OuterVolumeSpecName: "kube-api-access-nqqdl") pod "e9475877-e4a7-4ddd-8b4d-cd06683abd1b" (UID: "e9475877-e4a7-4ddd-8b4d-cd06683abd1b"). InnerVolumeSpecName "kube-api-access-nqqdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:47:28.167459 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:28.167431    2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e9475877-e4a7-4ddd-8b4d-cd06683abd1b-config-file\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:47:28.167459 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:28.167454    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqqdl\" (UniqueName: \"kubernetes.io/projected/e9475877-e4a7-4ddd-8b4d-cd06683abd1b-kube-api-access-nqqdl\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:47:28.372859 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:28.372831    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"]
Aug 05 16:47:28.378470 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:28.378446    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-pt2zp"]
Aug 05 16:47:29.952174 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:29.952145    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9475877-e4a7-4ddd-8b4d-cd06683abd1b" path="/var/lib/kubelet/pods/e9475877-e4a7-4ddd-8b4d-cd06683abd1b/volumes"
Aug 05 16:47:33.770523 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:33.770491    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r76nh"]
Aug 05 16:47:33.770881 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:33.770811    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3062cb04-a273-4ad0-b32d-c56d862d1f96" containerName="authorino"
Aug 05 16:47:33.770881 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:33.770823    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3062cb04-a273-4ad0-b32d-c56d862d1f96" containerName="authorino"
Aug 05 16:47:33.770881 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:33.770837    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9475877-e4a7-4ddd-8b4d-cd06683abd1b" containerName="limitador"
Aug 05 16:47:33.770881 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:33.770842    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9475877-e4a7-4ddd-8b4d-cd06683abd1b" containerName="limitador"
Aug 05 16:47:33.771029 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:33.770894    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9475877-e4a7-4ddd-8b4d-cd06683abd1b" containerName="limitador"
Aug 05 16:47:33.771029 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:33.770904    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3062cb04-a273-4ad0-b32d-c56d862d1f96" containerName="authorino"
Aug 05 16:47:33.775449 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:33.775434    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r76nh"
Aug 05 16:47:33.778253 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:33.778233    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7rjf8\""
Aug 05 16:47:33.778366 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:33.778240    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Aug 05 16:47:33.779408 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:33.779391    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 05 16:47:33.779652 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:33.779638    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 16:47:33.807489 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:33.807459    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r76nh"]
Aug 05 16:47:33.913809 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:33.913774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e8fe28ce-e7f6-4839-9898-7c0e2286f8be-data\") pod \"postgres-69fb4594cf-r76nh\" (UID: \"e8fe28ce-e7f6-4839-9898-7c0e2286f8be\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r76nh"
Aug 05 16:47:33.913972 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:33.913836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz25s\" (UniqueName: \"kubernetes.io/projected/e8fe28ce-e7f6-4839-9898-7c0e2286f8be-kube-api-access-jz25s\") pod \"postgres-69fb4594cf-r76nh\" (UID: \"e8fe28ce-e7f6-4839-9898-7c0e2286f8be\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r76nh"
Aug 05 16:47:34.014493 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:34.014462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz25s\" (UniqueName: \"kubernetes.io/projected/e8fe28ce-e7f6-4839-9898-7c0e2286f8be-kube-api-access-jz25s\") pod \"postgres-69fb4594cf-r76nh\" (UID: \"e8fe28ce-e7f6-4839-9898-7c0e2286f8be\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r76nh"
Aug 05 16:47:34.014682 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:34.014528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e8fe28ce-e7f6-4839-9898-7c0e2286f8be-data\") pod \"postgres-69fb4594cf-r76nh\" (UID: \"e8fe28ce-e7f6-4839-9898-7c0e2286f8be\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r76nh"
Aug 05 16:47:34.014881 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:34.014863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e8fe28ce-e7f6-4839-9898-7c0e2286f8be-data\") pod \"postgres-69fb4594cf-r76nh\" (UID: \"e8fe28ce-e7f6-4839-9898-7c0e2286f8be\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r76nh"
Aug 05 16:47:34.034195 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:34.034132    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz25s\" (UniqueName: \"kubernetes.io/projected/e8fe28ce-e7f6-4839-9898-7c0e2286f8be-kube-api-access-jz25s\") pod \"postgres-69fb4594cf-r76nh\" (UID: \"e8fe28ce-e7f6-4839-9898-7c0e2286f8be\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r76nh"
Aug 05 16:47:34.084427 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:34.084390    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r76nh"
Aug 05 16:47:34.219722 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:34.219696    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r76nh"]
Aug 05 16:47:34.221817 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:47:34.221783    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8fe28ce_e7f6_4839_9898_7c0e2286f8be.slice/crio-a78051d7aeca32670cb5071eab1429b35b27ef9a09bbba330f7a436aa56dde97 WatchSource:0}: Error finding container a78051d7aeca32670cb5071eab1429b35b27ef9a09bbba330f7a436aa56dde97: Status 404 returned error can't find the container with id a78051d7aeca32670cb5071eab1429b35b27ef9a09bbba330f7a436aa56dde97
Aug 05 16:47:35.089866 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:35.089822    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r76nh" event={"ID":"e8fe28ce-e7f6-4839-9898-7c0e2286f8be","Type":"ContainerStarted","Data":"a78051d7aeca32670cb5071eab1429b35b27ef9a09bbba330f7a436aa56dde97"}
Aug 05 16:47:41.124469 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:41.124432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r76nh" event={"ID":"e8fe28ce-e7f6-4839-9898-7c0e2286f8be","Type":"ContainerStarted","Data":"537eb381c8d21c101f3c28915a50540aacf06ea47227f00106acb0b932537d34"}
Aug 05 16:47:41.124868 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:41.124522    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r76nh"
Aug 05 16:47:41.147027 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:41.146977    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r76nh" podStartSLOduration=1.830499868 podStartE2EDuration="8.146961812s" totalImagesPullingTime="6.316461944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:47:41.145703246 +0000 UTC m=+533.727774903" watchObservedRunningTime="2026-08-05 16:47:41.146961812 +0000 UTC m=+533.729033468"
Aug 05 16:47:47.156851 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:47.156823    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r76nh"
Aug 05 16:47:47.738806 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:47.738774    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-gbfh6"]
Aug 05 16:47:47.742237 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:47.742217    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-gbfh6"
Aug 05 16:47:47.745025 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:47.745003    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-d2pgd\""
Aug 05 16:47:47.752156 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:47.752133    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-gbfh6"]
Aug 05 16:47:47.834820 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:47.834788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5572\" (UniqueName: \"kubernetes.io/projected/426e6b01-cc95-494e-aab3-02ca75111f74-kube-api-access-r5572\") pod \"authorino-5dc7ccb5f-gbfh6\" (UID: \"426e6b01-cc95-494e-aab3-02ca75111f74\") " pod="kuadrant-system/authorino-5dc7ccb5f-gbfh6"
Aug 05 16:47:47.935349 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:47.935323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5572\" (UniqueName: \"kubernetes.io/projected/426e6b01-cc95-494e-aab3-02ca75111f74-kube-api-access-r5572\") pod \"authorino-5dc7ccb5f-gbfh6\" (UID: \"426e6b01-cc95-494e-aab3-02ca75111f74\") " pod="kuadrant-system/authorino-5dc7ccb5f-gbfh6"
Aug 05 16:47:47.947281 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:47.947252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5572\" (UniqueName: \"kubernetes.io/projected/426e6b01-cc95-494e-aab3-02ca75111f74-kube-api-access-r5572\") pod \"authorino-5dc7ccb5f-gbfh6\" (UID: \"426e6b01-cc95-494e-aab3-02ca75111f74\") " pod="kuadrant-system/authorino-5dc7ccb5f-gbfh6"
Aug 05 16:47:47.995485 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:47.995421    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-gbfh6"]
Aug 05 16:47:47.997902 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:47.997883    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-d2pgd\""
Aug 05 16:47:48.005679 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:48.005662    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-gbfh6"
Aug 05 16:47:48.046897 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:48.046867    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c6886bd7b-bwnhw"]
Aug 05 16:47:48.052585 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:48.052550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6886bd7b-bwnhw"
Aug 05 16:47:48.057969 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:48.057946    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 05 16:47:48.060915 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:48.060885    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c6886bd7b-bwnhw"]
Aug 05 16:47:48.136802 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:48.136768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75e81ce1-ee06-492a-acba-6cfa103834b6-tls-cert\") pod \"authorino-6c6886bd7b-bwnhw\" (UID: \"75e81ce1-ee06-492a-acba-6cfa103834b6\") " pod="kuadrant-system/authorino-6c6886bd7b-bwnhw"
Aug 05 16:47:48.136948 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:48.136835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fqnv\" (UniqueName: \"kubernetes.io/projected/75e81ce1-ee06-492a-acba-6cfa103834b6-kube-api-access-4fqnv\") pod \"authorino-6c6886bd7b-bwnhw\" (UID: \"75e81ce1-ee06-492a-acba-6cfa103834b6\") " pod="kuadrant-system/authorino-6c6886bd7b-bwnhw"
Aug 05 16:47:48.147719 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:48.147696    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-gbfh6"]
Aug 05 16:47:48.147965 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:47:48.147946    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod426e6b01_cc95_494e_aab3_02ca75111f74.slice/crio-8becd75d396a92b9875f875342d3eda4833ed8cbfbd16bea5c27b46a592b1416 WatchSource:0}: Error finding container 8becd75d396a92b9875f875342d3eda4833ed8cbfbd16bea5c27b46a592b1416: Status 404 returned error can't find the container with id 8becd75d396a92b9875f875342d3eda4833ed8cbfbd16bea5c27b46a592b1416
Aug 05 16:47:48.159088 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:48.159064    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-gbfh6" event={"ID":"426e6b01-cc95-494e-aab3-02ca75111f74","Type":"ContainerStarted","Data":"8becd75d396a92b9875f875342d3eda4833ed8cbfbd16bea5c27b46a592b1416"}
Aug 05 16:47:48.237187 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:48.237160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fqnv\" (UniqueName: \"kubernetes.io/projected/75e81ce1-ee06-492a-acba-6cfa103834b6-kube-api-access-4fqnv\") pod \"authorino-6c6886bd7b-bwnhw\" (UID: \"75e81ce1-ee06-492a-acba-6cfa103834b6\") " pod="kuadrant-system/authorino-6c6886bd7b-bwnhw"
Aug 05 16:47:48.237280 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:48.237209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75e81ce1-ee06-492a-acba-6cfa103834b6-tls-cert\") pod \"authorino-6c6886bd7b-bwnhw\" (UID: \"75e81ce1-ee06-492a-acba-6cfa103834b6\") " pod="kuadrant-system/authorino-6c6886bd7b-bwnhw"
Aug 05 16:47:48.239606 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:48.239586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75e81ce1-ee06-492a-acba-6cfa103834b6-tls-cert\") pod \"authorino-6c6886bd7b-bwnhw\" (UID: \"75e81ce1-ee06-492a-acba-6cfa103834b6\") " pod="kuadrant-system/authorino-6c6886bd7b-bwnhw"
Aug 05 16:47:48.247045 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:48.247000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fqnv\" (UniqueName: \"kubernetes.io/projected/75e81ce1-ee06-492a-acba-6cfa103834b6-kube-api-access-4fqnv\") pod \"authorino-6c6886bd7b-bwnhw\" (UID: \"75e81ce1-ee06-492a-acba-6cfa103834b6\") " pod="kuadrant-system/authorino-6c6886bd7b-bwnhw"
Aug 05 16:47:48.366852 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:48.366823    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6886bd7b-bwnhw"
Aug 05 16:47:48.504517 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:48.504442    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c6886bd7b-bwnhw"]
Aug 05 16:47:48.507551 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:47:48.507525    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75e81ce1_ee06_492a_acba_6cfa103834b6.slice/crio-5070dad63d0972fc7c0ce5bb6541ab4328b4ce379aba81e0cc63014ce86be011 WatchSource:0}: Error finding container 5070dad63d0972fc7c0ce5bb6541ab4328b4ce379aba81e0cc63014ce86be011: Status 404 returned error can't find the container with id 5070dad63d0972fc7c0ce5bb6541ab4328b4ce379aba81e0cc63014ce86be011
Aug 05 16:47:49.166213 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:49.166124    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6886bd7b-bwnhw" event={"ID":"75e81ce1-ee06-492a-acba-6cfa103834b6","Type":"ContainerStarted","Data":"8f7ca29c450537d97c24d9066f1872cf115527eef026ecf2cfb598e7a303a1fe"}
Aug 05 16:47:49.166213 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:49.166169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6886bd7b-bwnhw" event={"ID":"75e81ce1-ee06-492a-acba-6cfa103834b6","Type":"ContainerStarted","Data":"5070dad63d0972fc7c0ce5bb6541ab4328b4ce379aba81e0cc63014ce86be011"}
Aug 05 16:47:49.167769 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:49.167745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-gbfh6" event={"ID":"426e6b01-cc95-494e-aab3-02ca75111f74","Type":"ContainerStarted","Data":"3a2a0ca97ccfe0ec7b51ce144e8ee099778ea6b875e72590781a0a118b9a1e90"}
Aug 05 16:47:49.167894 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:49.167797    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5dc7ccb5f-gbfh6" podUID="426e6b01-cc95-494e-aab3-02ca75111f74" containerName="authorino" containerID="cri-o://3a2a0ca97ccfe0ec7b51ce144e8ee099778ea6b875e72590781a0a118b9a1e90" gracePeriod=30
Aug 05 16:47:49.186551 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:49.186511    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6c6886bd7b-bwnhw" podStartSLOduration=0.826696329 podStartE2EDuration="1.186497207s" totalImagesPullingTime="359.800878ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:47:49.18488427 +0000 UTC m=+541.766955939" watchObservedRunningTime="2026-08-05 16:47:49.186497207 +0000 UTC m=+541.768568840"
Aug 05 16:47:49.208200 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:49.208139    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dc7ccb5f-gbfh6" podStartSLOduration=1.321496494 podStartE2EDuration="2.208125793s" totalImagesPullingTime="886.629299ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:47:49.204743388 +0000 UTC m=+541.786815055" watchObservedRunningTime="2026-08-05 16:47:49.208125793 +0000 UTC m=+541.790197450"
Aug 05 16:47:49.408359 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:49.408334    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-gbfh6"
Aug 05 16:47:49.547062 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:49.546983    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5572\" (UniqueName: \"kubernetes.io/projected/426e6b01-cc95-494e-aab3-02ca75111f74-kube-api-access-r5572\") pod \"426e6b01-cc95-494e-aab3-02ca75111f74\" (UID: \"426e6b01-cc95-494e-aab3-02ca75111f74\") "
Aug 05 16:47:49.548914 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:49.548893    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/426e6b01-cc95-494e-aab3-02ca75111f74-kube-api-access-r5572" (OuterVolumeSpecName: "kube-api-access-r5572") pod "426e6b01-cc95-494e-aab3-02ca75111f74" (UID: "426e6b01-cc95-494e-aab3-02ca75111f74"). InnerVolumeSpecName "kube-api-access-r5572". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:47:49.648275 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:49.648249    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5572\" (UniqueName: \"kubernetes.io/projected/426e6b01-cc95-494e-aab3-02ca75111f74-kube-api-access-r5572\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:47:50.173150 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:50.173112    2565 generic.go:356] "Generic (PLEG): container finished" podID="426e6b01-cc95-494e-aab3-02ca75111f74" containerID="3a2a0ca97ccfe0ec7b51ce144e8ee099778ea6b875e72590781a0a118b9a1e90" exitCode=0
Aug 05 16:47:50.173512 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:50.173158    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-gbfh6"
Aug 05 16:47:50.173512 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:50.173191    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-gbfh6" event={"ID":"426e6b01-cc95-494e-aab3-02ca75111f74","Type":"ContainerDied","Data":"3a2a0ca97ccfe0ec7b51ce144e8ee099778ea6b875e72590781a0a118b9a1e90"}
Aug 05 16:47:50.173512 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:50.173235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-gbfh6" event={"ID":"426e6b01-cc95-494e-aab3-02ca75111f74","Type":"ContainerDied","Data":"8becd75d396a92b9875f875342d3eda4833ed8cbfbd16bea5c27b46a592b1416"}
Aug 05 16:47:50.173512 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:50.173255    2565 scope.go:117] "RemoveContainer" containerID="3a2a0ca97ccfe0ec7b51ce144e8ee099778ea6b875e72590781a0a118b9a1e90"
Aug 05 16:47:50.182578 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:50.182561    2565 scope.go:117] "RemoveContainer" containerID="3a2a0ca97ccfe0ec7b51ce144e8ee099778ea6b875e72590781a0a118b9a1e90"
Aug 05 16:47:50.182829 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:47:50.182810    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a2a0ca97ccfe0ec7b51ce144e8ee099778ea6b875e72590781a0a118b9a1e90\": container with ID starting with 3a2a0ca97ccfe0ec7b51ce144e8ee099778ea6b875e72590781a0a118b9a1e90 not found: ID does not exist" containerID="3a2a0ca97ccfe0ec7b51ce144e8ee099778ea6b875e72590781a0a118b9a1e90"
Aug 05 16:47:50.182900 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:50.182838    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a2a0ca97ccfe0ec7b51ce144e8ee099778ea6b875e72590781a0a118b9a1e90"} err="failed to get container status \"3a2a0ca97ccfe0ec7b51ce144e8ee099778ea6b875e72590781a0a118b9a1e90\": rpc error: code = NotFound desc = could not find container \"3a2a0ca97ccfe0ec7b51ce144e8ee099778ea6b875e72590781a0a118b9a1e90\": container with ID starting with 3a2a0ca97ccfe0ec7b51ce144e8ee099778ea6b875e72590781a0a118b9a1e90 not found: ID does not exist"
Aug 05 16:47:50.193028 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:50.193003    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-gbfh6"]
Aug 05 16:47:50.201251 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:50.201233    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-gbfh6"]
Aug 05 16:47:51.952228 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:51.952194    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="426e6b01-cc95-494e-aab3-02ca75111f74" path="/var/lib/kubelet/pods/426e6b01-cc95-494e-aab3-02ca75111f74/volumes"
Aug 05 16:47:54.059979 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.059946    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d85846748-9rmw2"]
Aug 05 16:47:54.060475 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.060458    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="426e6b01-cc95-494e-aab3-02ca75111f74" containerName="authorino"
Aug 05 16:47:54.060547 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.060477    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="426e6b01-cc95-494e-aab3-02ca75111f74" containerName="authorino"
Aug 05 16:47:54.060598 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.060574    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="426e6b01-cc95-494e-aab3-02ca75111f74" containerName="authorino"
Aug 05 16:47:54.064919 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.064901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d85846748-9rmw2"
Aug 05 16:47:54.068299 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.068274    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dcshl\""
Aug 05 16:47:54.068423 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.068405    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 05 16:47:54.069243 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.069228    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 05 16:47:54.077154 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.077127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c86766d-9b34-4aed-b617-489f715ae4dc-webhook-cert\") pod \"maas-controller-5d85846748-9rmw2\" (UID: \"2c86766d-9b34-4aed-b617-489f715ae4dc\") " pod="opendatahub/maas-controller-5d85846748-9rmw2"
Aug 05 16:47:54.077258 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.077178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfzb5\" (UniqueName: \"kubernetes.io/projected/2c86766d-9b34-4aed-b617-489f715ae4dc-kube-api-access-nfzb5\") pod \"maas-controller-5d85846748-9rmw2\" (UID: \"2c86766d-9b34-4aed-b617-489f715ae4dc\") " pod="opendatahub/maas-controller-5d85846748-9rmw2"
Aug 05 16:47:54.077957 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.077936    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d85846748-9rmw2"]
Aug 05 16:47:54.177865 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.177835    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfzb5\" (UniqueName: \"kubernetes.io/projected/2c86766d-9b34-4aed-b617-489f715ae4dc-kube-api-access-nfzb5\") pod \"maas-controller-5d85846748-9rmw2\" (UID: \"2c86766d-9b34-4aed-b617-489f715ae4dc\") " pod="opendatahub/maas-controller-5d85846748-9rmw2"
Aug 05 16:47:54.178033 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.177900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c86766d-9b34-4aed-b617-489f715ae4dc-webhook-cert\") pod \"maas-controller-5d85846748-9rmw2\" (UID: \"2c86766d-9b34-4aed-b617-489f715ae4dc\") " pod="opendatahub/maas-controller-5d85846748-9rmw2"
Aug 05 16:47:54.180183 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.180164    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c86766d-9b34-4aed-b617-489f715ae4dc-webhook-cert\") pod \"maas-controller-5d85846748-9rmw2\" (UID: \"2c86766d-9b34-4aed-b617-489f715ae4dc\") " pod="opendatahub/maas-controller-5d85846748-9rmw2"
Aug 05 16:47:54.186558 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.186527    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfzb5\" (UniqueName: \"kubernetes.io/projected/2c86766d-9b34-4aed-b617-489f715ae4dc-kube-api-access-nfzb5\") pod \"maas-controller-5d85846748-9rmw2\" (UID: \"2c86766d-9b34-4aed-b617-489f715ae4dc\") " pod="opendatahub/maas-controller-5d85846748-9rmw2"
Aug 05 16:47:54.260056 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.260028    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f7778ff75-bdsd2"]
Aug 05 16:47:54.263461 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.263447    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7778ff75-bdsd2"
Aug 05 16:47:54.278586 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.278558    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7778ff75-bdsd2"]
Aug 05 16:47:54.278704 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.278650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvb9z\" (UniqueName: \"kubernetes.io/projected/3cb14413-c7d1-4d10-bff3-430d09426ca7-kube-api-access-dvb9z\") pod \"maas-controller-7f7778ff75-bdsd2\" (UID: \"3cb14413-c7d1-4d10-bff3-430d09426ca7\") " pod="opendatahub/maas-controller-7f7778ff75-bdsd2"
Aug 05 16:47:54.278748 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.278710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3cb14413-c7d1-4d10-bff3-430d09426ca7-webhook-cert\") pod \"maas-controller-7f7778ff75-bdsd2\" (UID: \"3cb14413-c7d1-4d10-bff3-430d09426ca7\") " pod="opendatahub/maas-controller-7f7778ff75-bdsd2"
Aug 05 16:47:54.375754 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.375677    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d85846748-9rmw2"
Aug 05 16:47:54.379632 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.379614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvb9z\" (UniqueName: \"kubernetes.io/projected/3cb14413-c7d1-4d10-bff3-430d09426ca7-kube-api-access-dvb9z\") pod \"maas-controller-7f7778ff75-bdsd2\" (UID: \"3cb14413-c7d1-4d10-bff3-430d09426ca7\") " pod="opendatahub/maas-controller-7f7778ff75-bdsd2"
Aug 05 16:47:54.379714 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.379653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3cb14413-c7d1-4d10-bff3-430d09426ca7-webhook-cert\") pod \"maas-controller-7f7778ff75-bdsd2\" (UID: \"3cb14413-c7d1-4d10-bff3-430d09426ca7\") " pod="opendatahub/maas-controller-7f7778ff75-bdsd2"
Aug 05 16:47:54.381982 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.381953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3cb14413-c7d1-4d10-bff3-430d09426ca7-webhook-cert\") pod \"maas-controller-7f7778ff75-bdsd2\" (UID: \"3cb14413-c7d1-4d10-bff3-430d09426ca7\") " pod="opendatahub/maas-controller-7f7778ff75-bdsd2"
Aug 05 16:47:54.389070 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.389043    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvb9z\" (UniqueName: \"kubernetes.io/projected/3cb14413-c7d1-4d10-bff3-430d09426ca7-kube-api-access-dvb9z\") pod \"maas-controller-7f7778ff75-bdsd2\" (UID: \"3cb14413-c7d1-4d10-bff3-430d09426ca7\") " pod="opendatahub/maas-controller-7f7778ff75-bdsd2"
Aug 05 16:47:54.507908 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.507886    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d85846748-9rmw2"]
Aug 05 16:47:54.509912 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:47:54.509889    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c86766d_9b34_4aed_b617_489f715ae4dc.slice/crio-e17d28bf8079263df83974e4ffbd0c76dd1c1319c1e53bc4931c876da9e63378 WatchSource:0}: Error finding container e17d28bf8079263df83974e4ffbd0c76dd1c1319c1e53bc4931c876da9e63378: Status 404 returned error can't find the container with id e17d28bf8079263df83974e4ffbd0c76dd1c1319c1e53bc4931c876da9e63378
Aug 05 16:47:54.573039 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.573004    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7778ff75-bdsd2"
Aug 05 16:47:54.705480 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:54.705456    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7778ff75-bdsd2"]
Aug 05 16:47:54.707179 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:47:54.707148    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cb14413_c7d1_4d10_bff3_430d09426ca7.slice/crio-5658e6626c5fdab353101ba64b85b3e926ba93a7c695b3440c7090ddbfb7f003 WatchSource:0}: Error finding container 5658e6626c5fdab353101ba64b85b3e926ba93a7c695b3440c7090ddbfb7f003: Status 404 returned error can't find the container with id 5658e6626c5fdab353101ba64b85b3e926ba93a7c695b3440c7090ddbfb7f003
Aug 05 16:47:55.200824 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:55.200788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d85846748-9rmw2" event={"ID":"2c86766d-9b34-4aed-b617-489f715ae4dc","Type":"ContainerStarted","Data":"e17d28bf8079263df83974e4ffbd0c76dd1c1319c1e53bc4931c876da9e63378"}
Aug 05 16:47:55.202055 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:55.202034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7778ff75-bdsd2" event={"ID":"3cb14413-c7d1-4d10-bff3-430d09426ca7","Type":"ContainerStarted","Data":"5658e6626c5fdab353101ba64b85b3e926ba93a7c695b3440c7090ddbfb7f003"}
Aug 05 16:47:57.214802 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:57.214770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d85846748-9rmw2" event={"ID":"2c86766d-9b34-4aed-b617-489f715ae4dc","Type":"ContainerStarted","Data":"1ac7be086e57f2730e0f59172330ee350ae6ea4dd355fcfd35e3aaea02a4921f"}
Aug 05 16:47:57.215209 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:57.214876    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d85846748-9rmw2"
Aug 05 16:47:57.216497 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:57.216469    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7778ff75-bdsd2" event={"ID":"3cb14413-c7d1-4d10-bff3-430d09426ca7","Type":"ContainerStarted","Data":"dd5dae3546f7d3a2060d2751aabb3d2f87b688f007b5ae61cc07bbc035c4ca79"}
Aug 05 16:47:57.216590 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:57.216566    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f7778ff75-bdsd2"
Aug 05 16:47:57.236583 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:57.236541    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d85846748-9rmw2" podStartSLOduration=0.618110086 podStartE2EDuration="3.236525905s" totalImagesPullingTime="2.618415819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:47:57.234516311 +0000 UTC m=+549.816587967" watchObservedRunningTime="2026-08-05 16:47:57.236525905 +0000 UTC m=+549.818597560"
Aug 05 16:47:57.255013 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:47:57.254967    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f7778ff75-bdsd2" podStartSLOduration=0.82540907 podStartE2EDuration="3.2549502s" totalImagesPullingTime="2.42954113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:47:57.254021994 +0000 UTC m=+549.836093660" watchObservedRunningTime="2026-08-05 16:47:57.2549502 +0000 UTC m=+549.837021846"
Aug 05 16:48:08.223949 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:08.223918    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f7778ff75-bdsd2"
Aug 05 16:48:08.224366 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:08.223991    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d85846748-9rmw2"
Aug 05 16:48:08.307427 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:08.307397    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d85846748-9rmw2"]
Aug 05 16:48:08.307578 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:08.307556    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5d85846748-9rmw2" podUID="2c86766d-9b34-4aed-b617-489f715ae4dc" containerName="manager" containerID="cri-o://1ac7be086e57f2730e0f59172330ee350ae6ea4dd355fcfd35e3aaea02a4921f" gracePeriod=30
Aug 05 16:48:08.556510 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:08.556485    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d85846748-9rmw2"
Aug 05 16:48:08.584198 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:08.584170    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfzb5\" (UniqueName: \"kubernetes.io/projected/2c86766d-9b34-4aed-b617-489f715ae4dc-kube-api-access-nfzb5\") pod \"2c86766d-9b34-4aed-b617-489f715ae4dc\" (UID: \"2c86766d-9b34-4aed-b617-489f715ae4dc\") "
Aug 05 16:48:08.584327 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:08.584264    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c86766d-9b34-4aed-b617-489f715ae4dc-webhook-cert\") pod \"2c86766d-9b34-4aed-b617-489f715ae4dc\" (UID: \"2c86766d-9b34-4aed-b617-489f715ae4dc\") "
Aug 05 16:48:08.586345 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:08.586316    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c86766d-9b34-4aed-b617-489f715ae4dc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2c86766d-9b34-4aed-b617-489f715ae4dc" (UID: "2c86766d-9b34-4aed-b617-489f715ae4dc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:48:08.586465 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:08.586441    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c86766d-9b34-4aed-b617-489f715ae4dc-kube-api-access-nfzb5" (OuterVolumeSpecName: "kube-api-access-nfzb5") pod "2c86766d-9b34-4aed-b617-489f715ae4dc" (UID: "2c86766d-9b34-4aed-b617-489f715ae4dc"). InnerVolumeSpecName "kube-api-access-nfzb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:48:08.684832 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:08.684800    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c86766d-9b34-4aed-b617-489f715ae4dc-webhook-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:48:08.684832 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:08.684825    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfzb5\" (UniqueName: \"kubernetes.io/projected/2c86766d-9b34-4aed-b617-489f715ae4dc-kube-api-access-nfzb5\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:48:09.274654 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:09.274621    2565 generic.go:356] "Generic (PLEG): container finished" podID="2c86766d-9b34-4aed-b617-489f715ae4dc" containerID="1ac7be086e57f2730e0f59172330ee350ae6ea4dd355fcfd35e3aaea02a4921f" exitCode=0
Aug 05 16:48:09.275050 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:09.274668    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d85846748-9rmw2"
Aug 05 16:48:09.275050 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:09.274673    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d85846748-9rmw2" event={"ID":"2c86766d-9b34-4aed-b617-489f715ae4dc","Type":"ContainerDied","Data":"1ac7be086e57f2730e0f59172330ee350ae6ea4dd355fcfd35e3aaea02a4921f"}
Aug 05 16:48:09.275050 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:09.274769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d85846748-9rmw2" event={"ID":"2c86766d-9b34-4aed-b617-489f715ae4dc","Type":"ContainerDied","Data":"e17d28bf8079263df83974e4ffbd0c76dd1c1319c1e53bc4931c876da9e63378"}
Aug 05 16:48:09.275050 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:09.274792    2565 scope.go:117] "RemoveContainer" containerID="1ac7be086e57f2730e0f59172330ee350ae6ea4dd355fcfd35e3aaea02a4921f"
Aug 05 16:48:09.283788 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:09.283772    2565 scope.go:117] "RemoveContainer" containerID="1ac7be086e57f2730e0f59172330ee350ae6ea4dd355fcfd35e3aaea02a4921f"
Aug 05 16:48:09.284026 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:48:09.284007    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ac7be086e57f2730e0f59172330ee350ae6ea4dd355fcfd35e3aaea02a4921f\": container with ID starting with 1ac7be086e57f2730e0f59172330ee350ae6ea4dd355fcfd35e3aaea02a4921f not found: ID does not exist" containerID="1ac7be086e57f2730e0f59172330ee350ae6ea4dd355fcfd35e3aaea02a4921f"
Aug 05 16:48:09.284072 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:09.284034    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ac7be086e57f2730e0f59172330ee350ae6ea4dd355fcfd35e3aaea02a4921f"} err="failed to get container status \"1ac7be086e57f2730e0f59172330ee350ae6ea4dd355fcfd35e3aaea02a4921f\": rpc error: code = NotFound desc = could not find container \"1ac7be086e57f2730e0f59172330ee350ae6ea4dd355fcfd35e3aaea02a4921f\": container with ID starting with 1ac7be086e57f2730e0f59172330ee350ae6ea4dd355fcfd35e3aaea02a4921f not found: ID does not exist"
Aug 05 16:48:09.296784 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:09.296765    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d85846748-9rmw2"]
Aug 05 16:48:09.302046 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:09.302028    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5d85846748-9rmw2"]
Aug 05 16:48:09.951911 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:09.951882    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c86766d-9b34-4aed-b617-489f715ae4dc" path="/var/lib/kubelet/pods/2c86766d-9b34-4aed-b617-489f715ae4dc/volumes"
Aug 05 16:48:31.234345 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.234312    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm"]
Aug 05 16:48:31.234743 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.234623    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c86766d-9b34-4aed-b617-489f715ae4dc" containerName="manager"
Aug 05 16:48:31.234743 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.234633    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c86766d-9b34-4aed-b617-489f715ae4dc" containerName="manager"
Aug 05 16:48:31.234743 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.234688    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c86766d-9b34-4aed-b617-489f715ae4dc" containerName="manager"
Aug 05 16:48:31.244930 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.244909    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm"
Aug 05 16:48:31.247778 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.247748    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Aug 05 16:48:31.248451 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.248430    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8qnfg\""
Aug 05 16:48:31.249216 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.249198    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm"]
Aug 05 16:48:31.332647 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.332611    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-q5jnc"]
Aug 05 16:48:31.336407 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.336384    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-q5jnc"
Aug 05 16:48:31.348060 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.348036    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-q5jnc"]
Aug 05 16:48:31.355871 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.355846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a6e6249-af7f-4a70-bcdd-dee55a78aee3-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-qhbfm\" (UID: \"9a6e6249-af7f-4a70-bcdd-dee55a78aee3\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm"
Aug 05 16:48:31.355975 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.355916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf4dx\" (UniqueName: \"kubernetes.io/projected/9a6e6249-af7f-4a70-bcdd-dee55a78aee3-kube-api-access-rf4dx\") pod \"payload-pre-processing-687dbb6cf6-qhbfm\" (UID: \"9a6e6249-af7f-4a70-bcdd-dee55a78aee3\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm"
Aug 05 16:48:31.456987 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.456950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf4dx\" (UniqueName: \"kubernetes.io/projected/9a6e6249-af7f-4a70-bcdd-dee55a78aee3-kube-api-access-rf4dx\") pod \"payload-pre-processing-687dbb6cf6-qhbfm\" (UID: \"9a6e6249-af7f-4a70-bcdd-dee55a78aee3\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm"
Aug 05 16:48:31.456987 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.456990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/129fa8c6-36f6-4e83-8e1d-194d567e0215-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-q5jnc\" (UID: \"129fa8c6-36f6-4e83-8e1d-194d567e0215\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q5jnc"
Aug 05 16:48:31.457212 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.457043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a6e6249-af7f-4a70-bcdd-dee55a78aee3-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-qhbfm\" (UID: \"9a6e6249-af7f-4a70-bcdd-dee55a78aee3\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm"
Aug 05 16:48:31.457212 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.457076    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rchsq\" (UniqueName: \"kubernetes.io/projected/129fa8c6-36f6-4e83-8e1d-194d567e0215-kube-api-access-rchsq\") pod \"payload-processing-5cc6cd444b-q5jnc\" (UID: \"129fa8c6-36f6-4e83-8e1d-194d567e0215\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q5jnc"
Aug 05 16:48:31.457731 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.457709    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a6e6249-af7f-4a70-bcdd-dee55a78aee3-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-qhbfm\" (UID: \"9a6e6249-af7f-4a70-bcdd-dee55a78aee3\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm"
Aug 05 16:48:31.466271 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.466227    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf4dx\" (UniqueName: \"kubernetes.io/projected/9a6e6249-af7f-4a70-bcdd-dee55a78aee3-kube-api-access-rf4dx\") pod \"payload-pre-processing-687dbb6cf6-qhbfm\" (UID: \"9a6e6249-af7f-4a70-bcdd-dee55a78aee3\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm"
Aug 05 16:48:31.556720 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.556689    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm"
Aug 05 16:48:31.557945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.557917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/129fa8c6-36f6-4e83-8e1d-194d567e0215-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-q5jnc\" (UID: \"129fa8c6-36f6-4e83-8e1d-194d567e0215\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q5jnc"
Aug 05 16:48:31.558045 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.557970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rchsq\" (UniqueName: \"kubernetes.io/projected/129fa8c6-36f6-4e83-8e1d-194d567e0215-kube-api-access-rchsq\") pod \"payload-processing-5cc6cd444b-q5jnc\" (UID: \"129fa8c6-36f6-4e83-8e1d-194d567e0215\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q5jnc"
Aug 05 16:48:31.558589 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.558569    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/129fa8c6-36f6-4e83-8e1d-194d567e0215-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-q5jnc\" (UID: \"129fa8c6-36f6-4e83-8e1d-194d567e0215\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q5jnc"
Aug 05 16:48:31.567346 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.567325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rchsq\" (UniqueName: \"kubernetes.io/projected/129fa8c6-36f6-4e83-8e1d-194d567e0215-kube-api-access-rchsq\") pod \"payload-processing-5cc6cd444b-q5jnc\" (UID: \"129fa8c6-36f6-4e83-8e1d-194d567e0215\") " pod="openshift-ingress/payload-processing-5cc6cd444b-q5jnc"
Aug 05 16:48:31.647430 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.647391    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-q5jnc"
Aug 05 16:48:31.699171 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.699140    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm"]
Aug 05 16:48:31.702112 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:48:31.702071    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a6e6249_af7f_4a70_bcdd_dee55a78aee3.slice/crio-cce8bd7c7f48537807a565dd3d2fcc0a9745829de0e6cd4cdb688f4d3204115b WatchSource:0}: Error finding container cce8bd7c7f48537807a565dd3d2fcc0a9745829de0e6cd4cdb688f4d3204115b: Status 404 returned error can't find the container with id cce8bd7c7f48537807a565dd3d2fcc0a9745829de0e6cd4cdb688f4d3204115b
Aug 05 16:48:31.798678 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:31.798650    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-q5jnc"]
Aug 05 16:48:31.799626 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:48:31.799601    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod129fa8c6_36f6_4e83_8e1d_194d567e0215.slice/crio-73f908c6e33ae2214f2bb5c10543aa1d438568d4543e628655652b0d83b8db03 WatchSource:0}: Error finding container 73f908c6e33ae2214f2bb5c10543aa1d438568d4543e628655652b0d83b8db03: Status 404 returned error can't find the container with id 73f908c6e33ae2214f2bb5c10543aa1d438568d4543e628655652b0d83b8db03
Aug 05 16:48:32.384412 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:32.384371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-q5jnc" event={"ID":"129fa8c6-36f6-4e83-8e1d-194d567e0215","Type":"ContainerStarted","Data":"73f908c6e33ae2214f2bb5c10543aa1d438568d4543e628655652b0d83b8db03"}
Aug 05 16:48:32.386306 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:32.386250    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm" event={"ID":"9a6e6249-af7f-4a70-bcdd-dee55a78aee3","Type":"ContainerStarted","Data":"cce8bd7c7f48537807a565dd3d2fcc0a9745829de0e6cd4cdb688f4d3204115b"}
Aug 05 16:48:34.399079 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:34.399038    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-q5jnc" event={"ID":"129fa8c6-36f6-4e83-8e1d-194d567e0215","Type":"ContainerStarted","Data":"25cce06c44fd3fdb5ca221552f77f045a0858f14293ae925d273aecfd61824c2"}
Aug 05 16:48:34.399557 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:34.399227    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-q5jnc"
Aug 05 16:48:34.400589 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:34.400563    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm" event={"ID":"9a6e6249-af7f-4a70-bcdd-dee55a78aee3","Type":"ContainerStarted","Data":"cb4b8884e5694bc77e4315dbb9aa97c560cf4b7345dbe721a19373b40e2f1b43"}
Aug 05 16:48:34.400720 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:34.400618    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm"
Aug 05 16:48:34.419680 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:34.419622    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-q5jnc" podStartSLOduration=1.29337912 podStartE2EDuration="3.419605304s" totalImagesPullingTime="2.126226184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:48:34.41898412 +0000 UTC m=+587.001055802" watchObservedRunningTime="2026-08-05 16:48:34.419605304 +0000 UTC m=+587.001676954"
Aug 05 16:48:34.438078 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:34.438008    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm" podStartSLOduration=1.221268028 podStartE2EDuration="3.437986465s" totalImagesPullingTime="2.216718437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:48:34.437452202 +0000 UTC m=+587.019523860" watchObservedRunningTime="2026-08-05 16:48:34.437986465 +0000 UTC m=+587.020058126"
Aug 05 16:48:41.445084 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:41.445051    2565 generic.go:356] "Generic (PLEG): container finished" podID="b74ce519-2869-4fb6-8a25-546889825c39" containerID="d1c47f5af830e94f78b555d69a6cde666c2a3bc6f9e8d1804716bff8ee0e0b9e" exitCode=0
Aug 05 16:48:41.445084 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:41.445088    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m" event={"ID":"b74ce519-2869-4fb6-8a25-546889825c39","Type":"ContainerDied","Data":"d1c47f5af830e94f78b555d69a6cde666c2a3bc6f9e8d1804716bff8ee0e0b9e"}
Aug 05 16:48:41.445537 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:41.445464    2565 scope.go:117] "RemoveContainer" containerID="d1c47f5af830e94f78b555d69a6cde666c2a3bc6f9e8d1804716bff8ee0e0b9e"
Aug 05 16:48:41.446529 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:41.446497    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:48:41.446637 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:41.446586    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:48:41.446673 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:41.446646    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:48:41.963119 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:41.963069    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:48:42.452518 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:42.452482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m" event={"ID":"b74ce519-2869-4fb6-8a25-546889825c39","Type":"ContainerStarted","Data":"da7f9f1ac4cbe2802184b7a60954cd899fc5bbe27f6149ce7069bce35e1d9685"}
Aug 05 16:48:42.742976 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:42.742906    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:48:42.744022 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:42.743995    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vmm6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Aug 05 16:48:42.744135 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:42.744043    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m" podUID="b74ce519-2869-4fb6-8a25-546889825c39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Aug 05 16:48:43.743221 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:43.742718    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vmm6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Aug 05 16:48:43.743221 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:43.742818    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m" podUID="b74ce519-2869-4fb6-8a25-546889825c39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Aug 05 16:48:44.742895 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:44.742858    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vmm6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Aug 05 16:48:44.743196 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:44.743168    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m" podUID="b74ce519-2869-4fb6-8a25-546889825c39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Aug 05 16:48:45.408655 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.408625    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qhbfm"
Aug 05 16:48:45.409078 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.408710    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-q5jnc"
Aug 05 16:48:45.625704 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.625672    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"]
Aug 05 16:48:45.629036 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.629018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.631849 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.631828    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 05 16:48:45.632086 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.632064    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5pwrv\""
Aug 05 16:48:45.632225 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.632147    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Aug 05 16:48:45.632290 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.632240    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 05 16:48:45.663697 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.663620    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"]
Aug 05 16:48:45.693571 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.693544    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd63414e-d06d-454a-86ee-cd1548b47fee-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.693722 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.693578    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd63414e-d06d-454a-86ee-cd1548b47fee-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.693722 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.693601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd63414e-d06d-454a-86ee-cd1548b47fee-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.693843 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.693719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftl8h\" (UniqueName: \"kubernetes.io/projected/cd63414e-d06d-454a-86ee-cd1548b47fee-kube-api-access-ftl8h\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.693843 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.693766    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd63414e-d06d-454a-86ee-cd1548b47fee-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.693843 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.693820    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd63414e-d06d-454a-86ee-cd1548b47fee-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.748546 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.748511    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vmm6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Aug 05 16:48:45.748794 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.748764    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m" podUID="b74ce519-2869-4fb6-8a25-546889825c39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Aug 05 16:48:45.795046 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.795016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd63414e-d06d-454a-86ee-cd1548b47fee-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.795223 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.795056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd63414e-d06d-454a-86ee-cd1548b47fee-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.795223 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.795077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd63414e-d06d-454a-86ee-cd1548b47fee-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.795223 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.795117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd63414e-d06d-454a-86ee-cd1548b47fee-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.795223 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.795143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd63414e-d06d-454a-86ee-cd1548b47fee-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.795223 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.795195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftl8h\" (UniqueName: \"kubernetes.io/projected/cd63414e-d06d-454a-86ee-cd1548b47fee-kube-api-access-ftl8h\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.795528 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.795411    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd63414e-d06d-454a-86ee-cd1548b47fee-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.795590 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.795526    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd63414e-d06d-454a-86ee-cd1548b47fee-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.795638 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.795583    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd63414e-d06d-454a-86ee-cd1548b47fee-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.797341 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.797321    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd63414e-d06d-454a-86ee-cd1548b47fee-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.797598 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.797579    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd63414e-d06d-454a-86ee-cd1548b47fee-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.809308 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.809286    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftl8h\" (UniqueName: \"kubernetes.io/projected/cd63414e-d06d-454a-86ee-cd1548b47fee-kube-api-access-ftl8h\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6\" (UID: \"cd63414e-d06d-454a-86ee-cd1548b47fee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:45.971804 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:45.971716    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:46.133923 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:46.133842    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"]
Aug 05 16:48:46.161612 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:48:46.161563    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd63414e_d06d_454a_86ee_cd1548b47fee.slice/crio-541cdd1ac06d2081431dce46aa629d1b97552637a3fc84c4664267e8d839256c WatchSource:0}: Error finding container 541cdd1ac06d2081431dce46aa629d1b97552637a3fc84c4664267e8d839256c: Status 404 returned error can't find the container with id 541cdd1ac06d2081431dce46aa629d1b97552637a3fc84c4664267e8d839256c
Aug 05 16:48:46.477850 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:46.477814    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6" event={"ID":"cd63414e-d06d-454a-86ee-cd1548b47fee","Type":"ContainerStarted","Data":"541cdd1ac06d2081431dce46aa629d1b97552637a3fc84c4664267e8d839256c"}
Aug 05 16:48:46.742861 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:46.742768    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vmm6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Aug 05 16:48:46.742861 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:46.742836    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m" podUID="b74ce519-2869-4fb6-8a25-546889825c39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Aug 05 16:48:47.744500 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:47.744459    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vmm6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Aug 05 16:48:47.744975 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:47.744525    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m" podUID="b74ce519-2869-4fb6-8a25-546889825c39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Aug 05 16:48:48.490019 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:48.489980    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6" event={"ID":"cd63414e-d06d-454a-86ee-cd1548b47fee","Type":"ContainerStarted","Data":"f515220a8c6e6b1211050eb290871b14567e721169a757b8b516fe52a1f61843"}
Aug 05 16:48:48.510610 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:48.510563    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6" podStartSLOduration=1.617501058 podStartE2EDuration="3.510549085s" totalImagesPullingTime="1.893048027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:48:48.509369859 +0000 UTC m=+601.091441516" watchObservedRunningTime="2026-08-05 16:48:48.510549085 +0000 UTC m=+601.092620745"
Aug 05 16:48:48.899925 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:48.899893    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:48:48.900430 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:48.900387    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:48:48.932451 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:48.932420    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vmm6m"
Aug 05 16:48:55.972823 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:55.972786    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:55.973231 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:55.972858    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:55.985464 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:55.985440    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:48:56.543354 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:48:56.543324    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6"
Aug 05 16:49:00.092445 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.092414    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"]
Aug 05 16:49:00.096127 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.096085    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.098890 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.098869    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Aug 05 16:49:00.110316 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.110295    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"]
Aug 05 16:49:00.220305 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.220273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gch4\" (UniqueName: \"kubernetes.io/projected/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-kube-api-access-5gch4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.220471 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.220333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.220471 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.220358    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.220471 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.220399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.220471 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.220420    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.220471 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.220449    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.321767 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.321735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gch4\" (UniqueName: \"kubernetes.io/projected/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-kube-api-access-5gch4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.321945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.321792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.321945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.321819    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.321945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.321837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.321945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.321857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.321945 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.321893    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.322268 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.322249    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.322337 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.322314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.322377 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.322345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.324281 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.324258    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.324392 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.324327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.332682 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.332649    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gch4\" (UniqueName: \"kubernetes.io/projected/1aa51ae6-f5a7-4558-9c73-8ccebc744a4b-kube-api-access-5gch4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7jdtr\" (UID: \"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.406479 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.406409    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:00.538805 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.538782    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"]
Aug 05 16:49:00.541243 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:49:00.541216    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa51ae6_f5a7_4558_9c73_8ccebc744a4b.slice/crio-64fe5ee56f5f107e4787e7114739942eecdcc04cc8093751882d24bf0f95374e WatchSource:0}: Error finding container 64fe5ee56f5f107e4787e7114739942eecdcc04cc8093751882d24bf0f95374e: Status 404 returned error can't find the container with id 64fe5ee56f5f107e4787e7114739942eecdcc04cc8093751882d24bf0f95374e
Aug 05 16:49:00.542594 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.542576    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:49:00.550459 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:00.550435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr" event={"ID":"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b","Type":"ContainerStarted","Data":"64fe5ee56f5f107e4787e7114739942eecdcc04cc8093751882d24bf0f95374e"}
Aug 05 16:49:01.557737 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:01.557674    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr" event={"ID":"1aa51ae6-f5a7-4558-9c73-8ccebc744a4b","Type":"ContainerStarted","Data":"d96e31086ea350c60598e8b3f82ef22b1d01d3c053e606b72331ebeea6711125"}
Aug 05 16:49:01.584325 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:01.584274    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr" podStartSLOduration=1.2738534750000001 podStartE2EDuration="1.584258434s" totalImagesPullingTime="310.404959ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:49:01.582686043 +0000 UTC m=+614.164757702" watchObservedRunningTime="2026-08-05 16:49:01.584258434 +0000 UTC m=+614.166330115"
Aug 05 16:49:10.407026 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:10.406949    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:10.407026 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:10.407009    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:10.419143 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:10.419122    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:10.612115 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:10.612066    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7jdtr"
Aug 05 16:49:33.701149 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.701116    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"]
Aug 05 16:49:33.706227 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.706206    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.708743 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.708723    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Aug 05 16:49:33.717490 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.717467    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"]
Aug 05 16:49:33.802557 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.802521    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f703efcd-61a1-46a1-ba6d-2f08fa07e547-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.802722 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.802572    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f703efcd-61a1-46a1-ba6d-2f08fa07e547-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.802722 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.802587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f703efcd-61a1-46a1-ba6d-2f08fa07e547-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.802722 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.802606    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97wtz\" (UniqueName: \"kubernetes.io/projected/f703efcd-61a1-46a1-ba6d-2f08fa07e547-kube-api-access-97wtz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.802722 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.802688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f703efcd-61a1-46a1-ba6d-2f08fa07e547-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.802877 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.802754    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f703efcd-61a1-46a1-ba6d-2f08fa07e547-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.904051 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.904021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f703efcd-61a1-46a1-ba6d-2f08fa07e547-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.904227 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.904061    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f703efcd-61a1-46a1-ba6d-2f08fa07e547-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.904227 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.904078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f703efcd-61a1-46a1-ba6d-2f08fa07e547-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.904227 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.904114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97wtz\" (UniqueName: \"kubernetes.io/projected/f703efcd-61a1-46a1-ba6d-2f08fa07e547-kube-api-access-97wtz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.904227 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.904170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f703efcd-61a1-46a1-ba6d-2f08fa07e547-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.904431 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.904237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f703efcd-61a1-46a1-ba6d-2f08fa07e547-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.904487 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.904450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f703efcd-61a1-46a1-ba6d-2f08fa07e547-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.904573 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.904555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f703efcd-61a1-46a1-ba6d-2f08fa07e547-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.904647 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.904629    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f703efcd-61a1-46a1-ba6d-2f08fa07e547-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.906526 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.906492    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f703efcd-61a1-46a1-ba6d-2f08fa07e547-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.906681 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.906665    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f703efcd-61a1-46a1-ba6d-2f08fa07e547-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:33.912725 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:33.912707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97wtz\" (UniqueName: \"kubernetes.io/projected/f703efcd-61a1-46a1-ba6d-2f08fa07e547-kube-api-access-97wtz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dpqhq\" (UID: \"f703efcd-61a1-46a1-ba6d-2f08fa07e547\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:34.017940 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:34.017864    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:34.160731 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:34.160707    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"]
Aug 05 16:49:34.162564 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:49:34.162535    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf703efcd_61a1_46a1_ba6d_2f08fa07e547.slice/crio-74717cd1974d66d0dfe4808136400ef69998fa65306e4984f94fba81d967cc82 WatchSource:0}: Error finding container 74717cd1974d66d0dfe4808136400ef69998fa65306e4984f94fba81d967cc82: Status 404 returned error can't find the container with id 74717cd1974d66d0dfe4808136400ef69998fa65306e4984f94fba81d967cc82
Aug 05 16:49:34.719648 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:34.719554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq" event={"ID":"f703efcd-61a1-46a1-ba6d-2f08fa07e547","Type":"ContainerStarted","Data":"270ce59b1670af588ae6efcd2d62d3b02958a475d0ccb8e668d64c50e8393536"}
Aug 05 16:49:34.719648 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:34.719613    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq" event={"ID":"f703efcd-61a1-46a1-ba6d-2f08fa07e547","Type":"ContainerStarted","Data":"74717cd1974d66d0dfe4808136400ef69998fa65306e4984f94fba81d967cc82"}
Aug 05 16:49:34.739080 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:34.739024    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq" podStartSLOduration=1.51004204 podStartE2EDuration="1.739004726s" totalImagesPullingTime="228.962686ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:49:34.738742574 +0000 UTC m=+647.320814230" watchObservedRunningTime="2026-08-05 16:49:34.739004726 +0000 UTC m=+647.321076383"
Aug 05 16:49:44.018730 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:44.018693    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:44.019213 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:44.018754    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:44.031263 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:44.031243    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:49:44.781153 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:49:44.781117    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dpqhq"
Aug 05 16:50:21.234967 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.234930    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c6886bd7b-bwnhw"]
Aug 05 16:50:21.235575 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.235172    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6c6886bd7b-bwnhw" podUID="75e81ce1-ee06-492a-acba-6cfa103834b6" containerName="authorino" containerID="cri-o://8f7ca29c450537d97c24d9066f1872cf115527eef026ecf2cfb598e7a303a1fe" gracePeriod=30
Aug 05 16:50:21.478868 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.478846    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6886bd7b-bwnhw"
Aug 05 16:50:21.528199 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.528118    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75e81ce1-ee06-492a-acba-6cfa103834b6-tls-cert\") pod \"75e81ce1-ee06-492a-acba-6cfa103834b6\" (UID: \"75e81ce1-ee06-492a-acba-6cfa103834b6\") "
Aug 05 16:50:21.528362 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.528221    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fqnv\" (UniqueName: \"kubernetes.io/projected/75e81ce1-ee06-492a-acba-6cfa103834b6-kube-api-access-4fqnv\") pod \"75e81ce1-ee06-492a-acba-6cfa103834b6\" (UID: \"75e81ce1-ee06-492a-acba-6cfa103834b6\") "
Aug 05 16:50:21.530189 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.530152    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75e81ce1-ee06-492a-acba-6cfa103834b6-kube-api-access-4fqnv" (OuterVolumeSpecName: "kube-api-access-4fqnv") pod "75e81ce1-ee06-492a-acba-6cfa103834b6" (UID: "75e81ce1-ee06-492a-acba-6cfa103834b6"). InnerVolumeSpecName "kube-api-access-4fqnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:50:21.538373 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.538339    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75e81ce1-ee06-492a-acba-6cfa103834b6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "75e81ce1-ee06-492a-acba-6cfa103834b6" (UID: "75e81ce1-ee06-492a-acba-6cfa103834b6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:50:21.629670 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.629638    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fqnv\" (UniqueName: \"kubernetes.io/projected/75e81ce1-ee06-492a-acba-6cfa103834b6-kube-api-access-4fqnv\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:50:21.629670 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.629664    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/75e81ce1-ee06-492a-acba-6cfa103834b6-tls-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:50:21.962717 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.962688    2565 generic.go:356] "Generic (PLEG): container finished" podID="75e81ce1-ee06-492a-acba-6cfa103834b6" containerID="8f7ca29c450537d97c24d9066f1872cf115527eef026ecf2cfb598e7a303a1fe" exitCode=0
Aug 05 16:50:21.962851 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.962716    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6886bd7b-bwnhw"
Aug 05 16:50:21.962851 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.962759    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6886bd7b-bwnhw" event={"ID":"75e81ce1-ee06-492a-acba-6cfa103834b6","Type":"ContainerDied","Data":"8f7ca29c450537d97c24d9066f1872cf115527eef026ecf2cfb598e7a303a1fe"}
Aug 05 16:50:21.962851 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.962805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6886bd7b-bwnhw" event={"ID":"75e81ce1-ee06-492a-acba-6cfa103834b6","Type":"ContainerDied","Data":"5070dad63d0972fc7c0ce5bb6541ab4328b4ce379aba81e0cc63014ce86be011"}
Aug 05 16:50:21.962851 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.962823    2565 scope.go:117] "RemoveContainer" containerID="8f7ca29c450537d97c24d9066f1872cf115527eef026ecf2cfb598e7a303a1fe"
Aug 05 16:50:21.973279 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.973263    2565 scope.go:117] "RemoveContainer" containerID="8f7ca29c450537d97c24d9066f1872cf115527eef026ecf2cfb598e7a303a1fe"
Aug 05 16:50:21.973548 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:50:21.973522    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f7ca29c450537d97c24d9066f1872cf115527eef026ecf2cfb598e7a303a1fe\": container with ID starting with 8f7ca29c450537d97c24d9066f1872cf115527eef026ecf2cfb598e7a303a1fe not found: ID does not exist" containerID="8f7ca29c450537d97c24d9066f1872cf115527eef026ecf2cfb598e7a303a1fe"
Aug 05 16:50:21.973636 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.973552    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7ca29c450537d97c24d9066f1872cf115527eef026ecf2cfb598e7a303a1fe"} err="failed to get container status \"8f7ca29c450537d97c24d9066f1872cf115527eef026ecf2cfb598e7a303a1fe\": rpc error: code = NotFound desc = could not find container \"8f7ca29c450537d97c24d9066f1872cf115527eef026ecf2cfb598e7a303a1fe\": container with ID starting with 8f7ca29c450537d97c24d9066f1872cf115527eef026ecf2cfb598e7a303a1fe not found: ID does not exist"
Aug 05 16:50:21.988425 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.988400    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c6886bd7b-bwnhw"]
Aug 05 16:50:21.997023 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:21.997000    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c6886bd7b-bwnhw"]
Aug 05 16:50:23.952301 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:50:23.952271    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75e81ce1-ee06-492a-acba-6cfa103834b6" path="/var/lib/kubelet/pods/75e81ce1-ee06-492a-acba-6cfa103834b6/volumes"
Aug 05 16:51:08.866247 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:08.866209    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f7778ff75-bdsd2"]
Aug 05 16:51:08.866756 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:08.866567    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f7778ff75-bdsd2" podUID="3cb14413-c7d1-4d10-bff3-430d09426ca7" containerName="manager" containerID="cri-o://dd5dae3546f7d3a2060d2751aabb3d2f87b688f007b5ae61cc07bbc035c4ca79" gracePeriod=30
Aug 05 16:51:09.099368 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.099346    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7778ff75-bdsd2"
Aug 05 16:51:09.135446 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.135366    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3cb14413-c7d1-4d10-bff3-430d09426ca7-webhook-cert\") pod \"3cb14413-c7d1-4d10-bff3-430d09426ca7\" (UID: \"3cb14413-c7d1-4d10-bff3-430d09426ca7\") "
Aug 05 16:51:09.135446 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.135420    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvb9z\" (UniqueName: \"kubernetes.io/projected/3cb14413-c7d1-4d10-bff3-430d09426ca7-kube-api-access-dvb9z\") pod \"3cb14413-c7d1-4d10-bff3-430d09426ca7\" (UID: \"3cb14413-c7d1-4d10-bff3-430d09426ca7\") "
Aug 05 16:51:09.137462 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.137428    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cb14413-c7d1-4d10-bff3-430d09426ca7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3cb14413-c7d1-4d10-bff3-430d09426ca7" (UID: "3cb14413-c7d1-4d10-bff3-430d09426ca7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:51:09.137563 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.137479    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cb14413-c7d1-4d10-bff3-430d09426ca7-kube-api-access-dvb9z" (OuterVolumeSpecName: "kube-api-access-dvb9z") pod "3cb14413-c7d1-4d10-bff3-430d09426ca7" (UID: "3cb14413-c7d1-4d10-bff3-430d09426ca7"). InnerVolumeSpecName "kube-api-access-dvb9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:51:09.196001 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.195972    2565 generic.go:356] "Generic (PLEG): container finished" podID="3cb14413-c7d1-4d10-bff3-430d09426ca7" containerID="dd5dae3546f7d3a2060d2751aabb3d2f87b688f007b5ae61cc07bbc035c4ca79" exitCode=0
Aug 05 16:51:09.196172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.196017    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7778ff75-bdsd2"
Aug 05 16:51:09.196172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.196060    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7778ff75-bdsd2" event={"ID":"3cb14413-c7d1-4d10-bff3-430d09426ca7","Type":"ContainerDied","Data":"dd5dae3546f7d3a2060d2751aabb3d2f87b688f007b5ae61cc07bbc035c4ca79"}
Aug 05 16:51:09.196172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.196131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7778ff75-bdsd2" event={"ID":"3cb14413-c7d1-4d10-bff3-430d09426ca7","Type":"ContainerDied","Data":"5658e6626c5fdab353101ba64b85b3e926ba93a7c695b3440c7090ddbfb7f003"}
Aug 05 16:51:09.196172 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.196157    2565 scope.go:117] "RemoveContainer" containerID="dd5dae3546f7d3a2060d2751aabb3d2f87b688f007b5ae61cc07bbc035c4ca79"
Aug 05 16:51:09.204819 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.204800    2565 scope.go:117] "RemoveContainer" containerID="dd5dae3546f7d3a2060d2751aabb3d2f87b688f007b5ae61cc07bbc035c4ca79"
Aug 05 16:51:09.205055 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:51:09.205037    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd5dae3546f7d3a2060d2751aabb3d2f87b688f007b5ae61cc07bbc035c4ca79\": container with ID starting with dd5dae3546f7d3a2060d2751aabb3d2f87b688f007b5ae61cc07bbc035c4ca79 not found: ID does not exist" containerID="dd5dae3546f7d3a2060d2751aabb3d2f87b688f007b5ae61cc07bbc035c4ca79"
Aug 05 16:51:09.205144 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.205063    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd5dae3546f7d3a2060d2751aabb3d2f87b688f007b5ae61cc07bbc035c4ca79"} err="failed to get container status \"dd5dae3546f7d3a2060d2751aabb3d2f87b688f007b5ae61cc07bbc035c4ca79\": rpc error: code = NotFound desc = could not find container \"dd5dae3546f7d3a2060d2751aabb3d2f87b688f007b5ae61cc07bbc035c4ca79\": container with ID starting with dd5dae3546f7d3a2060d2751aabb3d2f87b688f007b5ae61cc07bbc035c4ca79 not found: ID does not exist"
Aug 05 16:51:09.218078 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.218052    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f7778ff75-bdsd2"]
Aug 05 16:51:09.222802 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.222782    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f7778ff75-bdsd2"]
Aug 05 16:51:09.236478 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.236456    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3cb14413-c7d1-4d10-bff3-430d09426ca7-webhook-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:51:09.236478 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.236475    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvb9z\" (UniqueName: \"kubernetes.io/projected/3cb14413-c7d1-4d10-bff3-430d09426ca7-kube-api-access-dvb9z\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:51:09.953001 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:51:09.952967    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cb14413-c7d1-4d10-bff3-430d09426ca7" path="/var/lib/kubelet/pods/3cb14413-c7d1-4d10-bff3-430d09426ca7/volumes"
Aug 05 16:52:10.059042 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.059008    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f7778ff75-2s6n9"]
Aug 05 16:52:10.059467 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.059362    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cb14413-c7d1-4d10-bff3-430d09426ca7" containerName="manager"
Aug 05 16:52:10.059467 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.059373    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cb14413-c7d1-4d10-bff3-430d09426ca7" containerName="manager"
Aug 05 16:52:10.059467 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.059383    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75e81ce1-ee06-492a-acba-6cfa103834b6" containerName="authorino"
Aug 05 16:52:10.059467 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.059389    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="75e81ce1-ee06-492a-acba-6cfa103834b6" containerName="authorino"
Aug 05 16:52:10.059467 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.059439    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="75e81ce1-ee06-492a-acba-6cfa103834b6" containerName="authorino"
Aug 05 16:52:10.059467 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.059447    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cb14413-c7d1-4d10-bff3-430d09426ca7" containerName="manager"
Aug 05 16:52:10.063549 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.063535    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7778ff75-2s6n9"
Aug 05 16:52:10.069079 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.069056    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 05 16:52:10.069079 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.069060    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dcshl\""
Aug 05 16:52:10.069297 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.069126    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 05 16:52:10.075248 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.075224    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7778ff75-2s6n9"]
Aug 05 16:52:10.142378 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.142347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzc2g\" (UniqueName: \"kubernetes.io/projected/03c5415f-d218-47f3-9de4-52a29eac3d84-kube-api-access-vzc2g\") pod \"maas-controller-7f7778ff75-2s6n9\" (UID: \"03c5415f-d218-47f3-9de4-52a29eac3d84\") " pod="opendatahub/maas-controller-7f7778ff75-2s6n9"
Aug 05 16:52:10.142507 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.142461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03c5415f-d218-47f3-9de4-52a29eac3d84-webhook-cert\") pod \"maas-controller-7f7778ff75-2s6n9\" (UID: \"03c5415f-d218-47f3-9de4-52a29eac3d84\") " pod="opendatahub/maas-controller-7f7778ff75-2s6n9"
Aug 05 16:52:10.243123 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.243059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03c5415f-d218-47f3-9de4-52a29eac3d84-webhook-cert\") pod \"maas-controller-7f7778ff75-2s6n9\" (UID: \"03c5415f-d218-47f3-9de4-52a29eac3d84\") " pod="opendatahub/maas-controller-7f7778ff75-2s6n9"
Aug 05 16:52:10.243219 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.243128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzc2g\" (UniqueName: \"kubernetes.io/projected/03c5415f-d218-47f3-9de4-52a29eac3d84-kube-api-access-vzc2g\") pod \"maas-controller-7f7778ff75-2s6n9\" (UID: \"03c5415f-d218-47f3-9de4-52a29eac3d84\") " pod="opendatahub/maas-controller-7f7778ff75-2s6n9"
Aug 05 16:52:10.245366 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.245340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03c5415f-d218-47f3-9de4-52a29eac3d84-webhook-cert\") pod \"maas-controller-7f7778ff75-2s6n9\" (UID: \"03c5415f-d218-47f3-9de4-52a29eac3d84\") " pod="opendatahub/maas-controller-7f7778ff75-2s6n9"
Aug 05 16:52:10.252862 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.252841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzc2g\" (UniqueName: \"kubernetes.io/projected/03c5415f-d218-47f3-9de4-52a29eac3d84-kube-api-access-vzc2g\") pod \"maas-controller-7f7778ff75-2s6n9\" (UID: \"03c5415f-d218-47f3-9de4-52a29eac3d84\") " pod="opendatahub/maas-controller-7f7778ff75-2s6n9"
Aug 05 16:52:10.373942 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.373870    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7778ff75-2s6n9"
Aug 05 16:52:10.508077 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:10.508051    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7778ff75-2s6n9"]
Aug 05 16:52:10.509152 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:52:10.509123    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c5415f_d218_47f3_9de4_52a29eac3d84.slice/crio-b6bf56cd82c8b2e6383d48f4ea74aab32d104f19099c53523e60e3f3d7245f9b WatchSource:0}: Error finding container b6bf56cd82c8b2e6383d48f4ea74aab32d104f19099c53523e60e3f3d7245f9b: Status 404 returned error can't find the container with id b6bf56cd82c8b2e6383d48f4ea74aab32d104f19099c53523e60e3f3d7245f9b
Aug 05 16:52:11.513833 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:11.513756    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7778ff75-2s6n9" event={"ID":"03c5415f-d218-47f3-9de4-52a29eac3d84","Type":"ContainerStarted","Data":"cdd3a52380c182b44c08504a89b3ee5b26ac1f1a8d0e7b176248353c45a5a6d7"}
Aug 05 16:52:11.513833 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:11.513805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7778ff75-2s6n9" event={"ID":"03c5415f-d218-47f3-9de4-52a29eac3d84","Type":"ContainerStarted","Data":"b6bf56cd82c8b2e6383d48f4ea74aab32d104f19099c53523e60e3f3d7245f9b"}
Aug 05 16:52:11.514239 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:11.513854    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f7778ff75-2s6n9"
Aug 05 16:52:11.536079 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:11.536035    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f7778ff75-2s6n9" podStartSLOduration=0.942138098 podStartE2EDuration="1.536021073s" totalImagesPullingTime="593.882975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:52:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:52:11.533913605 +0000 UTC m=+804.115985260" watchObservedRunningTime="2026-08-05 16:52:11.536021073 +0000 UTC m=+804.118092728"
Aug 05 16:52:22.521023 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:22.520991    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f7778ff75-2s6n9"
Aug 05 16:52:27.181866 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.181831    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f7778ff75-2s6n9"]
Aug 05 16:52:27.182263 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.182049    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f7778ff75-2s6n9" podUID="03c5415f-d218-47f3-9de4-52a29eac3d84" containerName="manager" containerID="cri-o://cdd3a52380c182b44c08504a89b3ee5b26ac1f1a8d0e7b176248353c45a5a6d7" gracePeriod=30
Aug 05 16:52:27.422692 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.422668    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7778ff75-2s6n9"
Aug 05 16:52:27.589632 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.589587    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzc2g\" (UniqueName: \"kubernetes.io/projected/03c5415f-d218-47f3-9de4-52a29eac3d84-kube-api-access-vzc2g\") pod \"03c5415f-d218-47f3-9de4-52a29eac3d84\" (UID: \"03c5415f-d218-47f3-9de4-52a29eac3d84\") "
Aug 05 16:52:27.589826 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.589646    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03c5415f-d218-47f3-9de4-52a29eac3d84-webhook-cert\") pod \"03c5415f-d218-47f3-9de4-52a29eac3d84\" (UID: \"03c5415f-d218-47f3-9de4-52a29eac3d84\") "
Aug 05 16:52:27.591683 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.591652    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03c5415f-d218-47f3-9de4-52a29eac3d84-kube-api-access-vzc2g" (OuterVolumeSpecName: "kube-api-access-vzc2g") pod "03c5415f-d218-47f3-9de4-52a29eac3d84" (UID: "03c5415f-d218-47f3-9de4-52a29eac3d84"). InnerVolumeSpecName "kube-api-access-vzc2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:52:27.591864 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.591847    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03c5415f-d218-47f3-9de4-52a29eac3d84-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "03c5415f-d218-47f3-9de4-52a29eac3d84" (UID: "03c5415f-d218-47f3-9de4-52a29eac3d84"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:52:27.595377 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.595355    2565 generic.go:356] "Generic (PLEG): container finished" podID="03c5415f-d218-47f3-9de4-52a29eac3d84" containerID="cdd3a52380c182b44c08504a89b3ee5b26ac1f1a8d0e7b176248353c45a5a6d7" exitCode=0
Aug 05 16:52:27.595705 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.595409    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7778ff75-2s6n9"
Aug 05 16:52:27.595705 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.595437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7778ff75-2s6n9" event={"ID":"03c5415f-d218-47f3-9de4-52a29eac3d84","Type":"ContainerDied","Data":"cdd3a52380c182b44c08504a89b3ee5b26ac1f1a8d0e7b176248353c45a5a6d7"}
Aug 05 16:52:27.595705 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.595501    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7778ff75-2s6n9" event={"ID":"03c5415f-d218-47f3-9de4-52a29eac3d84","Type":"ContainerDied","Data":"b6bf56cd82c8b2e6383d48f4ea74aab32d104f19099c53523e60e3f3d7245f9b"}
Aug 05 16:52:27.595705 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.595534    2565 scope.go:117] "RemoveContainer" containerID="cdd3a52380c182b44c08504a89b3ee5b26ac1f1a8d0e7b176248353c45a5a6d7"
Aug 05 16:52:27.610658 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.610638    2565 scope.go:117] "RemoveContainer" containerID="cdd3a52380c182b44c08504a89b3ee5b26ac1f1a8d0e7b176248353c45a5a6d7"
Aug 05 16:52:27.610924 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:52:27.610908    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdd3a52380c182b44c08504a89b3ee5b26ac1f1a8d0e7b176248353c45a5a6d7\": container with ID starting with cdd3a52380c182b44c08504a89b3ee5b26ac1f1a8d0e7b176248353c45a5a6d7 not found: ID does not exist" containerID="cdd3a52380c182b44c08504a89b3ee5b26ac1f1a8d0e7b176248353c45a5a6d7"
Aug 05 16:52:27.610975 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.610932    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdd3a52380c182b44c08504a89b3ee5b26ac1f1a8d0e7b176248353c45a5a6d7"} err="failed to get container status \"cdd3a52380c182b44c08504a89b3ee5b26ac1f1a8d0e7b176248353c45a5a6d7\": rpc error: code = NotFound desc = could not find container \"cdd3a52380c182b44c08504a89b3ee5b26ac1f1a8d0e7b176248353c45a5a6d7\": container with ID starting with cdd3a52380c182b44c08504a89b3ee5b26ac1f1a8d0e7b176248353c45a5a6d7 not found: ID does not exist"
Aug 05 16:52:27.621706 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.621686    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f7778ff75-2s6n9"]
Aug 05 16:52:27.625604 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.625584    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f7778ff75-2s6n9"]
Aug 05 16:52:27.690920 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.690863    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzc2g\" (UniqueName: \"kubernetes.io/projected/03c5415f-d218-47f3-9de4-52a29eac3d84-kube-api-access-vzc2g\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:52:27.690920 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.690888    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/03c5415f-d218-47f3-9de4-52a29eac3d84-webhook-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:52:27.953171 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:27.953083    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03c5415f-d218-47f3-9de4-52a29eac3d84" path="/var/lib/kubelet/pods/03c5415f-d218-47f3-9de4-52a29eac3d84/volumes"
Aug 05 16:52:28.475321 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.475295    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f7778ff75-27k4r"]
Aug 05 16:52:28.475682 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.475649    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03c5415f-d218-47f3-9de4-52a29eac3d84" containerName="manager"
Aug 05 16:52:28.475682 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.475660    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="03c5415f-d218-47f3-9de4-52a29eac3d84" containerName="manager"
Aug 05 16:52:28.475754 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.475720    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="03c5415f-d218-47f3-9de4-52a29eac3d84" containerName="manager"
Aug 05 16:52:28.480201 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.480183    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7778ff75-27k4r"
Aug 05 16:52:28.483748 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.483725    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dcshl\""
Aug 05 16:52:28.483882 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.483747    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 05 16:52:28.483882 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.483736    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 05 16:52:28.489796 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.489775    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7778ff75-27k4r"]
Aug 05 16:52:28.598543 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.598509    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8b65\" (UniqueName: \"kubernetes.io/projected/26cfd6af-ac2d-4419-9cb7-e4edbf6cf016-kube-api-access-v8b65\") pod \"maas-controller-7f7778ff75-27k4r\" (UID: \"26cfd6af-ac2d-4419-9cb7-e4edbf6cf016\") " pod="opendatahub/maas-controller-7f7778ff75-27k4r"
Aug 05 16:52:28.598717 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.598634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26cfd6af-ac2d-4419-9cb7-e4edbf6cf016-webhook-cert\") pod \"maas-controller-7f7778ff75-27k4r\" (UID: \"26cfd6af-ac2d-4419-9cb7-e4edbf6cf016\") " pod="opendatahub/maas-controller-7f7778ff75-27k4r"
Aug 05 16:52:28.699851 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.699821    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8b65\" (UniqueName: \"kubernetes.io/projected/26cfd6af-ac2d-4419-9cb7-e4edbf6cf016-kube-api-access-v8b65\") pod \"maas-controller-7f7778ff75-27k4r\" (UID: \"26cfd6af-ac2d-4419-9cb7-e4edbf6cf016\") " pod="opendatahub/maas-controller-7f7778ff75-27k4r"
Aug 05 16:52:28.700019 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.699884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26cfd6af-ac2d-4419-9cb7-e4edbf6cf016-webhook-cert\") pod \"maas-controller-7f7778ff75-27k4r\" (UID: \"26cfd6af-ac2d-4419-9cb7-e4edbf6cf016\") " pod="opendatahub/maas-controller-7f7778ff75-27k4r"
Aug 05 16:52:28.702214 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.702188    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26cfd6af-ac2d-4419-9cb7-e4edbf6cf016-webhook-cert\") pod \"maas-controller-7f7778ff75-27k4r\" (UID: \"26cfd6af-ac2d-4419-9cb7-e4edbf6cf016\") " pod="opendatahub/maas-controller-7f7778ff75-27k4r"
Aug 05 16:52:28.708695 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.708673    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8b65\" (UniqueName: \"kubernetes.io/projected/26cfd6af-ac2d-4419-9cb7-e4edbf6cf016-kube-api-access-v8b65\") pod \"maas-controller-7f7778ff75-27k4r\" (UID: \"26cfd6af-ac2d-4419-9cb7-e4edbf6cf016\") " pod="opendatahub/maas-controller-7f7778ff75-27k4r"
Aug 05 16:52:28.791136 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.791059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7778ff75-27k4r"
Aug 05 16:52:28.921152 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:28.921129    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7778ff75-27k4r"]
Aug 05 16:52:28.922979 ip-10-0-138-233 kubenswrapper[2565]: W0805 16:52:28.922952    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26cfd6af_ac2d_4419_9cb7_e4edbf6cf016.slice/crio-70579d7aa609f53bdfaf19f6f4dd36dbdc99dfef9ffd3ea8ca0fc91bb70b1029 WatchSource:0}: Error finding container 70579d7aa609f53bdfaf19f6f4dd36dbdc99dfef9ffd3ea8ca0fc91bb70b1029: Status 404 returned error can't find the container with id 70579d7aa609f53bdfaf19f6f4dd36dbdc99dfef9ffd3ea8ca0fc91bb70b1029
Aug 05 16:52:29.607574 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:29.607541    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7778ff75-27k4r" event={"ID":"26cfd6af-ac2d-4419-9cb7-e4edbf6cf016","Type":"ContainerStarted","Data":"7ed5187fbfd3ced8ebdcee042b34007f195147c5a48277a5c9b4b226c748552c"}
Aug 05 16:52:29.608033 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:29.607597    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7778ff75-27k4r" event={"ID":"26cfd6af-ac2d-4419-9cb7-e4edbf6cf016","Type":"ContainerStarted","Data":"70579d7aa609f53bdfaf19f6f4dd36dbdc99dfef9ffd3ea8ca0fc91bb70b1029"}
Aug 05 16:52:29.608033 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:29.607674    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f7778ff75-27k4r"
Aug 05 16:52:29.628177 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:29.628131    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f7778ff75-27k4r" podStartSLOduration=1.096591136 podStartE2EDuration="1.628118735s" totalImagesPullingTime="531.527599ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:52:29.625921175 +0000 UTC m=+822.207992979" watchObservedRunningTime="2026-08-05 16:52:29.628118735 +0000 UTC m=+822.210190385"
Aug 05 16:52:40.620139 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:52:40.620111    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f7778ff75-27k4r"
Aug 05 16:58:57.663063 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:57.663027    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"]
Aug 05 16:58:57.665765 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:57.663242    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk" podUID="c80e93de-485c-48a0-8288-93957a32d862" containerName="manager" containerID="cri-o://c4622f8ed97ceebd9cfd01ec0107bfbf62f55e319fe73d9ddff0e3d645f82bcf" gracePeriod=10
Aug 05 16:58:57.908205 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:57.908183    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"
Aug 05 16:58:58.026018 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:58.025942    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c80e93de-485c-48a0-8288-93957a32d862-extensions-socket-volume\") pod \"c80e93de-485c-48a0-8288-93957a32d862\" (UID: \"c80e93de-485c-48a0-8288-93957a32d862\") "
Aug 05 16:58:58.026018 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:58.025984    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwpxc\" (UniqueName: \"kubernetes.io/projected/c80e93de-485c-48a0-8288-93957a32d862-kube-api-access-xwpxc\") pod \"c80e93de-485c-48a0-8288-93957a32d862\" (UID: \"c80e93de-485c-48a0-8288-93957a32d862\") "
Aug 05 16:58:58.026311 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:58.026288    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c80e93de-485c-48a0-8288-93957a32d862-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c80e93de-485c-48a0-8288-93957a32d862" (UID: "c80e93de-485c-48a0-8288-93957a32d862"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:58:58.027910 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:58.027889    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c80e93de-485c-48a0-8288-93957a32d862-kube-api-access-xwpxc" (OuterVolumeSpecName: "kube-api-access-xwpxc") pod "c80e93de-485c-48a0-8288-93957a32d862" (UID: "c80e93de-485c-48a0-8288-93957a32d862"). InnerVolumeSpecName "kube-api-access-xwpxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:58:58.126951 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:58.126919    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c80e93de-485c-48a0-8288-93957a32d862-extensions-socket-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:58:58.126951 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:58.126946    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwpxc\" (UniqueName: \"kubernetes.io/projected/c80e93de-485c-48a0-8288-93957a32d862-kube-api-access-xwpxc\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 16:58:58.560086 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:58.560049    2565 generic.go:356] "Generic (PLEG): container finished" podID="c80e93de-485c-48a0-8288-93957a32d862" containerID="c4622f8ed97ceebd9cfd01ec0107bfbf62f55e319fe73d9ddff0e3d645f82bcf" exitCode=0
Aug 05 16:58:58.560299 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:58.560108    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"
Aug 05 16:58:58.560299 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:58.560138    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk" event={"ID":"c80e93de-485c-48a0-8288-93957a32d862","Type":"ContainerDied","Data":"c4622f8ed97ceebd9cfd01ec0107bfbf62f55e319fe73d9ddff0e3d645f82bcf"}
Aug 05 16:58:58.560299 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:58.560191    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk" event={"ID":"c80e93de-485c-48a0-8288-93957a32d862","Type":"ContainerDied","Data":"b2f3905526ae6c0691f522475088ac99d7ca16a51409fe989edf327447774331"}
Aug 05 16:58:58.560299 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:58.560214    2565 scope.go:117] "RemoveContainer" containerID="c4622f8ed97ceebd9cfd01ec0107bfbf62f55e319fe73d9ddff0e3d645f82bcf"
Aug 05 16:58:58.570443 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:58.570424    2565 scope.go:117] "RemoveContainer" containerID="c4622f8ed97ceebd9cfd01ec0107bfbf62f55e319fe73d9ddff0e3d645f82bcf"
Aug 05 16:58:58.570673 ip-10-0-138-233 kubenswrapper[2565]: E0805 16:58:58.570655    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4622f8ed97ceebd9cfd01ec0107bfbf62f55e319fe73d9ddff0e3d645f82bcf\": container with ID starting with c4622f8ed97ceebd9cfd01ec0107bfbf62f55e319fe73d9ddff0e3d645f82bcf not found: ID does not exist" containerID="c4622f8ed97ceebd9cfd01ec0107bfbf62f55e319fe73d9ddff0e3d645f82bcf"
Aug 05 16:58:58.570721 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:58.570683    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4622f8ed97ceebd9cfd01ec0107bfbf62f55e319fe73d9ddff0e3d645f82bcf"} err="failed to get container status \"c4622f8ed97ceebd9cfd01ec0107bfbf62f55e319fe73d9ddff0e3d645f82bcf\": rpc error: code = NotFound desc = could not find container \"c4622f8ed97ceebd9cfd01ec0107bfbf62f55e319fe73d9ddff0e3d645f82bcf\": container with ID starting with c4622f8ed97ceebd9cfd01ec0107bfbf62f55e319fe73d9ddff0e3d645f82bcf not found: ID does not exist"
Aug 05 16:58:58.584006 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:58.583988    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"]
Aug 05 16:58:58.589134 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:58.589115    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-8bjlk"]
Aug 05 16:58:59.952849 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:58:59.952815    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c80e93de-485c-48a0-8288-93957a32d862" path="/var/lib/kubelet/pods/c80e93de-485c-48a0-8288-93957a32d862/volumes"
Aug 05 16:59:58.421578 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:58.421530    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"]
Aug 05 16:59:58.422025 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:58.421894    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c80e93de-485c-48a0-8288-93957a32d862" containerName="manager"
Aug 05 16:59:58.422025 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:58.421905    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c80e93de-485c-48a0-8288-93957a32d862" containerName="manager"
Aug 05 16:59:58.422025 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:58.421964    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c80e93de-485c-48a0-8288-93957a32d862" containerName="manager"
Aug 05 16:59:58.425357 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:58.425341    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"
Aug 05 16:59:58.429495 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:58.429474    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-69w5h\""
Aug 05 16:59:58.442822 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:58.442803    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"]
Aug 05 16:59:58.507747 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:58.507722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwr8f\" (UniqueName: \"kubernetes.io/projected/8775deea-6203-4dc8-8689-0a5ef3dfdb10-kube-api-access-rwr8f\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-knrnh\" (UID: \"8775deea-6203-4dc8-8689-0a5ef3dfdb10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"
Aug 05 16:59:58.507888 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:58.507788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8775deea-6203-4dc8-8689-0a5ef3dfdb10-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-knrnh\" (UID: \"8775deea-6203-4dc8-8689-0a5ef3dfdb10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"
Aug 05 16:59:58.609215 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:58.609180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwr8f\" (UniqueName: \"kubernetes.io/projected/8775deea-6203-4dc8-8689-0a5ef3dfdb10-kube-api-access-rwr8f\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-knrnh\" (UID: \"8775deea-6203-4dc8-8689-0a5ef3dfdb10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"
Aug 05 16:59:58.609390 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:58.609266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8775deea-6203-4dc8-8689-0a5ef3dfdb10-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-knrnh\" (UID: \"8775deea-6203-4dc8-8689-0a5ef3dfdb10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"
Aug 05 16:59:58.609651 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:58.609630    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8775deea-6203-4dc8-8689-0a5ef3dfdb10-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-knrnh\" (UID: \"8775deea-6203-4dc8-8689-0a5ef3dfdb10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"
Aug 05 16:59:58.619413 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:58.619392    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwr8f\" (UniqueName: \"kubernetes.io/projected/8775deea-6203-4dc8-8689-0a5ef3dfdb10-kube-api-access-rwr8f\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-knrnh\" (UID: \"8775deea-6203-4dc8-8689-0a5ef3dfdb10\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"
Aug 05 16:59:58.735489 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:58.735408    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"
Aug 05 16:59:58.885397 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:58.884399    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"]
Aug 05 16:59:59.871256 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:59.871218    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh" event={"ID":"8775deea-6203-4dc8-8689-0a5ef3dfdb10","Type":"ContainerStarted","Data":"948ce646c99e2de3a6f74de260b9a9eb4a9f3754e6b80d8f346a26f9ad07d105"}
Aug 05 16:59:59.871668 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:59.871280    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh" event={"ID":"8775deea-6203-4dc8-8689-0a5ef3dfdb10","Type":"ContainerStarted","Data":"8ce17da52e519dc49f9b02877b9e89d2184c93030968a9064ee49ef409210d59"}
Aug 05 16:59:59.871668 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:59.871407    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"
Aug 05 16:59:59.898453 ip-10-0-138-233 kubenswrapper[2565]: I0805 16:59:59.898404    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh" podStartSLOduration=1.898388441 podStartE2EDuration="1.898388441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:59:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:59:59.895000783 +0000 UTC m=+1272.477072438" watchObservedRunningTime="2026-08-05 16:59:59.898388441 +0000 UTC m=+1272.480460096"
Aug 05 17:00:00.157323 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:00:00.157240    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765820-pwxgn"]
Aug 05 17:00:00.160727 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:00:00.160710    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-pwxgn"
Aug 05 17:00:00.163682 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:00:00.163666    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:00:00.170999 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:00:00.170978    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-pwxgn"
Aug 05 17:00:00.172394 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:00:00.172367    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765820-pwxgn"]
Aug 05 17:00:00.312532 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:00:00.312508    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765820-pwxgn"]
Aug 05 17:00:00.314300 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:00:00.314274    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9cdc316_13cd_45c7_885f_6ee856e88ec4.slice/crio-082c2c39cd5c3642a3ad1b44aa9b0263369db10b1575082ea1ae87b0236175a5 WatchSource:0}: Error finding container 082c2c39cd5c3642a3ad1b44aa9b0263369db10b1575082ea1ae87b0236175a5: Status 404 returned error can't find the container with id 082c2c39cd5c3642a3ad1b44aa9b0263369db10b1575082ea1ae87b0236175a5
Aug 05 17:00:00.316152 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:00:00.316137    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:00:00.877965 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:00:00.877931    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-pwxgn" event={"ID":"f9cdc316-13cd-45c7-885f-6ee856e88ec4","Type":"ContainerStarted","Data":"082c2c39cd5c3642a3ad1b44aa9b0263369db10b1575082ea1ae87b0236175a5"}
Aug 05 17:00:03.894829 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:00:03.894792    2565 generic.go:356] "Generic (PLEG): container finished" podID="f9cdc316-13cd-45c7-885f-6ee856e88ec4" containerID="6a521de8b5d28bc23c4427b3c9c96eacde607aa55521a3ed05491d4c6d22449a" exitCode=0
Aug 05 17:00:03.895314 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:00:03.894877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-pwxgn" event={"ID":"f9cdc316-13cd-45c7-885f-6ee856e88ec4","Type":"ContainerDied","Data":"6a521de8b5d28bc23c4427b3c9c96eacde607aa55521a3ed05491d4c6d22449a"}
Aug 05 17:00:05.036682 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:00:05.036648    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-pwxgn"
Aug 05 17:00:05.906324 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:00:05.906288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-pwxgn" event={"ID":"f9cdc316-13cd-45c7-885f-6ee856e88ec4","Type":"ContainerDied","Data":"082c2c39cd5c3642a3ad1b44aa9b0263369db10b1575082ea1ae87b0236175a5"}
Aug 05 17:00:05.906497 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:00:05.906341    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="082c2c39cd5c3642a3ad1b44aa9b0263369db10b1575082ea1ae87b0236175a5"
Aug 05 17:00:05.906497 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:00:05.906308    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765820-pwxgn"
Aug 05 17:00:10.881075 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:00:10.881046    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"
Aug 05 17:03:19.638716 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.638678    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"]
Aug 05 17:03:19.639340 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.639077    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9cdc316-13cd-45c7-885f-6ee856e88ec4" containerName="cleanup"
Aug 05 17:03:19.639340 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.639091    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9cdc316-13cd-45c7-885f-6ee856e88ec4" containerName="cleanup"
Aug 05 17:03:19.639340 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.639167    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9cdc316-13cd-45c7-885f-6ee856e88ec4" containerName="cleanup"
Aug 05 17:03:19.642224 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.642203    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.648248 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.648222    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-707ffd07-kserve-self-signed-certs\""
Aug 05 17:03:19.673646 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.673619    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"]
Aug 05 17:03:19.727422 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.727396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bfd6d42-8727-43af-927b-e17b9ae6693d-tls-certs\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.727543 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.727435    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds9jn\" (UniqueName: \"kubernetes.io/projected/2bfd6d42-8727-43af-927b-e17b9ae6693d-kube-api-access-ds9jn\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.727543 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.727453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-dshm\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.727543 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.727517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-home\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.727678 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.727549    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-model-cache\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.727678 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.727581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-tmp-dir\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.828929 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.828897    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bfd6d42-8727-43af-927b-e17b9ae6693d-tls-certs\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.829085 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.828939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds9jn\" (UniqueName: \"kubernetes.io/projected/2bfd6d42-8727-43af-927b-e17b9ae6693d-kube-api-access-ds9jn\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.829085 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.828960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-dshm\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.829085 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.828993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-home\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.829085 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.829022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-model-cache\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.829085 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.829044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-tmp-dir\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.829470 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.829439    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-model-cache\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.829545 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.829469    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-home\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.829545 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.829482    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-tmp-dir\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.831303 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.831279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-dshm\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.831442 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.831428    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bfd6d42-8727-43af-927b-e17b9ae6693d-tls-certs\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.840669 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.840644    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds9jn\" (UniqueName: \"kubernetes.io/projected/2bfd6d42-8727-43af-927b-e17b9ae6693d-kube-api-access-ds9jn\") pod \"e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") " pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:19.952291 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:19.952207    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:20.091488 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:20.091462    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"]
Aug 05 17:03:20.092273 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:03:20.092250    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bfd6d42_8727_43af_927b_e17b9ae6693d.slice/crio-b99220730984dafb6a6280126a65f234bfc5560b38f8b7aee33096ee62b5d923 WatchSource:0}: Error finding container b99220730984dafb6a6280126a65f234bfc5560b38f8b7aee33096ee62b5d923: Status 404 returned error can't find the container with id b99220730984dafb6a6280126a65f234bfc5560b38f8b7aee33096ee62b5d923
Aug 05 17:03:20.895839 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:20.895801    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt" event={"ID":"2bfd6d42-8727-43af-927b-e17b9ae6693d","Type":"ContainerStarted","Data":"95b2155b20923db174e8d9225bcc4b5bca9bec7d0a3eda108bb308f31ddec7d2"}
Aug 05 17:03:20.895839 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:20.895845    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt" event={"ID":"2bfd6d42-8727-43af-927b-e17b9ae6693d","Type":"ContainerStarted","Data":"b99220730984dafb6a6280126a65f234bfc5560b38f8b7aee33096ee62b5d923"}
Aug 05 17:03:20.916634 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:20.916587    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt" podStartSLOduration=1.916572157 podStartE2EDuration="1.916572157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:03:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:03:20.914301461 +0000 UTC m=+1473.496373117" watchObservedRunningTime="2026-08-05 17:03:20.916572157 +0000 UTC m=+1473.498643813"
Aug 05 17:03:29.952515 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:29.952438    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:29.952515 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:29.952484    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:29.964950 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:29.964925    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:30.957675 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:30.957644    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:03:51.874192 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:03:51.874153    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"]
Aug 05 17:04:06.892889 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:06.892830    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt" podUID="2bfd6d42-8727-43af-927b-e17b9ae6693d" containerName="main" containerID="cri-o://95b2155b20923db174e8d9225bcc4b5bca9bec7d0a3eda108bb308f31ddec7d2" gracePeriod=45
Aug 05 17:04:07.127270 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.127241    2565 generic.go:356] "Generic (PLEG): container finished" podID="2bfd6d42-8727-43af-927b-e17b9ae6693d" containerID="95b2155b20923db174e8d9225bcc4b5bca9bec7d0a3eda108bb308f31ddec7d2" exitCode=0
Aug 05 17:04:07.127378 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.127318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt" event={"ID":"2bfd6d42-8727-43af-927b-e17b9ae6693d","Type":"ContainerDied","Data":"95b2155b20923db174e8d9225bcc4b5bca9bec7d0a3eda108bb308f31ddec7d2"}
Aug 05 17:04:07.141403 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.141378    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:04:07.248337 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.248267    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-tmp-dir\") pod \"2bfd6d42-8727-43af-927b-e17b9ae6693d\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") "
Aug 05 17:04:07.248337 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.248308    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bfd6d42-8727-43af-927b-e17b9ae6693d-tls-certs\") pod \"2bfd6d42-8727-43af-927b-e17b9ae6693d\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") "
Aug 05 17:04:07.248337 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.248328    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds9jn\" (UniqueName: \"kubernetes.io/projected/2bfd6d42-8727-43af-927b-e17b9ae6693d-kube-api-access-ds9jn\") pod \"2bfd6d42-8727-43af-927b-e17b9ae6693d\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") "
Aug 05 17:04:07.248623 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.248355    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-home\") pod \"2bfd6d42-8727-43af-927b-e17b9ae6693d\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") "
Aug 05 17:04:07.248623 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.248431    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-model-cache\") pod \"2bfd6d42-8727-43af-927b-e17b9ae6693d\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") "
Aug 05 17:04:07.248623 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.248463    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-dshm\") pod \"2bfd6d42-8727-43af-927b-e17b9ae6693d\" (UID: \"2bfd6d42-8727-43af-927b-e17b9ae6693d\") "
Aug 05 17:04:07.248623 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.248590    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2bfd6d42-8727-43af-927b-e17b9ae6693d" (UID: "2bfd6d42-8727-43af-927b-e17b9ae6693d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:04:07.248851 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.248731    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-tmp-dir\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:04:07.248980 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.248951    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-home" (OuterVolumeSpecName: "home") pod "2bfd6d42-8727-43af-927b-e17b9ae6693d" (UID: "2bfd6d42-8727-43af-927b-e17b9ae6693d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:04:07.248980 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.248967    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-model-cache" (OuterVolumeSpecName: "model-cache") pod "2bfd6d42-8727-43af-927b-e17b9ae6693d" (UID: "2bfd6d42-8727-43af-927b-e17b9ae6693d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:04:07.250574 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.250547    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bfd6d42-8727-43af-927b-e17b9ae6693d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2bfd6d42-8727-43af-927b-e17b9ae6693d" (UID: "2bfd6d42-8727-43af-927b-e17b9ae6693d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:04:07.250896 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.250872    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-dshm" (OuterVolumeSpecName: "dshm") pod "2bfd6d42-8727-43af-927b-e17b9ae6693d" (UID: "2bfd6d42-8727-43af-927b-e17b9ae6693d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:04:07.250969 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.250873    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bfd6d42-8727-43af-927b-e17b9ae6693d-kube-api-access-ds9jn" (OuterVolumeSpecName: "kube-api-access-ds9jn") pod "2bfd6d42-8727-43af-927b-e17b9ae6693d" (UID: "2bfd6d42-8727-43af-927b-e17b9ae6693d"). InnerVolumeSpecName "kube-api-access-ds9jn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:04:07.349715 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.349687    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-model-cache\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:04:07.349715 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.349711    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-dshm\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:04:07.349715 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.349721    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bfd6d42-8727-43af-927b-e17b9ae6693d-tls-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:04:07.349897 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.349730    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds9jn\" (UniqueName: \"kubernetes.io/projected/2bfd6d42-8727-43af-927b-e17b9ae6693d-kube-api-access-ds9jn\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:04:07.349897 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:07.349738    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bfd6d42-8727-43af-927b-e17b9ae6693d-home\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:04:08.133903 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:08.133870    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"
Aug 05 17:04:08.133903 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:08.133887    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt" event={"ID":"2bfd6d42-8727-43af-927b-e17b9ae6693d","Type":"ContainerDied","Data":"b99220730984dafb6a6280126a65f234bfc5560b38f8b7aee33096ee62b5d923"}
Aug 05 17:04:08.134395 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:08.133938    2565 scope.go:117] "RemoveContainer" containerID="95b2155b20923db174e8d9225bcc4b5bca9bec7d0a3eda108bb308f31ddec7d2"
Aug 05 17:04:08.157849 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:08.157819    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"]
Aug 05 17:04:08.168481 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:08.168455    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-707ffd07-kserve-9b8796fc5-brpvt"]
Aug 05 17:04:09.952542 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:04:09.952505    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bfd6d42-8727-43af-927b-e17b9ae6693d" path="/var/lib/kubelet/pods/2bfd6d42-8727-43af-927b-e17b9ae6693d/volumes"
Aug 05 17:07:57.800900 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.800865    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"]
Aug 05 17:07:57.801447 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.801283    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bfd6d42-8727-43af-927b-e17b9ae6693d" containerName="main"
Aug 05 17:07:57.801447 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.801296    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bfd6d42-8727-43af-927b-e17b9ae6693d" containerName="main"
Aug 05 17:07:57.801447 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.801372    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bfd6d42-8727-43af-927b-e17b9ae6693d" containerName="main"
Aug 05 17:07:57.804455 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.804437    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.807325 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.807300    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-fba92dbb-openshift-default-dockercfg-8v9l4\""
Aug 05 17:07:57.839322 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.839286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-istio-envoy\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.839492 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.839333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-workload-socket\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.839492 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.839360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ea53cb-8157-4253-9720-628c4cda2614-istio-token\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.839492 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.839386    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-workload-certs\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.839492 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.839409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mr9t\" (UniqueName: \"kubernetes.io/projected/b0ea53cb-8157-4253-9720-628c4cda2614-kube-api-access-5mr9t\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.839492 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.839481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-istio-data\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.839705 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.839498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ea53cb-8157-4253-9720-628c4cda2614-istiod-ca-cert\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.839705 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.839561    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ea53cb-8157-4253-9720-628c4cda2614-istio-podinfo\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.839705 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.839631    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-credential-socket\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.874437 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.874397    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"]
Aug 05 17:07:57.940241 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.940201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-workload-socket\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.940241 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.940243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ea53cb-8157-4253-9720-628c4cda2614-istio-token\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.940499 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.940269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-workload-certs\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.940499 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.940293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mr9t\" (UniqueName: \"kubernetes.io/projected/b0ea53cb-8157-4253-9720-628c4cda2614-kube-api-access-5mr9t\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.940499 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.940347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-istio-data\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.940499 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.940363    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ea53cb-8157-4253-9720-628c4cda2614-istiod-ca-cert\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.940499 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.940392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ea53cb-8157-4253-9720-628c4cda2614-istio-podinfo\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.940499 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.940420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-credential-socket\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.940499 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.940453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-istio-envoy\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.940903 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.940659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-workload-socket\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.940903 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.940674    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-workload-certs\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.941170 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.941148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-credential-socket\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.941263 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.941172    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-istio-data\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.941263 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.941244    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ea53cb-8157-4253-9720-628c4cda2614-istiod-ca-cert\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.942852 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.942833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-istio-envoy\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.942941 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.942923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ea53cb-8157-4253-9720-628c4cda2614-istio-podinfo\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.955634 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.955598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mr9t\" (UniqueName: \"kubernetes.io/projected/b0ea53cb-8157-4253-9720-628c4cda2614-kube-api-access-5mr9t\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:57.955781 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:57.955634    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ea53cb-8157-4253-9720-628c4cda2614-istio-token\") pod \"e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") " pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:58.115326 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:58.115225    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:07:58.274575 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:58.274548    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"]
Aug 05 17:07:58.275602 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:07:58.275573    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ea53cb_8157_4253_9720_628c4cda2614.slice/crio-c32ab793ed66280c65a1e9a639c90a2b8ae1f36c1f70499fccb0a6a653f63f48 WatchSource:0}: Error finding container c32ab793ed66280c65a1e9a639c90a2b8ae1f36c1f70499fccb0a6a653f63f48: Status 404 returned error can't find the container with id c32ab793ed66280c65a1e9a639c90a2b8ae1f36c1f70499fccb0a6a653f63f48
Aug 05 17:07:58.277589 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:58.277560    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:07:58.277696 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:58.277630    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:07:58.277696 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:58.277678    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:07:58.309707 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:58.309670    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2" event={"ID":"b0ea53cb-8157-4253-9720-628c4cda2614","Type":"ContainerStarted","Data":"c32ab793ed66280c65a1e9a639c90a2b8ae1f36c1f70499fccb0a6a653f63f48"}
Aug 05 17:07:59.316523 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:59.316488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2" event={"ID":"b0ea53cb-8157-4253-9720-628c4cda2614","Type":"ContainerStarted","Data":"45f80a64f21e6b40f805446ea2ba9727f7f2aec719c7ecfe8008c96614fc0615"}
Aug 05 17:07:59.346906 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:07:59.346845    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2" podStartSLOduration=2.346830313 podStartE2EDuration="2.346830313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:07:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:07:59.346377856 +0000 UTC m=+1751.928449512" watchObservedRunningTime="2026-08-05 17:07:59.346830313 +0000 UTC m=+1751.928901968"
Aug 05 17:08:00.115822 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:00.115777    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:08:00.120967 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:00.120942    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:08:00.321422 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:00.321385    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:08:00.322470 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:00.322449    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:08:02.899909 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:02.899871    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"]
Aug 05 17:08:02.903462 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:02.903446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"
Aug 05 17:08:02.906542 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:02.906520    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-fba92dbb-dockercfg-czm54\""
Aug 05 17:08:02.906542 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:02.906533    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-fba92dbb\""
Aug 05 17:08:02.915964 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:02.915941    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"]
Aug 05 17:08:02.986087 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:02.986057    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtb4f\" (UniqueName: \"kubernetes.io/projected/44320e64-c03f-4a86-8e1a-f83a5c15a1d4-kube-api-access-jtb4f\") pod \"payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk\" (UID: \"44320e64-c03f-4a86-8e1a-f83a5c15a1d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"
Aug 05 17:08:02.986287 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:02.986185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44320e64-c03f-4a86-8e1a-f83a5c15a1d4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk\" (UID: \"44320e64-c03f-4a86-8e1a-f83a5c15a1d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"
Aug 05 17:08:02.991968 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:02.991941    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"]
Aug 05 17:08:02.995460 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:02.995442    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"
Aug 05 17:08:03.027174 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:03.027149    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"]
Aug 05 17:08:03.087191 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:03.087156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tfh7\" (UniqueName: \"kubernetes.io/projected/a142a66e-e965-4de7-bf61-d121205701b5-kube-api-access-4tfh7\") pod \"payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj\" (UID: \"a142a66e-e965-4de7-bf61-d121205701b5\") " pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"
Aug 05 17:08:03.087397 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:03.087195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44320e64-c03f-4a86-8e1a-f83a5c15a1d4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk\" (UID: \"44320e64-c03f-4a86-8e1a-f83a5c15a1d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"
Aug 05 17:08:03.087397 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:03.087319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtb4f\" (UniqueName: \"kubernetes.io/projected/44320e64-c03f-4a86-8e1a-f83a5c15a1d4-kube-api-access-jtb4f\") pod \"payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk\" (UID: \"44320e64-c03f-4a86-8e1a-f83a5c15a1d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"
Aug 05 17:08:03.087397 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:03.087372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a142a66e-e965-4de7-bf61-d121205701b5-plugins-config-volume\") pod \"payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj\" (UID: \"a142a66e-e965-4de7-bf61-d121205701b5\") " pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"
Aug 05 17:08:03.087852 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:03.087834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44320e64-c03f-4a86-8e1a-f83a5c15a1d4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk\" (UID: \"44320e64-c03f-4a86-8e1a-f83a5c15a1d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"
Aug 05 17:08:03.124350 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:03.124324    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtb4f\" (UniqueName: \"kubernetes.io/projected/44320e64-c03f-4a86-8e1a-f83a5c15a1d4-kube-api-access-jtb4f\") pod \"payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk\" (UID: \"44320e64-c03f-4a86-8e1a-f83a5c15a1d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"
Aug 05 17:08:03.188645 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:03.188556    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tfh7\" (UniqueName: \"kubernetes.io/projected/a142a66e-e965-4de7-bf61-d121205701b5-kube-api-access-4tfh7\") pod \"payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj\" (UID: \"a142a66e-e965-4de7-bf61-d121205701b5\") " pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"
Aug 05 17:08:03.188817 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:03.188676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a142a66e-e965-4de7-bf61-d121205701b5-plugins-config-volume\") pod \"payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj\" (UID: \"a142a66e-e965-4de7-bf61-d121205701b5\") " pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"
Aug 05 17:08:03.189358 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:03.189340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a142a66e-e965-4de7-bf61-d121205701b5-plugins-config-volume\") pod \"payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj\" (UID: \"a142a66e-e965-4de7-bf61-d121205701b5\") " pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"
Aug 05 17:08:03.201732 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:03.201709    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tfh7\" (UniqueName: \"kubernetes.io/projected/a142a66e-e965-4de7-bf61-d121205701b5-kube-api-access-4tfh7\") pod \"payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj\" (UID: \"a142a66e-e965-4de7-bf61-d121205701b5\") " pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"
Aug 05 17:08:03.214545 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:03.214518    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"
Aug 05 17:08:03.305744 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:03.305502    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"
Aug 05 17:08:03.363577 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:03.363505    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"]
Aug 05 17:08:03.365186 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:08:03.365163    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44320e64_c03f_4a86_8e1a_f83a5c15a1d4.slice/crio-898f1034f51774f2b1fc9b282c18c4ac27dbdd905ccf10ed288cdd87706c43e4 WatchSource:0}: Error finding container 898f1034f51774f2b1fc9b282c18c4ac27dbdd905ccf10ed288cdd87706c43e4: Status 404 returned error can't find the container with id 898f1034f51774f2b1fc9b282c18c4ac27dbdd905ccf10ed288cdd87706c43e4
Aug 05 17:08:03.467286 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:03.467264    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"]
Aug 05 17:08:03.469528 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:08:03.469503    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda142a66e_e965_4de7_bf61_d121205701b5.slice/crio-47f45e5a9bccb305958387481c35377d20b1771cc9dc9f2bda66265d3c347a65 WatchSource:0}: Error finding container 47f45e5a9bccb305958387481c35377d20b1771cc9dc9f2bda66265d3c347a65: Status 404 returned error can't find the container with id 47f45e5a9bccb305958387481c35377d20b1771cc9dc9f2bda66265d3c347a65
Aug 05 17:08:04.346272 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:04.346216    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj" event={"ID":"a142a66e-e965-4de7-bf61-d121205701b5","Type":"ContainerStarted","Data":"5577e50d890a444142ad58aa6f737f81f5d1a0d309b19f867a6903be358ee619"}
Aug 05 17:08:04.346831 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:04.346286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj" event={"ID":"a142a66e-e965-4de7-bf61-d121205701b5","Type":"ContainerStarted","Data":"47f45e5a9bccb305958387481c35377d20b1771cc9dc9f2bda66265d3c347a65"}
Aug 05 17:08:04.346831 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:04.346462    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"
Aug 05 17:08:04.348155 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:04.348128    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk" event={"ID":"44320e64-c03f-4a86-8e1a-f83a5c15a1d4","Type":"ContainerStarted","Data":"9d24b39997fa4fc3429a38340652d29536d759d4279dd26bda1eeaaae74f8348"}
Aug 05 17:08:04.348282 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:04.348179    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk" event={"ID":"44320e64-c03f-4a86-8e1a-f83a5c15a1d4","Type":"ContainerStarted","Data":"898f1034f51774f2b1fc9b282c18c4ac27dbdd905ccf10ed288cdd87706c43e4"}
Aug 05 17:08:04.348282 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:04.348221    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"
Aug 05 17:08:04.369874 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:04.369825    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj" podStartSLOduration=2.369811516 podStartE2EDuration="2.369811516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:08:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:08:04.367762482 +0000 UTC m=+1756.949834135" watchObservedRunningTime="2026-08-05 17:08:04.369811516 +0000 UTC m=+1756.951883173"
Aug 05 17:08:04.408200 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:04.408151    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk" podStartSLOduration=2.408135314 podStartE2EDuration="2.408135314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:08:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:08:04.407083898 +0000 UTC m=+1756.989155554" watchObservedRunningTime="2026-08-05 17:08:04.408135314 +0000 UTC m=+1756.990206969"
Aug 05 17:08:15.357059 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:15.357028    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"
Aug 05 17:08:15.359417 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:15.357136    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"
Aug 05 17:08:15.400498 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:15.400441    2565 patch_prober.go:28] interesting pod/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": read tcp 10.132.0.2:58932->10.132.0.52:15021: read: connection reset by peer" start-of-body=
Aug 05 17:08:15.400632 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:15.400504    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2" podUID="b0ea53cb-8157-4253-9720-628c4cda2614" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": read tcp 10.132.0.2:58932->10.132.0.52:15021: read: connection reset by peer"
Aug 05 17:08:16.415114 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:16.415061    2565 generic.go:356] "Generic (PLEG): container finished" podID="b0ea53cb-8157-4253-9720-628c4cda2614" containerID="45f80a64f21e6b40f805446ea2ba9727f7f2aec719c7ecfe8008c96614fc0615" exitCode=0
Aug 05 17:08:16.415488 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:16.415149    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2" event={"ID":"b0ea53cb-8157-4253-9720-628c4cda2614","Type":"ContainerDied","Data":"45f80a64f21e6b40f805446ea2ba9727f7f2aec719c7ecfe8008c96614fc0615"}
Aug 05 17:08:16.415577 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:16.415554    2565 scope.go:117] "RemoveContainer" containerID="45f80a64f21e6b40f805446ea2ba9727f7f2aec719c7ecfe8008c96614fc0615"
Aug 05 17:08:16.416588 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:16.416561    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:16.416645 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:16.416625    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:16.416692 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:16.416656    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:17.422643 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:17.422615    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2" event={"ID":"b0ea53cb-8157-4253-9720-628c4cda2614","Type":"ContainerStarted","Data":"82c6045bce6af5b1c9839c5e0c8460d29601c1e7c6e7c68646ca4337f6f4316d"}
Aug 05 17:08:18.115964 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:18.115936    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:08:18.116165 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:18.116144    2565 patch_prober.go:28] interesting pod/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 05 17:08:18.116214 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:18.116190    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2" podUID="b0ea53cb-8157-4253-9720-628c4cda2614" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 05 17:08:19.116271 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:19.116233    2565 patch_prober.go:28] interesting pod/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 05 17:08:19.116651 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:19.116292    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2" podUID="b0ea53cb-8157-4253-9720-628c4cda2614" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 05 17:08:20.116387 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:20.116351    2565 patch_prober.go:28] interesting pod/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 05 17:08:20.116772 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:20.116411    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2" podUID="b0ea53cb-8157-4253-9720-628c4cda2614" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 05 17:08:21.115728 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:21.115695    2565 patch_prober.go:28] interesting pod/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 05 17:08:21.115899 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:21.115744    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2" podUID="b0ea53cb-8157-4253-9720-628c4cda2614" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 05 17:08:22.115850 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:22.115814    2565 patch_prober.go:28] interesting pod/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Aug 05 17:08:22.116276 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:22.115867    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2" podUID="b0ea53cb-8157-4253-9720-628c4cda2614" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Aug 05 17:08:23.120306 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:23.120276    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:08:23.120697 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:23.120533    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:08:23.121178 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:23.121161    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:08:42.729855 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:42.729771    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"]
Aug 05 17:08:42.730494 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:42.730202    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj" podUID="a142a66e-e965-4de7-bf61-d121205701b5" containerName="payload-processing" containerID="cri-o://5577e50d890a444142ad58aa6f737f81f5d1a0d309b19f867a6903be358ee619" gracePeriod=30
Aug 05 17:08:42.757463 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:42.757438    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"]
Aug 05 17:08:42.757658 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:42.757625    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk" podUID="44320e64-c03f-4a86-8e1a-f83a5c15a1d4" containerName="payload-pre-processing" containerID="cri-o://9d24b39997fa4fc3429a38340652d29536d759d4279dd26bda1eeaaae74f8348" gracePeriod=30
Aug 05 17:08:43.011542 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.011514    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"
Aug 05 17:08:43.042756 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.042726    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"
Aug 05 17:08:43.061929 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.061890    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tfh7\" (UniqueName: \"kubernetes.io/projected/a142a66e-e965-4de7-bf61-d121205701b5-kube-api-access-4tfh7\") pod \"a142a66e-e965-4de7-bf61-d121205701b5\" (UID: \"a142a66e-e965-4de7-bf61-d121205701b5\") "
Aug 05 17:08:43.062132 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.061976    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44320e64-c03f-4a86-8e1a-f83a5c15a1d4-plugins-config-volume\") pod \"44320e64-c03f-4a86-8e1a-f83a5c15a1d4\" (UID: \"44320e64-c03f-4a86-8e1a-f83a5c15a1d4\") "
Aug 05 17:08:43.062132 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.062011    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a142a66e-e965-4de7-bf61-d121205701b5-plugins-config-volume\") pod \"a142a66e-e965-4de7-bf61-d121205701b5\" (UID: \"a142a66e-e965-4de7-bf61-d121205701b5\") "
Aug 05 17:08:43.062132 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.062032    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtb4f\" (UniqueName: \"kubernetes.io/projected/44320e64-c03f-4a86-8e1a-f83a5c15a1d4-kube-api-access-jtb4f\") pod \"44320e64-c03f-4a86-8e1a-f83a5c15a1d4\" (UID: \"44320e64-c03f-4a86-8e1a-f83a5c15a1d4\") "
Aug 05 17:08:43.062686 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.062409    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44320e64-c03f-4a86-8e1a-f83a5c15a1d4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44320e64-c03f-4a86-8e1a-f83a5c15a1d4" (UID: "44320e64-c03f-4a86-8e1a-f83a5c15a1d4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:08:43.062686 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.062651    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a142a66e-e965-4de7-bf61-d121205701b5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a142a66e-e965-4de7-bf61-d121205701b5" (UID: "a142a66e-e965-4de7-bf61-d121205701b5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:08:43.064645 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.064617    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a142a66e-e965-4de7-bf61-d121205701b5-kube-api-access-4tfh7" (OuterVolumeSpecName: "kube-api-access-4tfh7") pod "a142a66e-e965-4de7-bf61-d121205701b5" (UID: "a142a66e-e965-4de7-bf61-d121205701b5"). InnerVolumeSpecName "kube-api-access-4tfh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:08:43.064749 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.064651    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44320e64-c03f-4a86-8e1a-f83a5c15a1d4-kube-api-access-jtb4f" (OuterVolumeSpecName: "kube-api-access-jtb4f") pod "44320e64-c03f-4a86-8e1a-f83a5c15a1d4" (UID: "44320e64-c03f-4a86-8e1a-f83a5c15a1d4"). InnerVolumeSpecName "kube-api-access-jtb4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:08:43.163474 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.163442    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tfh7\" (UniqueName: \"kubernetes.io/projected/a142a66e-e965-4de7-bf61-d121205701b5-kube-api-access-4tfh7\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:08:43.163474 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.163470    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44320e64-c03f-4a86-8e1a-f83a5c15a1d4-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:08:43.163474 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.163480    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a142a66e-e965-4de7-bf61-d121205701b5-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:08:43.163740 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.163489    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtb4f\" (UniqueName: \"kubernetes.io/projected/44320e64-c03f-4a86-8e1a-f83a5c15a1d4-kube-api-access-jtb4f\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:08:43.303940 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.303911    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"]
Aug 05 17:08:43.304163 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.304127    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2" podUID="b0ea53cb-8157-4253-9720-628c4cda2614" containerName="istio-proxy" containerID="cri-o://82c6045bce6af5b1c9839c5e0c8460d29601c1e7c6e7c68646ca4337f6f4316d" gracePeriod=30
Aug 05 17:08:43.567826 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.567716    2565 generic.go:356] "Generic (PLEG): container finished" podID="44320e64-c03f-4a86-8e1a-f83a5c15a1d4" containerID="9d24b39997fa4fc3429a38340652d29536d759d4279dd26bda1eeaaae74f8348" exitCode=0
Aug 05 17:08:43.567826 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.567777    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"
Aug 05 17:08:43.567826 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.567799    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk" event={"ID":"44320e64-c03f-4a86-8e1a-f83a5c15a1d4","Type":"ContainerDied","Data":"9d24b39997fa4fc3429a38340652d29536d759d4279dd26bda1eeaaae74f8348"}
Aug 05 17:08:43.568142 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.567855    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk" event={"ID":"44320e64-c03f-4a86-8e1a-f83a5c15a1d4","Type":"ContainerDied","Data":"898f1034f51774f2b1fc9b282c18c4ac27dbdd905ccf10ed288cdd87706c43e4"}
Aug 05 17:08:43.568142 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.567885    2565 scope.go:117] "RemoveContainer" containerID="9d24b39997fa4fc3429a38340652d29536d759d4279dd26bda1eeaaae74f8348"
Aug 05 17:08:43.569191 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.569168    2565 generic.go:356] "Generic (PLEG): container finished" podID="a142a66e-e965-4de7-bf61-d121205701b5" containerID="5577e50d890a444142ad58aa6f737f81f5d1a0d309b19f867a6903be358ee619" exitCode=0
Aug 05 17:08:43.569316 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.569199    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj" event={"ID":"a142a66e-e965-4de7-bf61-d121205701b5","Type":"ContainerDied","Data":"5577e50d890a444142ad58aa6f737f81f5d1a0d309b19f867a6903be358ee619"}
Aug 05 17:08:43.569316 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.569227    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"
Aug 05 17:08:43.569316 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.569244    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj" event={"ID":"a142a66e-e965-4de7-bf61-d121205701b5","Type":"ContainerDied","Data":"47f45e5a9bccb305958387481c35377d20b1771cc9dc9f2bda66265d3c347a65"}
Aug 05 17:08:43.576619 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.576602    2565 scope.go:117] "RemoveContainer" containerID="9d24b39997fa4fc3429a38340652d29536d759d4279dd26bda1eeaaae74f8348"
Aug 05 17:08:43.576941 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:08:43.576910    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d24b39997fa4fc3429a38340652d29536d759d4279dd26bda1eeaaae74f8348\": container with ID starting with 9d24b39997fa4fc3429a38340652d29536d759d4279dd26bda1eeaaae74f8348 not found: ID does not exist" containerID="9d24b39997fa4fc3429a38340652d29536d759d4279dd26bda1eeaaae74f8348"
Aug 05 17:08:43.577023 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.576953    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d24b39997fa4fc3429a38340652d29536d759d4279dd26bda1eeaaae74f8348"} err="failed to get container status \"9d24b39997fa4fc3429a38340652d29536d759d4279dd26bda1eeaaae74f8348\": rpc error: code = NotFound desc = could not find container \"9d24b39997fa4fc3429a38340652d29536d759d4279dd26bda1eeaaae74f8348\": container with ID starting with 9d24b39997fa4fc3429a38340652d29536d759d4279dd26bda1eeaaae74f8348 not found: ID does not exist"
Aug 05 17:08:43.577023 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.576978    2565 scope.go:117] "RemoveContainer" containerID="5577e50d890a444142ad58aa6f737f81f5d1a0d309b19f867a6903be358ee619"
Aug 05 17:08:43.591586 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.591564    2565 scope.go:117] "RemoveContainer" containerID="5577e50d890a444142ad58aa6f737f81f5d1a0d309b19f867a6903be358ee619"
Aug 05 17:08:43.591897 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:08:43.591878    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5577e50d890a444142ad58aa6f737f81f5d1a0d309b19f867a6903be358ee619\": container with ID starting with 5577e50d890a444142ad58aa6f737f81f5d1a0d309b19f867a6903be358ee619 not found: ID does not exist" containerID="5577e50d890a444142ad58aa6f737f81f5d1a0d309b19f867a6903be358ee619"
Aug 05 17:08:43.591976 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.591902    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5577e50d890a444142ad58aa6f737f81f5d1a0d309b19f867a6903be358ee619"} err="failed to get container status \"5577e50d890a444142ad58aa6f737f81f5d1a0d309b19f867a6903be358ee619\": rpc error: code = NotFound desc = could not find container \"5577e50d890a444142ad58aa6f737f81f5d1a0d309b19f867a6903be358ee619\": container with ID starting with 5577e50d890a444142ad58aa6f737f81f5d1a0d309b19f867a6903be358ee619 not found: ID does not exist"
Aug 05 17:08:43.615838 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.615808    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"]
Aug 05 17:08:43.622592 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.622571    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fba92dbb-6d9c7d55b8-9b2mj"]
Aug 05 17:08:43.642281 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.642207    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"]
Aug 05 17:08:43.644680 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.644655    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fba92dbb-786c995dd-nglfk"]
Aug 05 17:08:43.953010 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.952933    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44320e64-c03f-4a86-8e1a-f83a5c15a1d4" path="/var/lib/kubelet/pods/44320e64-c03f-4a86-8e1a-f83a5c15a1d4/volumes"
Aug 05 17:08:43.953400 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:43.953287    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a142a66e-e965-4de7-bf61-d121205701b5" path="/var/lib/kubelet/pods/a142a66e-e965-4de7-bf61-d121205701b5/volumes"
Aug 05 17:08:44.472967 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.472932    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"]
Aug 05 17:08:44.473343 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.473329    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44320e64-c03f-4a86-8e1a-f83a5c15a1d4" containerName="payload-pre-processing"
Aug 05 17:08:44.473394 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.473344    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="44320e64-c03f-4a86-8e1a-f83a5c15a1d4" containerName="payload-pre-processing"
Aug 05 17:08:44.473394 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.473355    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a142a66e-e965-4de7-bf61-d121205701b5" containerName="payload-processing"
Aug 05 17:08:44.473394 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.473361    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a142a66e-e965-4de7-bf61-d121205701b5" containerName="payload-processing"
Aug 05 17:08:44.473491 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.473433    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="44320e64-c03f-4a86-8e1a-f83a5c15a1d4" containerName="payload-pre-processing"
Aug 05 17:08:44.473491 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.473446    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a142a66e-e965-4de7-bf61-d121205701b5" containerName="payload-processing"
Aug 05 17:08:44.477818 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.477801    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.488261 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.488244    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-1678b097-gw-openshift-default-dockercfg-mxrwb\""
Aug 05 17:08:44.574463 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.574418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9s67\" (UniqueName: \"kubernetes.io/projected/1220b664-60ec-4ac5-b238-b688f6fd15e7-kube-api-access-p9s67\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.574463 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.574462    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-token\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.574769 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.574510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-data\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.574769 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.574539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-envoy\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.574769 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.574577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-podinfo\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.574769 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.574603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1220b664-60ec-4ac5-b238-b688f6fd15e7-istiod-ca-cert\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.574769 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.574710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-workload-socket\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.574769 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.574746    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-workload-certs\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.575145 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.574819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-credential-socket\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.579624 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.579594    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"]
Aug 05 17:08:44.675558 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.675524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-workload-socket\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.675751 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.675569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-workload-certs\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.675751 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.675606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-credential-socket\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.675751 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.675637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9s67\" (UniqueName: \"kubernetes.io/projected/1220b664-60ec-4ac5-b238-b688f6fd15e7-kube-api-access-p9s67\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.675751 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.675662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-token\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.675751 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.675715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-data\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.676035 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.675755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-envoy\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.676035 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.675815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-podinfo\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.676035 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.675846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1220b664-60ec-4ac5-b238-b688f6fd15e7-istiod-ca-cert\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.676035 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.675968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-workload-certs\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.676035 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.676007    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-workload-socket\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.676347 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.676261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-credential-socket\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.676347 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.676316    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-data\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.676599 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.676573    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1220b664-60ec-4ac5-b238-b688f6fd15e7-istiod-ca-cert\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.678216 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.678193    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-envoy\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.678390 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.678373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-podinfo\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.691927 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.691903    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9s67\" (UniqueName: \"kubernetes.io/projected/1220b664-60ec-4ac5-b238-b688f6fd15e7-kube-api-access-p9s67\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.693908 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.693886    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-token\") pod \"e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") " pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.788154 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.788061    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:44.944778 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.944751    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"]
Aug 05 17:08:44.950979 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.950938    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:44.951155 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.951026    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:44.951155 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:44.951055    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:45.587052 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:45.587014    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm" event={"ID":"1220b664-60ec-4ac5-b238-b688f6fd15e7","Type":"ContainerStarted","Data":"b33b9ce44238a1ece3f4234b1f23d4a09ef8b3435754e627ae080e608fe81d26"}
Aug 05 17:08:45.587444 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:45.587070    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm" event={"ID":"1220b664-60ec-4ac5-b238-b688f6fd15e7","Type":"ContainerStarted","Data":"5f2fb1706f772d298a9d36ea842a76cb84cb732bfd29c354d9b384caca397f4b"}
Aug 05 17:08:45.618948 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:45.618901    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm" podStartSLOduration=1.618886255 podStartE2EDuration="1.618886255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:08:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:08:45.617091419 +0000 UTC m=+1798.199163076" watchObservedRunningTime="2026-08-05 17:08:45.618886255 +0000 UTC m=+1798.200957911"
Aug 05 17:08:45.788164 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:45.788132    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:46.793889 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:46.793861    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:47.600511 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:47.600483    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:47.601294 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:47.601271    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:08:48.558024 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.558001    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:08:48.607622 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.607589    2565 generic.go:356] "Generic (PLEG): container finished" podID="b0ea53cb-8157-4253-9720-628c4cda2614" containerID="82c6045bce6af5b1c9839c5e0c8460d29601c1e7c6e7c68646ca4337f6f4316d" exitCode=0
Aug 05 17:08:48.607797 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.607637    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"
Aug 05 17:08:48.607797 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.607665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2" event={"ID":"b0ea53cb-8157-4253-9720-628c4cda2614","Type":"ContainerDied","Data":"82c6045bce6af5b1c9839c5e0c8460d29601c1e7c6e7c68646ca4337f6f4316d"}
Aug 05 17:08:48.607797 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.607719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2" event={"ID":"b0ea53cb-8157-4253-9720-628c4cda2614","Type":"ContainerDied","Data":"c32ab793ed66280c65a1e9a639c90a2b8ae1f36c1f70499fccb0a6a653f63f48"}
Aug 05 17:08:48.607797 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.607744    2565 scope.go:117] "RemoveContainer" containerID="82c6045bce6af5b1c9839c5e0c8460d29601c1e7c6e7c68646ca4337f6f4316d"
Aug 05 17:08:48.612903 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.612882    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-credential-socket\") pod \"b0ea53cb-8157-4253-9720-628c4cda2614\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") "
Aug 05 17:08:48.612991 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.612937    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ea53cb-8157-4253-9720-628c4cda2614-istio-podinfo\") pod \"b0ea53cb-8157-4253-9720-628c4cda2614\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") "
Aug 05 17:08:48.612991 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.612969    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-workload-certs\") pod \"b0ea53cb-8157-4253-9720-628c4cda2614\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") "
Aug 05 17:08:48.613158 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.613015    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ea53cb-8157-4253-9720-628c4cda2614-istio-token\") pod \"b0ea53cb-8157-4253-9720-628c4cda2614\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") "
Aug 05 17:08:48.613158 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.613056    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-istio-data\") pod \"b0ea53cb-8157-4253-9720-628c4cda2614\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") "
Aug 05 17:08:48.613158 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.613109    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-istio-envoy\") pod \"b0ea53cb-8157-4253-9720-628c4cda2614\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") "
Aug 05 17:08:48.613312 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.613163    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-workload-socket\") pod \"b0ea53cb-8157-4253-9720-628c4cda2614\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") "
Aug 05 17:08:48.613312 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.613172    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b0ea53cb-8157-4253-9720-628c4cda2614" (UID: "b0ea53cb-8157-4253-9720-628c4cda2614"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:08:48.613312 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.613186    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mr9t\" (UniqueName: \"kubernetes.io/projected/b0ea53cb-8157-4253-9720-628c4cda2614-kube-api-access-5mr9t\") pod \"b0ea53cb-8157-4253-9720-628c4cda2614\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") "
Aug 05 17:08:48.613312 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.613227    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ea53cb-8157-4253-9720-628c4cda2614-istiod-ca-cert\") pod \"b0ea53cb-8157-4253-9720-628c4cda2614\" (UID: \"b0ea53cb-8157-4253-9720-628c4cda2614\") "
Aug 05 17:08:48.613312 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.613284    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b0ea53cb-8157-4253-9720-628c4cda2614" (UID: "b0ea53cb-8157-4253-9720-628c4cda2614"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:08:48.613573 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.613459    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b0ea53cb-8157-4253-9720-628c4cda2614" (UID: "b0ea53cb-8157-4253-9720-628c4cda2614"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:08:48.613573 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.613476    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-credential-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:08:48.613573 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.613494    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-workload-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:08:48.613573 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.613556    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-istio-data" (OuterVolumeSpecName: "istio-data") pod "b0ea53cb-8157-4253-9720-628c4cda2614" (UID: "b0ea53cb-8157-4253-9720-628c4cda2614"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:08:48.613814 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.613791    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ea53cb-8157-4253-9720-628c4cda2614-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b0ea53cb-8157-4253-9720-628c4cda2614" (UID: "b0ea53cb-8157-4253-9720-628c4cda2614"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:08:48.615394 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.615370    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b0ea53cb-8157-4253-9720-628c4cda2614" (UID: "b0ea53cb-8157-4253-9720-628c4cda2614"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:08:48.615394 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.615374    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ea53cb-8157-4253-9720-628c4cda2614-kube-api-access-5mr9t" (OuterVolumeSpecName: "kube-api-access-5mr9t") pod "b0ea53cb-8157-4253-9720-628c4cda2614" (UID: "b0ea53cb-8157-4253-9720-628c4cda2614"). InnerVolumeSpecName "kube-api-access-5mr9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:08:48.615611 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.615588    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ea53cb-8157-4253-9720-628c4cda2614-istio-token" (OuterVolumeSpecName: "istio-token") pod "b0ea53cb-8157-4253-9720-628c4cda2614" (UID: "b0ea53cb-8157-4253-9720-628c4cda2614"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:08:48.615665 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.615639    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b0ea53cb-8157-4253-9720-628c4cda2614-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b0ea53cb-8157-4253-9720-628c4cda2614" (UID: "b0ea53cb-8157-4253-9720-628c4cda2614"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:08:48.617702 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.617679    2565 scope.go:117] "RemoveContainer" containerID="45f80a64f21e6b40f805446ea2ba9727f7f2aec719c7ecfe8008c96614fc0615"
Aug 05 17:08:48.636532 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.636313    2565 scope.go:117] "RemoveContainer" containerID="82c6045bce6af5b1c9839c5e0c8460d29601c1e7c6e7c68646ca4337f6f4316d"
Aug 05 17:08:48.636711 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:08:48.636688    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82c6045bce6af5b1c9839c5e0c8460d29601c1e7c6e7c68646ca4337f6f4316d\": container with ID starting with 82c6045bce6af5b1c9839c5e0c8460d29601c1e7c6e7c68646ca4337f6f4316d not found: ID does not exist" containerID="82c6045bce6af5b1c9839c5e0c8460d29601c1e7c6e7c68646ca4337f6f4316d"
Aug 05 17:08:48.636810 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.636719    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82c6045bce6af5b1c9839c5e0c8460d29601c1e7c6e7c68646ca4337f6f4316d"} err="failed to get container status \"82c6045bce6af5b1c9839c5e0c8460d29601c1e7c6e7c68646ca4337f6f4316d\": rpc error: code = NotFound desc = could not find container \"82c6045bce6af5b1c9839c5e0c8460d29601c1e7c6e7c68646ca4337f6f4316d\": container with ID starting with 82c6045bce6af5b1c9839c5e0c8460d29601c1e7c6e7c68646ca4337f6f4316d not found: ID does not exist"
Aug 05 17:08:48.636810 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.636736    2565 scope.go:117] "RemoveContainer" containerID="45f80a64f21e6b40f805446ea2ba9727f7f2aec719c7ecfe8008c96614fc0615"
Aug 05 17:08:48.637030 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:08:48.637005    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45f80a64f21e6b40f805446ea2ba9727f7f2aec719c7ecfe8008c96614fc0615\": container with ID starting with 45f80a64f21e6b40f805446ea2ba9727f7f2aec719c7ecfe8008c96614fc0615 not found: ID does not exist" containerID="45f80a64f21e6b40f805446ea2ba9727f7f2aec719c7ecfe8008c96614fc0615"
Aug 05 17:08:48.637142 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.637037    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45f80a64f21e6b40f805446ea2ba9727f7f2aec719c7ecfe8008c96614fc0615"} err="failed to get container status \"45f80a64f21e6b40f805446ea2ba9727f7f2aec719c7ecfe8008c96614fc0615\": rpc error: code = NotFound desc = could not find container \"45f80a64f21e6b40f805446ea2ba9727f7f2aec719c7ecfe8008c96614fc0615\": container with ID starting with 45f80a64f21e6b40f805446ea2ba9727f7f2aec719c7ecfe8008c96614fc0615 not found: ID does not exist"
Aug 05 17:08:48.639684 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.639658    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"]
Aug 05 17:08:48.640046 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.640033    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ea53cb-8157-4253-9720-628c4cda2614" containerName="istio-proxy"
Aug 05 17:08:48.640126 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.640049    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ea53cb-8157-4253-9720-628c4cda2614" containerName="istio-proxy"
Aug 05 17:08:48.640126 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.640062    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ea53cb-8157-4253-9720-628c4cda2614" containerName="istio-proxy"
Aug 05 17:08:48.640126 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.640070    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ea53cb-8157-4253-9720-628c4cda2614" containerName="istio-proxy"
Aug 05 17:08:48.640286 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.640160    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ea53cb-8157-4253-9720-628c4cda2614" containerName="istio-proxy"
Aug 05 17:08:48.640286 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.640170    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ea53cb-8157-4253-9720-628c4cda2614" containerName="istio-proxy"
Aug 05 17:08:48.644502 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.644482    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"
Aug 05 17:08:48.647729 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.647710    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-1678b097-dockercfg-q4w2k\""
Aug 05 17:08:48.647878 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.647768    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-1678b097\""
Aug 05 17:08:48.678576 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.678512    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"]
Aug 05 17:08:48.714603 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.714566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a6ed76b-36f7-4579-92b0-fa2cef2299a9-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d\" (UID: \"6a6ed76b-36f7-4579-92b0-fa2cef2299a9\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"
Aug 05 17:08:48.714748 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.714628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pswhd\" (UniqueName: \"kubernetes.io/projected/6a6ed76b-36f7-4579-92b0-fa2cef2299a9-kube-api-access-pswhd\") pod \"payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d\" (UID: \"6a6ed76b-36f7-4579-92b0-fa2cef2299a9\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"
Aug 05 17:08:48.714890 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.714873    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ea53cb-8157-4253-9720-628c4cda2614-istio-podinfo\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:08:48.714949 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.714932    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ea53cb-8157-4253-9720-628c4cda2614-istio-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:08:48.715004 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.714958    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-istio-data\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:08:48.715004 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.714973    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-istio-envoy\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:08:48.715004 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.714987    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ea53cb-8157-4253-9720-628c4cda2614-workload-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:08:48.715142 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.715002    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mr9t\" (UniqueName: \"kubernetes.io/projected/b0ea53cb-8157-4253-9720-628c4cda2614-kube-api-access-5mr9t\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:08:48.715142 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.715017    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ea53cb-8157-4253-9720-628c4cda2614-istiod-ca-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:08:48.807800 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.807770    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"]
Aug 05 17:08:48.811304 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.811286    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"
Aug 05 17:08:48.816437 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.816411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a6ed76b-36f7-4579-92b0-fa2cef2299a9-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d\" (UID: \"6a6ed76b-36f7-4579-92b0-fa2cef2299a9\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"
Aug 05 17:08:48.816556 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.816460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pswhd\" (UniqueName: \"kubernetes.io/projected/6a6ed76b-36f7-4579-92b0-fa2cef2299a9-kube-api-access-pswhd\") pod \"payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d\" (UID: \"6a6ed76b-36f7-4579-92b0-fa2cef2299a9\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"
Aug 05 17:08:48.817064 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.817038    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a6ed76b-36f7-4579-92b0-fa2cef2299a9-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d\" (UID: \"6a6ed76b-36f7-4579-92b0-fa2cef2299a9\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"
Aug 05 17:08:48.838342 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.838315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pswhd\" (UniqueName: \"kubernetes.io/projected/6a6ed76b-36f7-4579-92b0-fa2cef2299a9-kube-api-access-pswhd\") pod \"payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d\" (UID: \"6a6ed76b-36f7-4579-92b0-fa2cef2299a9\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"
Aug 05 17:08:48.880470 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.880441    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"]
Aug 05 17:08:48.917432 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.917408    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t72t6\" (UniqueName: \"kubernetes.io/projected/f2b50407-f35f-4d1b-9c53-b074f7f92294-kube-api-access-t72t6\") pod \"payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw\" (UID: \"f2b50407-f35f-4d1b-9c53-b074f7f92294\") " pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"
Aug 05 17:08:48.917540 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.917449    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2b50407-f35f-4d1b-9c53-b074f7f92294-plugins-config-volume\") pod \"payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw\" (UID: \"f2b50407-f35f-4d1b-9c53-b074f7f92294\") " pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"
Aug 05 17:08:48.937780 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.937685    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"]
Aug 05 17:08:48.941068 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.941041    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-fba92dbb-openshift-default-57588597b8-mdxn2"]
Aug 05 17:08:48.955380 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:48.955348    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"
Aug 05 17:08:49.018914 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.018850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t72t6\" (UniqueName: \"kubernetes.io/projected/f2b50407-f35f-4d1b-9c53-b074f7f92294-kube-api-access-t72t6\") pod \"payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw\" (UID: \"f2b50407-f35f-4d1b-9c53-b074f7f92294\") " pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"
Aug 05 17:08:49.019087 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.018918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2b50407-f35f-4d1b-9c53-b074f7f92294-plugins-config-volume\") pod \"payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw\" (UID: \"f2b50407-f35f-4d1b-9c53-b074f7f92294\") " pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"
Aug 05 17:08:49.019725 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.019700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2b50407-f35f-4d1b-9c53-b074f7f92294-plugins-config-volume\") pod \"payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw\" (UID: \"f2b50407-f35f-4d1b-9c53-b074f7f92294\") " pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"
Aug 05 17:08:49.031707 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.031683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t72t6\" (UniqueName: \"kubernetes.io/projected/f2b50407-f35f-4d1b-9c53-b074f7f92294-kube-api-access-t72t6\") pod \"payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw\" (UID: \"f2b50407-f35f-4d1b-9c53-b074f7f92294\") " pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"
Aug 05 17:08:49.092282 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.092254    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"]
Aug 05 17:08:49.094013 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:08:49.093983    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a6ed76b_36f7_4579_92b0_fa2cef2299a9.slice/crio-602e07d6aa505dc619ff1e46a4cc859d5f8d5b921ec1ca9c9820b6a594d359a4 WatchSource:0}: Error finding container 602e07d6aa505dc619ff1e46a4cc859d5f8d5b921ec1ca9c9820b6a594d359a4: Status 404 returned error can't find the container with id 602e07d6aa505dc619ff1e46a4cc859d5f8d5b921ec1ca9c9820b6a594d359a4
Aug 05 17:08:49.120529 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.120504    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"
Aug 05 17:08:49.472309 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.472282    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"]
Aug 05 17:08:49.473514 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:08:49.473493    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2b50407_f35f_4d1b_9c53_b074f7f92294.slice/crio-ad985ccc173dc2d4fc3bee73a86e6643cf7eb666ed173882a2d645fff33a1267 WatchSource:0}: Error finding container ad985ccc173dc2d4fc3bee73a86e6643cf7eb666ed173882a2d645fff33a1267: Status 404 returned error can't find the container with id ad985ccc173dc2d4fc3bee73a86e6643cf7eb666ed173882a2d645fff33a1267
Aug 05 17:08:49.614004 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.613967    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d" event={"ID":"6a6ed76b-36f7-4579-92b0-fa2cef2299a9","Type":"ContainerStarted","Data":"9c1e05adab6fa666a01e0ecd44fdfeaa67d6a1f0b1c97565b361dc5ff4f96090"}
Aug 05 17:08:49.614477 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.614118    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"
Aug 05 17:08:49.614477 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.614175    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d" event={"ID":"6a6ed76b-36f7-4579-92b0-fa2cef2299a9","Type":"ContainerStarted","Data":"602e07d6aa505dc619ff1e46a4cc859d5f8d5b921ec1ca9c9820b6a594d359a4"}
Aug 05 17:08:49.616301 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.616276    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw" event={"ID":"f2b50407-f35f-4d1b-9c53-b074f7f92294","Type":"ContainerStarted","Data":"53cf84094e7413f28664ea499bb81f8933aa8a3454d4757c0e406a198559dd12"}
Aug 05 17:08:49.616417 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.616321    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw" event={"ID":"f2b50407-f35f-4d1b-9c53-b074f7f92294","Type":"ContainerStarted","Data":"ad985ccc173dc2d4fc3bee73a86e6643cf7eb666ed173882a2d645fff33a1267"}
Aug 05 17:08:49.616490 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.616474    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"
Aug 05 17:08:49.675284 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.675223    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d" podStartSLOduration=1.675204444 podStartE2EDuration="1.675204444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:08:49.648949703 +0000 UTC m=+1802.231021370" watchObservedRunningTime="2026-08-05 17:08:49.675204444 +0000 UTC m=+1802.257276101"
Aug 05 17:08:49.676162 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.676132    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw" podStartSLOduration=1.676123576 podStartE2EDuration="1.676123576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:08:49.675284491 +0000 UTC m=+1802.257356161" watchObservedRunningTime="2026-08-05 17:08:49.676123576 +0000 UTC m=+1802.258195231"
Aug 05 17:08:49.955748 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:49.955711    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ea53cb-8157-4253-9720-628c4cda2614" path="/var/lib/kubelet/pods/b0ea53cb-8157-4253-9720-628c4cda2614/volumes"
Aug 05 17:08:59.683889 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:59.683857    2565 generic.go:356] "Generic (PLEG): container finished" podID="1220b664-60ec-4ac5-b238-b688f6fd15e7" containerID="b33b9ce44238a1ece3f4234b1f23d4a09ef8b3435754e627ae080e608fe81d26" exitCode=0
Aug 05 17:08:59.684341 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:59.683929    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm" event={"ID":"1220b664-60ec-4ac5-b238-b688f6fd15e7","Type":"ContainerDied","Data":"b33b9ce44238a1ece3f4234b1f23d4a09ef8b3435754e627ae080e608fe81d26"}
Aug 05 17:08:59.684386 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:59.684348    2565 scope.go:117] "RemoveContainer" containerID="b33b9ce44238a1ece3f4234b1f23d4a09ef8b3435754e627ae080e608fe81d26"
Aug 05 17:08:59.685332 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:59.685307    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:59.685394 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:59.685370    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:08:59.685431 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:08:59.685403    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:09:00.622937 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:00.622910    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"
Aug 05 17:09:00.623155 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:00.623044    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"
Aug 05 17:09:00.692043 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:00.692007    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm" event={"ID":"1220b664-60ec-4ac5-b238-b688f6fd15e7","Type":"ContainerStarted","Data":"290204471ee6c2f6ce471a58625715b036c9e42cd8c9af22f8d37e25fc914a40"}
Aug 05 17:09:00.788273 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:00.788238    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:09:00.789130 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:00.789088    2565 patch_prober.go:28] interesting pod/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Aug 05 17:09:00.789189 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:00.789153    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm" podUID="1220b664-60ec-4ac5-b238-b688f6fd15e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Aug 05 17:09:01.789009 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:01.788970    2565 patch_prober.go:28] interesting pod/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Aug 05 17:09:01.789433 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:01.789024    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm" podUID="1220b664-60ec-4ac5-b238-b688f6fd15e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Aug 05 17:09:02.600990 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:02.600960    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:09:02.788661 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:02.788626    2565 patch_prober.go:28] interesting pod/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Aug 05 17:09:02.788839 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:02.788690    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm" podUID="1220b664-60ec-4ac5-b238-b688f6fd15e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Aug 05 17:09:03.789305 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:03.789265    2565 patch_prober.go:28] interesting pod/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Aug 05 17:09:03.789859 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:03.789828    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm" podUID="1220b664-60ec-4ac5-b238-b688f6fd15e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Aug 05 17:09:04.789133 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:04.789088    2565 patch_prober.go:28] interesting pod/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Aug 05 17:09:04.789306 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:04.789158    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm" podUID="1220b664-60ec-4ac5-b238-b688f6fd15e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Aug 05 17:09:05.792148 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:05.792088    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:09:05.792949 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:05.792931    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:09:17.737504 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:17.737468    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"]
Aug 05 17:09:17.738080 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:17.737719    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d" podUID="6a6ed76b-36f7-4579-92b0-fa2cef2299a9" containerName="payload-pre-processing" containerID="cri-o://9c1e05adab6fa666a01e0ecd44fdfeaa67d6a1f0b1c97565b361dc5ff4f96090" gracePeriod=30
Aug 05 17:09:17.742439 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:17.742415    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"]
Aug 05 17:09:17.747925 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:17.742882    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw" podUID="f2b50407-f35f-4d1b-9c53-b074f7f92294" containerName="payload-processing" containerID="cri-o://53cf84094e7413f28664ea499bb81f8933aa8a3454d4757c0e406a198559dd12" gracePeriod=30
Aug 05 17:09:18.007716 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.007686    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"
Aug 05 17:09:18.047637 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.047602    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"
Aug 05 17:09:18.083276 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.083171    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pswhd\" (UniqueName: \"kubernetes.io/projected/6a6ed76b-36f7-4579-92b0-fa2cef2299a9-kube-api-access-pswhd\") pod \"6a6ed76b-36f7-4579-92b0-fa2cef2299a9\" (UID: \"6a6ed76b-36f7-4579-92b0-fa2cef2299a9\") "
Aug 05 17:09:18.083472 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.083281    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a6ed76b-36f7-4579-92b0-fa2cef2299a9-plugins-config-volume\") pod \"6a6ed76b-36f7-4579-92b0-fa2cef2299a9\" (UID: \"6a6ed76b-36f7-4579-92b0-fa2cef2299a9\") "
Aug 05 17:09:18.083929 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.083903    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a6ed76b-36f7-4579-92b0-fa2cef2299a9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6a6ed76b-36f7-4579-92b0-fa2cef2299a9" (UID: "6a6ed76b-36f7-4579-92b0-fa2cef2299a9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:09:18.087000 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.086974    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a6ed76b-36f7-4579-92b0-fa2cef2299a9-kube-api-access-pswhd" (OuterVolumeSpecName: "kube-api-access-pswhd") pod "6a6ed76b-36f7-4579-92b0-fa2cef2299a9" (UID: "6a6ed76b-36f7-4579-92b0-fa2cef2299a9"). InnerVolumeSpecName "kube-api-access-pswhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:09:18.155372 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.155339    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"]
Aug 05 17:09:18.155571 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.155550    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm" podUID="1220b664-60ec-4ac5-b238-b688f6fd15e7" containerName="istio-proxy" containerID="cri-o://290204471ee6c2f6ce471a58625715b036c9e42cd8c9af22f8d37e25fc914a40" gracePeriod=30
Aug 05 17:09:18.183972 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.183944    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2b50407-f35f-4d1b-9c53-b074f7f92294-plugins-config-volume\") pod \"f2b50407-f35f-4d1b-9c53-b074f7f92294\" (UID: \"f2b50407-f35f-4d1b-9c53-b074f7f92294\") "
Aug 05 17:09:18.184153 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.184058    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t72t6\" (UniqueName: \"kubernetes.io/projected/f2b50407-f35f-4d1b-9c53-b074f7f92294-kube-api-access-t72t6\") pod \"f2b50407-f35f-4d1b-9c53-b074f7f92294\" (UID: \"f2b50407-f35f-4d1b-9c53-b074f7f92294\") "
Aug 05 17:09:18.184294 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.184270    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2b50407-f35f-4d1b-9c53-b074f7f92294-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f2b50407-f35f-4d1b-9c53-b074f7f92294" (UID: "f2b50407-f35f-4d1b-9c53-b074f7f92294"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:09:18.184357 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.184338    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a6ed76b-36f7-4579-92b0-fa2cef2299a9-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:18.184405 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.184360    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pswhd\" (UniqueName: \"kubernetes.io/projected/6a6ed76b-36f7-4579-92b0-fa2cef2299a9-kube-api-access-pswhd\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:18.186078 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.186050    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2b50407-f35f-4d1b-9c53-b074f7f92294-kube-api-access-t72t6" (OuterVolumeSpecName: "kube-api-access-t72t6") pod "f2b50407-f35f-4d1b-9c53-b074f7f92294" (UID: "f2b50407-f35f-4d1b-9c53-b074f7f92294"). InnerVolumeSpecName "kube-api-access-t72t6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:09:18.285419 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.285339    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t72t6\" (UniqueName: \"kubernetes.io/projected/f2b50407-f35f-4d1b-9c53-b074f7f92294-kube-api-access-t72t6\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:18.285419 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.285365    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2b50407-f35f-4d1b-9c53-b074f7f92294-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:18.789584 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.789553    2565 generic.go:356] "Generic (PLEG): container finished" podID="6a6ed76b-36f7-4579-92b0-fa2cef2299a9" containerID="9c1e05adab6fa666a01e0ecd44fdfeaa67d6a1f0b1c97565b361dc5ff4f96090" exitCode=0
Aug 05 17:09:18.789990 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.789613    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"
Aug 05 17:09:18.789990 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.789651    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d" event={"ID":"6a6ed76b-36f7-4579-92b0-fa2cef2299a9","Type":"ContainerDied","Data":"9c1e05adab6fa666a01e0ecd44fdfeaa67d6a1f0b1c97565b361dc5ff4f96090"}
Aug 05 17:09:18.789990 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.789718    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d" event={"ID":"6a6ed76b-36f7-4579-92b0-fa2cef2299a9","Type":"ContainerDied","Data":"602e07d6aa505dc619ff1e46a4cc859d5f8d5b921ec1ca9c9820b6a594d359a4"}
Aug 05 17:09:18.789990 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.789750    2565 scope.go:117] "RemoveContainer" containerID="9c1e05adab6fa666a01e0ecd44fdfeaa67d6a1f0b1c97565b361dc5ff4f96090"
Aug 05 17:09:18.791927 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.791784    2565 generic.go:356] "Generic (PLEG): container finished" podID="f2b50407-f35f-4d1b-9c53-b074f7f92294" containerID="53cf84094e7413f28664ea499bb81f8933aa8a3454d4757c0e406a198559dd12" exitCode=0
Aug 05 17:09:18.791927 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.791895    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw" event={"ID":"f2b50407-f35f-4d1b-9c53-b074f7f92294","Type":"ContainerDied","Data":"53cf84094e7413f28664ea499bb81f8933aa8a3454d4757c0e406a198559dd12"}
Aug 05 17:09:18.792061 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.791936    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw" event={"ID":"f2b50407-f35f-4d1b-9c53-b074f7f92294","Type":"ContainerDied","Data":"ad985ccc173dc2d4fc3bee73a86e6643cf7eb666ed173882a2d645fff33a1267"}
Aug 05 17:09:18.792061 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.792002    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"
Aug 05 17:09:18.805123 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.804960    2565 scope.go:117] "RemoveContainer" containerID="9c1e05adab6fa666a01e0ecd44fdfeaa67d6a1f0b1c97565b361dc5ff4f96090"
Aug 05 17:09:18.805587 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:09:18.805564    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c1e05adab6fa666a01e0ecd44fdfeaa67d6a1f0b1c97565b361dc5ff4f96090\": container with ID starting with 9c1e05adab6fa666a01e0ecd44fdfeaa67d6a1f0b1c97565b361dc5ff4f96090 not found: ID does not exist" containerID="9c1e05adab6fa666a01e0ecd44fdfeaa67d6a1f0b1c97565b361dc5ff4f96090"
Aug 05 17:09:18.805692 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.805601    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c1e05adab6fa666a01e0ecd44fdfeaa67d6a1f0b1c97565b361dc5ff4f96090"} err="failed to get container status \"9c1e05adab6fa666a01e0ecd44fdfeaa67d6a1f0b1c97565b361dc5ff4f96090\": rpc error: code = NotFound desc = could not find container \"9c1e05adab6fa666a01e0ecd44fdfeaa67d6a1f0b1c97565b361dc5ff4f96090\": container with ID starting with 9c1e05adab6fa666a01e0ecd44fdfeaa67d6a1f0b1c97565b361dc5ff4f96090 not found: ID does not exist"
Aug 05 17:09:18.805743 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.805705    2565 scope.go:117] "RemoveContainer" containerID="53cf84094e7413f28664ea499bb81f8933aa8a3454d4757c0e406a198559dd12"
Aug 05 17:09:18.813426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.813410    2565 scope.go:117] "RemoveContainer" containerID="53cf84094e7413f28664ea499bb81f8933aa8a3454d4757c0e406a198559dd12"
Aug 05 17:09:18.813666 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:09:18.813646    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53cf84094e7413f28664ea499bb81f8933aa8a3454d4757c0e406a198559dd12\": container with ID starting with 53cf84094e7413f28664ea499bb81f8933aa8a3454d4757c0e406a198559dd12 not found: ID does not exist" containerID="53cf84094e7413f28664ea499bb81f8933aa8a3454d4757c0e406a198559dd12"
Aug 05 17:09:18.813722 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.813673    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53cf84094e7413f28664ea499bb81f8933aa8a3454d4757c0e406a198559dd12"} err="failed to get container status \"53cf84094e7413f28664ea499bb81f8933aa8a3454d4757c0e406a198559dd12\": rpc error: code = NotFound desc = could not find container \"53cf84094e7413f28664ea499bb81f8933aa8a3454d4757c0e406a198559dd12\": container with ID starting with 53cf84094e7413f28664ea499bb81f8933aa8a3454d4757c0e406a198559dd12 not found: ID does not exist"
Aug 05 17:09:18.822052 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.822031    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"]
Aug 05 17:09:18.827847 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.827827    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1678b097-55f98bcb76-g287d"]
Aug 05 17:09:18.848319 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.848298    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"]
Aug 05 17:09:18.853545 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.853527    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-1678b097-77bfd57dfc-tngfw"]
Aug 05 17:09:18.970745 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.970714    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"]
Aug 05 17:09:18.971168 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.971151    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a6ed76b-36f7-4579-92b0-fa2cef2299a9" containerName="payload-pre-processing"
Aug 05 17:09:18.971168 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.971169    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a6ed76b-36f7-4579-92b0-fa2cef2299a9" containerName="payload-pre-processing"
Aug 05 17:09:18.971323 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.971200    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2b50407-f35f-4d1b-9c53-b074f7f92294" containerName="payload-processing"
Aug 05 17:09:18.971323 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.971210    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2b50407-f35f-4d1b-9c53-b074f7f92294" containerName="payload-processing"
Aug 05 17:09:18.971323 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.971303    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a6ed76b-36f7-4579-92b0-fa2cef2299a9" containerName="payload-pre-processing"
Aug 05 17:09:18.971323 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.971317    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2b50407-f35f-4d1b-9c53-b074f7f92294" containerName="payload-processing"
Aug 05 17:09:18.975636 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.975617    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:18.980352 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.980319    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-324ed8e0-openshift-default-dockercfg-nmnbh\""
Aug 05 17:09:19.000675 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:18.997506    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"]
Aug 05 17:09:19.092654 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.092619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istiod-ca-cert\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.092886 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.092679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-data\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.092886 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.092713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-workload-socket\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.092886 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.092736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-credential-socket\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.092886 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.092836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-workload-certs\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.093154 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.092905    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-token\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.093154 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.092984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd6rd\" (UniqueName: \"kubernetes.io/projected/90d1bc16-b32f-43b6-aeca-c4f4624f2604-kube-api-access-sd6rd\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.093154 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.093044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-podinfo\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.093154 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.093118    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-envoy\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.194240 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.194208    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-token\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.194428 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.194251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd6rd\" (UniqueName: \"kubernetes.io/projected/90d1bc16-b32f-43b6-aeca-c4f4624f2604-kube-api-access-sd6rd\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.194428 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.194374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-podinfo\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.194428 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.194428    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-envoy\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.194580 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.194469    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istiod-ca-cert\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.194580 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.194488    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-data\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.194580 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.194507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-workload-socket\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.194580 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.194522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-credential-socket\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.194580 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.194553    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-workload-certs\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.194948 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.194924    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-data\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.195065 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.194994    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-credential-socket\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.195152 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.195060    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-workload-certs\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.195152 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.195091    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-workload-socket\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.195296 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.195279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istiod-ca-cert\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.196834 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.196810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-envoy\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.196921 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.196889    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-podinfo\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.205608 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.205580    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd6rd\" (UniqueName: \"kubernetes.io/projected/90d1bc16-b32f-43b6-aeca-c4f4624f2604-kube-api-access-sd6rd\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.207740 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.207723    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-token\") pod \"e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") " pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.285837 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.285799    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:19.426791 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.426766    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"]
Aug 05 17:09:19.428208 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:09:19.428186    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90d1bc16_b32f_43b6_aeca_c4f4624f2604.slice/crio-6f7852e37aea7b7a89b010107b7201769413ce9278cd4b5a4c4aae366186e7f8 WatchSource:0}: Error finding container 6f7852e37aea7b7a89b010107b7201769413ce9278cd4b5a4c4aae366186e7f8: Status 404 returned error can't find the container with id 6f7852e37aea7b7a89b010107b7201769413ce9278cd4b5a4c4aae366186e7f8
Aug 05 17:09:19.430170 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.430141    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:09:19.430234 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.430198    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:09:19.430234 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.430226    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:09:19.799835 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.799798    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx" event={"ID":"90d1bc16-b32f-43b6-aeca-c4f4624f2604","Type":"ContainerStarted","Data":"97a20cdb7293a153a0b10d3fe596040dcddb1d6575a1a168f024def670b61e0f"}
Aug 05 17:09:19.800252 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.799859    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx" event={"ID":"90d1bc16-b32f-43b6-aeca-c4f4624f2604","Type":"ContainerStarted","Data":"6f7852e37aea7b7a89b010107b7201769413ce9278cd4b5a4c4aae366186e7f8"}
Aug 05 17:09:19.954545 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.954508    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a6ed76b-36f7-4579-92b0-fa2cef2299a9" path="/var/lib/kubelet/pods/6a6ed76b-36f7-4579-92b0-fa2cef2299a9/volumes"
Aug 05 17:09:19.955060 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:19.955026    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2b50407-f35f-4d1b-9c53-b074f7f92294" path="/var/lib/kubelet/pods/f2b50407-f35f-4d1b-9c53-b074f7f92294/volumes"
Aug 05 17:09:20.286989 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:20.286900    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:20.292251 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:20.292229    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:20.317766 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:20.317715    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx" podStartSLOduration=2.317700532 podStartE2EDuration="2.317700532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:09:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:09:19.832289665 +0000 UTC m=+1832.414361349" watchObservedRunningTime="2026-08-05 17:09:20.317700532 +0000 UTC m=+1832.899772187"
Aug 05 17:09:20.795388 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:20.795355    2565 patch_prober.go:28] interesting pod/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Aug 05 17:09:20.795556 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:20.795407    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm" podUID="1220b664-60ec-4ac5-b238-b688f6fd15e7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 17:09:20.806310 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:20.806286    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:20.807086 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:20.807066    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:23.414849 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.414824    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:09:23.525006 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.524936    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"]
Aug 05 17:09:23.525335 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.525320    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1220b664-60ec-4ac5-b238-b688f6fd15e7" containerName="istio-proxy"
Aug 05 17:09:23.525432 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.525337    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1220b664-60ec-4ac5-b238-b688f6fd15e7" containerName="istio-proxy"
Aug 05 17:09:23.525432 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.525346    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1220b664-60ec-4ac5-b238-b688f6fd15e7" containerName="istio-proxy"
Aug 05 17:09:23.525432 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.525352    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1220b664-60ec-4ac5-b238-b688f6fd15e7" containerName="istio-proxy"
Aug 05 17:09:23.525432 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.525408    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1220b664-60ec-4ac5-b238-b688f6fd15e7" containerName="istio-proxy"
Aug 05 17:09:23.525432 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.525417    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1220b664-60ec-4ac5-b238-b688f6fd15e7" containerName="istio-proxy"
Aug 05 17:09:23.528327 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.528306    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"
Aug 05 17:09:23.535546 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.535520    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-envoy\") pod \"1220b664-60ec-4ac5-b238-b688f6fd15e7\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") "
Aug 05 17:09:23.535718 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.535578    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-data\") pod \"1220b664-60ec-4ac5-b238-b688f6fd15e7\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") "
Aug 05 17:09:23.535718 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.535615    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9s67\" (UniqueName: \"kubernetes.io/projected/1220b664-60ec-4ac5-b238-b688f6fd15e7-kube-api-access-p9s67\") pod \"1220b664-60ec-4ac5-b238-b688f6fd15e7\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") "
Aug 05 17:09:23.535718 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.535642    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-workload-certs\") pod \"1220b664-60ec-4ac5-b238-b688f6fd15e7\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") "
Aug 05 17:09:23.535718 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.535691    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-credential-socket\") pod \"1220b664-60ec-4ac5-b238-b688f6fd15e7\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") "
Aug 05 17:09:23.535943 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.535728    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-podinfo\") pod \"1220b664-60ec-4ac5-b238-b688f6fd15e7\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") "
Aug 05 17:09:23.535943 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.535755    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-token\") pod \"1220b664-60ec-4ac5-b238-b688f6fd15e7\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") "
Aug 05 17:09:23.535943 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.535780    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1220b664-60ec-4ac5-b238-b688f6fd15e7-istiod-ca-cert\") pod \"1220b664-60ec-4ac5-b238-b688f6fd15e7\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") "
Aug 05 17:09:23.535943 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.535815    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-workload-socket\") pod \"1220b664-60ec-4ac5-b238-b688f6fd15e7\" (UID: \"1220b664-60ec-4ac5-b238-b688f6fd15e7\") "
Aug 05 17:09:23.537057 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.536948    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1220b664-60ec-4ac5-b238-b688f6fd15e7" (UID: "1220b664-60ec-4ac5-b238-b688f6fd15e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:09:23.537057 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.537041    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1220b664-60ec-4ac5-b238-b688f6fd15e7" (UID: "1220b664-60ec-4ac5-b238-b688f6fd15e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:09:23.539139 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.537341    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "1220b664-60ec-4ac5-b238-b688f6fd15e7" (UID: "1220b664-60ec-4ac5-b238-b688f6fd15e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:09:23.539139 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.537573    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1220b664-60ec-4ac5-b238-b688f6fd15e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1220b664-60ec-4ac5-b238-b688f6fd15e7" (UID: "1220b664-60ec-4ac5-b238-b688f6fd15e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:09:23.539139 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.537687    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1220b664-60ec-4ac5-b238-b688f6fd15e7" (UID: "1220b664-60ec-4ac5-b238-b688f6fd15e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:09:23.539496 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.539459    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1220b664-60ec-4ac5-b238-b688f6fd15e7-kube-api-access-p9s67" (OuterVolumeSpecName: "kube-api-access-p9s67") pod "1220b664-60ec-4ac5-b238-b688f6fd15e7" (UID: "1220b664-60ec-4ac5-b238-b688f6fd15e7"). InnerVolumeSpecName "kube-api-access-p9s67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:09:23.539814 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.539786    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1220b664-60ec-4ac5-b238-b688f6fd15e7" (UID: "1220b664-60ec-4ac5-b238-b688f6fd15e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:09:23.539889 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.539819    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1220b664-60ec-4ac5-b238-b688f6fd15e7" (UID: "1220b664-60ec-4ac5-b238-b688f6fd15e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:09:23.540054 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.540031    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "1220b664-60ec-4ac5-b238-b688f6fd15e7" (UID: "1220b664-60ec-4ac5-b238-b688f6fd15e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:09:23.562147 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.562123    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-324ed8e0\""
Aug 05 17:09:23.562495 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.562479    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-324ed8e0-dockercfg-vg5jl\""
Aug 05 17:09:23.564507 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.564488    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"]
Aug 05 17:09:23.624493 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.624464    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"]
Aug 05 17:09:23.628132 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.628086    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"
Aug 05 17:09:23.638405 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.638380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkfll\" (UniqueName: \"kubernetes.io/projected/0fefcc46-5a02-474b-a675-47d29af76bd9-kube-api-access-xkfll\") pod \"payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl\" (UID: \"0fefcc46-5a02-474b-a675-47d29af76bd9\") " pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"
Aug 05 17:09:23.638511 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.638430    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fefcc46-5a02-474b-a675-47d29af76bd9-plugins-config-volume\") pod \"payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl\" (UID: \"0fefcc46-5a02-474b-a675-47d29af76bd9\") " pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"
Aug 05 17:09:23.638948 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.638924    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-podinfo\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:23.639056 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.638962    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:23.639056 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.638979    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1220b664-60ec-4ac5-b238-b688f6fd15e7-istiod-ca-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:23.639056 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.638992    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-workload-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:23.639056 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.639005    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-envoy\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:23.639056 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.639023    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-istio-data\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:23.639056 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.639036    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9s67\" (UniqueName: \"kubernetes.io/projected/1220b664-60ec-4ac5-b238-b688f6fd15e7-kube-api-access-p9s67\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:23.639056 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.639051    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-workload-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:23.639364 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.639064    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1220b664-60ec-4ac5-b238-b688f6fd15e7-credential-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:23.664494 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.664465    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"]
Aug 05 17:09:23.740577 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.740529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c596abe9-392e-473f-856e-b576ec0378aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78\" (UID: \"c596abe9-392e-473f-856e-b576ec0378aa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"
Aug 05 17:09:23.740785 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.740589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkfll\" (UniqueName: \"kubernetes.io/projected/0fefcc46-5a02-474b-a675-47d29af76bd9-kube-api-access-xkfll\") pod \"payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl\" (UID: \"0fefcc46-5a02-474b-a675-47d29af76bd9\") " pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"
Aug 05 17:09:23.740785 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.740633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fefcc46-5a02-474b-a675-47d29af76bd9-plugins-config-volume\") pod \"payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl\" (UID: \"0fefcc46-5a02-474b-a675-47d29af76bd9\") " pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"
Aug 05 17:09:23.740785 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.740676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9tbm\" (UniqueName: \"kubernetes.io/projected/c596abe9-392e-473f-856e-b576ec0378aa-kube-api-access-k9tbm\") pod \"payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78\" (UID: \"c596abe9-392e-473f-856e-b576ec0378aa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"
Aug 05 17:09:23.741350 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.741330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fefcc46-5a02-474b-a675-47d29af76bd9-plugins-config-volume\") pod \"payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl\" (UID: \"0fefcc46-5a02-474b-a675-47d29af76bd9\") " pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"
Aug 05 17:09:23.767861 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.767826    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkfll\" (UniqueName: \"kubernetes.io/projected/0fefcc46-5a02-474b-a675-47d29af76bd9-kube-api-access-xkfll\") pod \"payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl\" (UID: \"0fefcc46-5a02-474b-a675-47d29af76bd9\") " pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"
Aug 05 17:09:23.822832 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.822794    2565 generic.go:356] "Generic (PLEG): container finished" podID="1220b664-60ec-4ac5-b238-b688f6fd15e7" containerID="290204471ee6c2f6ce471a58625715b036c9e42cd8c9af22f8d37e25fc914a40" exitCode=0
Aug 05 17:09:23.823013 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.822865    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"
Aug 05 17:09:23.823013 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.822881    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm" event={"ID":"1220b664-60ec-4ac5-b238-b688f6fd15e7","Type":"ContainerDied","Data":"290204471ee6c2f6ce471a58625715b036c9e42cd8c9af22f8d37e25fc914a40"}
Aug 05 17:09:23.823013 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.822935    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm" event={"ID":"1220b664-60ec-4ac5-b238-b688f6fd15e7","Type":"ContainerDied","Data":"5f2fb1706f772d298a9d36ea842a76cb84cb732bfd29c354d9b384caca397f4b"}
Aug 05 17:09:23.823013 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.822956    2565 scope.go:117] "RemoveContainer" containerID="290204471ee6c2f6ce471a58625715b036c9e42cd8c9af22f8d37e25fc914a40"
Aug 05 17:09:23.832933 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.832819    2565 scope.go:117] "RemoveContainer" containerID="b33b9ce44238a1ece3f4234b1f23d4a09ef8b3435754e627ae080e608fe81d26"
Aug 05 17:09:23.841649 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.841626    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"
Aug 05 17:09:23.841940 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.841874    2565 scope.go:117] "RemoveContainer" containerID="290204471ee6c2f6ce471a58625715b036c9e42cd8c9af22f8d37e25fc914a40"
Aug 05 17:09:23.842053 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.842030    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c596abe9-392e-473f-856e-b576ec0378aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78\" (UID: \"c596abe9-392e-473f-856e-b576ec0378aa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"
Aug 05 17:09:23.842146 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.842117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9tbm\" (UniqueName: \"kubernetes.io/projected/c596abe9-392e-473f-856e-b576ec0378aa-kube-api-access-k9tbm\") pod \"payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78\" (UID: \"c596abe9-392e-473f-856e-b576ec0378aa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"
Aug 05 17:09:23.842294 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:09:23.842271    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"290204471ee6c2f6ce471a58625715b036c9e42cd8c9af22f8d37e25fc914a40\": container with ID starting with 290204471ee6c2f6ce471a58625715b036c9e42cd8c9af22f8d37e25fc914a40 not found: ID does not exist" containerID="290204471ee6c2f6ce471a58625715b036c9e42cd8c9af22f8d37e25fc914a40"
Aug 05 17:09:23.842376 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.842303    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"290204471ee6c2f6ce471a58625715b036c9e42cd8c9af22f8d37e25fc914a40"} err="failed to get container status \"290204471ee6c2f6ce471a58625715b036c9e42cd8c9af22f8d37e25fc914a40\": rpc error: code = NotFound desc = could not find container \"290204471ee6c2f6ce471a58625715b036c9e42cd8c9af22f8d37e25fc914a40\": container with ID starting with 290204471ee6c2f6ce471a58625715b036c9e42cd8c9af22f8d37e25fc914a40 not found: ID does not exist"
Aug 05 17:09:23.842376 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.842321    2565 scope.go:117] "RemoveContainer" containerID="b33b9ce44238a1ece3f4234b1f23d4a09ef8b3435754e627ae080e608fe81d26"
Aug 05 17:09:23.842637 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:09:23.842615    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b33b9ce44238a1ece3f4234b1f23d4a09ef8b3435754e627ae080e608fe81d26\": container with ID starting with b33b9ce44238a1ece3f4234b1f23d4a09ef8b3435754e627ae080e608fe81d26 not found: ID does not exist" containerID="b33b9ce44238a1ece3f4234b1f23d4a09ef8b3435754e627ae080e608fe81d26"
Aug 05 17:09:23.842723 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.842643    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b33b9ce44238a1ece3f4234b1f23d4a09ef8b3435754e627ae080e608fe81d26"} err="failed to get container status \"b33b9ce44238a1ece3f4234b1f23d4a09ef8b3435754e627ae080e608fe81d26\": rpc error: code = NotFound desc = could not find container \"b33b9ce44238a1ece3f4234b1f23d4a09ef8b3435754e627ae080e608fe81d26\": container with ID starting with b33b9ce44238a1ece3f4234b1f23d4a09ef8b3435754e627ae080e608fe81d26 not found: ID does not exist"
Aug 05 17:09:23.842834 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.842816    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c596abe9-392e-473f-856e-b576ec0378aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78\" (UID: \"c596abe9-392e-473f-856e-b576ec0378aa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"
Aug 05 17:09:23.853815 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.853795    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9tbm\" (UniqueName: \"kubernetes.io/projected/c596abe9-392e-473f-856e-b576ec0378aa-kube-api-access-k9tbm\") pod \"payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78\" (UID: \"c596abe9-392e-473f-856e-b576ec0378aa\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"
Aug 05 17:09:23.861170 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.861147    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"]
Aug 05 17:09:23.864569 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.864549    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-1678b097-gw-openshift-default-74d6f47d88-qfjlm"]
Aug 05 17:09:23.938841 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.938772    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"
Aug 05 17:09:23.958439 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:23.958398    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1220b664-60ec-4ac5-b238-b688f6fd15e7" path="/var/lib/kubelet/pods/1220b664-60ec-4ac5-b238-b688f6fd15e7/volumes"
Aug 05 17:09:24.030336 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:09:24.030301    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fefcc46_5a02_474b_a675_47d29af76bd9.slice/crio-75ae1d10ad722d67c4b09bfbc411cdb89e90ee4d465b932bf974e9ec6d28a0ef WatchSource:0}: Error finding container 75ae1d10ad722d67c4b09bfbc411cdb89e90ee4d465b932bf974e9ec6d28a0ef: Status 404 returned error can't find the container with id 75ae1d10ad722d67c4b09bfbc411cdb89e90ee4d465b932bf974e9ec6d28a0ef
Aug 05 17:09:24.030821 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:24.030791    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"]
Aug 05 17:09:24.122085 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:24.122062    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"]
Aug 05 17:09:24.123722 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:09:24.123686    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc596abe9_392e_473f_856e_b576ec0378aa.slice/crio-18b1f8ab7b5c7b0834b5eddb55fead7334db173369cf925587cdc86b217c5ed9 WatchSource:0}: Error finding container 18b1f8ab7b5c7b0834b5eddb55fead7334db173369cf925587cdc86b217c5ed9: Status 404 returned error can't find the container with id 18b1f8ab7b5c7b0834b5eddb55fead7334db173369cf925587cdc86b217c5ed9
Aug 05 17:09:24.831828 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:24.831794    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78" event={"ID":"c596abe9-392e-473f-856e-b576ec0378aa","Type":"ContainerStarted","Data":"13c287f6859990f45c2ee141a4a5ab13dd94df2e0d2bfea64fe78a843e7f5419"}
Aug 05 17:09:24.832313 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:24.831846    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78" event={"ID":"c596abe9-392e-473f-856e-b576ec0378aa","Type":"ContainerStarted","Data":"18b1f8ab7b5c7b0834b5eddb55fead7334db173369cf925587cdc86b217c5ed9"}
Aug 05 17:09:24.832313 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:24.831971    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"
Aug 05 17:09:24.833633 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:24.833605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl" event={"ID":"0fefcc46-5a02-474b-a675-47d29af76bd9","Type":"ContainerStarted","Data":"4ef6c507807e200109fd3215b974010f3523c28607de607c23d7973c3804a41f"}
Aug 05 17:09:24.833771 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:24.833655    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl" event={"ID":"0fefcc46-5a02-474b-a675-47d29af76bd9","Type":"ContainerStarted","Data":"75ae1d10ad722d67c4b09bfbc411cdb89e90ee4d465b932bf974e9ec6d28a0ef"}
Aug 05 17:09:24.833771 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:24.833732    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"
Aug 05 17:09:24.863868 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:24.863824    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78" podStartSLOduration=1.8638102619999999 podStartE2EDuration="1.863810262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:09:24.863485839 +0000 UTC m=+1837.445557496" watchObservedRunningTime="2026-08-05 17:09:24.863810262 +0000 UTC m=+1837.445881919"
Aug 05 17:09:24.897766 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:24.897721    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl" podStartSLOduration=1.8977067490000001 podStartE2EDuration="1.897706749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:09:24.8963382 +0000 UTC m=+1837.478409856" watchObservedRunningTime="2026-08-05 17:09:24.897706749 +0000 UTC m=+1837.479778406"
Aug 05 17:09:34.898217 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:34.898184    2565 generic.go:356] "Generic (PLEG): container finished" podID="90d1bc16-b32f-43b6-aeca-c4f4624f2604" containerID="97a20cdb7293a153a0b10d3fe596040dcddb1d6575a1a168f024def670b61e0f" exitCode=0
Aug 05 17:09:34.898658 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:34.898257    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx" event={"ID":"90d1bc16-b32f-43b6-aeca-c4f4624f2604","Type":"ContainerDied","Data":"97a20cdb7293a153a0b10d3fe596040dcddb1d6575a1a168f024def670b61e0f"}
Aug 05 17:09:34.898708 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:34.898677    2565 scope.go:117] "RemoveContainer" containerID="97a20cdb7293a153a0b10d3fe596040dcddb1d6575a1a168f024def670b61e0f"
Aug 05 17:09:34.899796 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:34.899767    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:09:34.899870 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:34.899835    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:09:34.899870 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:34.899866    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:09:35.806476 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:35.806441    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:35.847705 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:35.847665    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"
Aug 05 17:09:35.847909 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:35.847769    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"
Aug 05 17:09:35.908567 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:35.908525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx" event={"ID":"90d1bc16-b32f-43b6-aeca-c4f4624f2604","Type":"ContainerStarted","Data":"295d495502866883d5f4ec48339700a2331fb4cd32e53a720682d3a88b360030"}
Aug 05 17:09:36.286793 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:36.286701    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:36.287751 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:36.287726    2565 patch_prober.go:28] interesting pod/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Aug 05 17:09:36.287864 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:36.287775    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx" podUID="90d1bc16-b32f-43b6-aeca-c4f4624f2604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Aug 05 17:09:37.286362 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:37.286326    2565 patch_prober.go:28] interesting pod/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Aug 05 17:09:37.286743 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:37.286379    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx" podUID="90d1bc16-b32f-43b6-aeca-c4f4624f2604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Aug 05 17:09:38.287118 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:38.287069    2565 patch_prober.go:28] interesting pod/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Aug 05 17:09:38.287531 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:38.287143    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx" podUID="90d1bc16-b32f-43b6-aeca-c4f4624f2604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Aug 05 17:09:39.286211 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:39.286171    2565 patch_prober.go:28] interesting pod/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Aug 05 17:09:39.286406 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:39.286260    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx" podUID="90d1bc16-b32f-43b6-aeca-c4f4624f2604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Aug 05 17:09:40.286682 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:40.286649    2565 patch_prober.go:28] interesting pod/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Aug 05 17:09:40.287057 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:40.286734    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx" podUID="90d1bc16-b32f-43b6-aeca-c4f4624f2604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Aug 05 17:09:41.290560 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:41.290528    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:41.290968 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:41.290782    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:41.291528 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:41.291509    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:09:56.741784 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:56.741752    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"]
Aug 05 17:09:56.742665 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:56.742612    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl" podUID="0fefcc46-5a02-474b-a675-47d29af76bd9" containerName="payload-processing" containerID="cri-o://4ef6c507807e200109fd3215b974010f3523c28607de607c23d7973c3804a41f" gracePeriod=30
Aug 05 17:09:56.751840 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:56.751813    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"]
Aug 05 17:09:56.752066 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:56.752021    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78" podUID="c596abe9-392e-473f-856e-b576ec0378aa" containerName="payload-pre-processing" containerID="cri-o://13c287f6859990f45c2ee141a4a5ab13dd94df2e0d2bfea64fe78a843e7f5419" gracePeriod=30
Aug 05 17:09:57.009245 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.009217    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"
Aug 05 17:09:57.019808 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.019775    2565 generic.go:356] "Generic (PLEG): container finished" podID="0fefcc46-5a02-474b-a675-47d29af76bd9" containerID="4ef6c507807e200109fd3215b974010f3523c28607de607c23d7973c3804a41f" exitCode=0
Aug 05 17:09:57.019967 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.019825    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"
Aug 05 17:09:57.019967 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.019857    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl" event={"ID":"0fefcc46-5a02-474b-a675-47d29af76bd9","Type":"ContainerDied","Data":"4ef6c507807e200109fd3215b974010f3523c28607de607c23d7973c3804a41f"}
Aug 05 17:09:57.019967 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.019909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl" event={"ID":"0fefcc46-5a02-474b-a675-47d29af76bd9","Type":"ContainerDied","Data":"75ae1d10ad722d67c4b09bfbc411cdb89e90ee4d465b932bf974e9ec6d28a0ef"}
Aug 05 17:09:57.019967 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.019939    2565 scope.go:117] "RemoveContainer" containerID="4ef6c507807e200109fd3215b974010f3523c28607de607c23d7973c3804a41f"
Aug 05 17:09:57.021685 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.021663    2565 generic.go:356] "Generic (PLEG): container finished" podID="c596abe9-392e-473f-856e-b576ec0378aa" containerID="13c287f6859990f45c2ee141a4a5ab13dd94df2e0d2bfea64fe78a843e7f5419" exitCode=0
Aug 05 17:09:57.021788 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.021733    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78" event={"ID":"c596abe9-392e-473f-856e-b576ec0378aa","Type":"ContainerDied","Data":"13c287f6859990f45c2ee141a4a5ab13dd94df2e0d2bfea64fe78a843e7f5419"}
Aug 05 17:09:57.036954 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.036934    2565 scope.go:117] "RemoveContainer" containerID="4ef6c507807e200109fd3215b974010f3523c28607de607c23d7973c3804a41f"
Aug 05 17:09:57.037336 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:09:57.037311    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ef6c507807e200109fd3215b974010f3523c28607de607c23d7973c3804a41f\": container with ID starting with 4ef6c507807e200109fd3215b974010f3523c28607de607c23d7973c3804a41f not found: ID does not exist" containerID="4ef6c507807e200109fd3215b974010f3523c28607de607c23d7973c3804a41f"
Aug 05 17:09:57.037434 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.037348    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef6c507807e200109fd3215b974010f3523c28607de607c23d7973c3804a41f"} err="failed to get container status \"4ef6c507807e200109fd3215b974010f3523c28607de607c23d7973c3804a41f\": rpc error: code = NotFound desc = could not find container \"4ef6c507807e200109fd3215b974010f3523c28607de607c23d7973c3804a41f\": container with ID starting with 4ef6c507807e200109fd3215b974010f3523c28607de607c23d7973c3804a41f not found: ID does not exist"
Aug 05 17:09:57.040939 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.040921    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"
Aug 05 17:09:57.140142 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.140116    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkfll\" (UniqueName: \"kubernetes.io/projected/0fefcc46-5a02-474b-a675-47d29af76bd9-kube-api-access-xkfll\") pod \"0fefcc46-5a02-474b-a675-47d29af76bd9\" (UID: \"0fefcc46-5a02-474b-a675-47d29af76bd9\") "
Aug 05 17:09:57.140325 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.140174    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fefcc46-5a02-474b-a675-47d29af76bd9-plugins-config-volume\") pod \"0fefcc46-5a02-474b-a675-47d29af76bd9\" (UID: \"0fefcc46-5a02-474b-a675-47d29af76bd9\") "
Aug 05 17:09:57.140325 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.140222    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c596abe9-392e-473f-856e-b576ec0378aa-plugins-config-volume\") pod \"c596abe9-392e-473f-856e-b576ec0378aa\" (UID: \"c596abe9-392e-473f-856e-b576ec0378aa\") "
Aug 05 17:09:57.140325 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.140255    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9tbm\" (UniqueName: \"kubernetes.io/projected/c596abe9-392e-473f-856e-b576ec0378aa-kube-api-access-k9tbm\") pod \"c596abe9-392e-473f-856e-b576ec0378aa\" (UID: \"c596abe9-392e-473f-856e-b576ec0378aa\") "
Aug 05 17:09:57.140641 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.140616    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fefcc46-5a02-474b-a675-47d29af76bd9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0fefcc46-5a02-474b-a675-47d29af76bd9" (UID: "0fefcc46-5a02-474b-a675-47d29af76bd9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:09:57.140641 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.140626    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c596abe9-392e-473f-856e-b576ec0378aa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c596abe9-392e-473f-856e-b576ec0378aa" (UID: "c596abe9-392e-473f-856e-b576ec0378aa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:09:57.142214 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.142192    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fefcc46-5a02-474b-a675-47d29af76bd9-kube-api-access-xkfll" (OuterVolumeSpecName: "kube-api-access-xkfll") pod "0fefcc46-5a02-474b-a675-47d29af76bd9" (UID: "0fefcc46-5a02-474b-a675-47d29af76bd9"). InnerVolumeSpecName "kube-api-access-xkfll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:09:57.142292 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.142256    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c596abe9-392e-473f-856e-b576ec0378aa-kube-api-access-k9tbm" (OuterVolumeSpecName: "kube-api-access-k9tbm") pod "c596abe9-392e-473f-856e-b576ec0378aa" (UID: "c596abe9-392e-473f-856e-b576ec0378aa"). InnerVolumeSpecName "kube-api-access-k9tbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:09:57.241318 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.241289    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkfll\" (UniqueName: \"kubernetes.io/projected/0fefcc46-5a02-474b-a675-47d29af76bd9-kube-api-access-xkfll\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:57.241318 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.241315    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fefcc46-5a02-474b-a675-47d29af76bd9-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:57.241318 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.241325    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c596abe9-392e-473f-856e-b576ec0378aa-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:57.241514 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.241334    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9tbm\" (UniqueName: \"kubernetes.io/projected/c596abe9-392e-473f-856e-b576ec0378aa-kube-api-access-k9tbm\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:09:57.358994 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.358967    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"]
Aug 05 17:09:57.363694 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.363670    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-324ed8e0-78c996bccd-qk9sl"]
Aug 05 17:09:57.952582 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:57.952542    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fefcc46-5a02-474b-a675-47d29af76bd9" path="/var/lib/kubelet/pods/0fefcc46-5a02-474b-a675-47d29af76bd9/volumes"
Aug 05 17:09:58.028652 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:58.028582    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"
Aug 05 17:09:58.028652 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:58.028597    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78" event={"ID":"c596abe9-392e-473f-856e-b576ec0378aa","Type":"ContainerDied","Data":"18b1f8ab7b5c7b0834b5eddb55fead7334db173369cf925587cdc86b217c5ed9"}
Aug 05 17:09:58.028652 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:58.028650    2565 scope.go:117] "RemoveContainer" containerID="13c287f6859990f45c2ee141a4a5ab13dd94df2e0d2bfea64fe78a843e7f5419"
Aug 05 17:09:58.056978 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:58.056944    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"]
Aug 05 17:09:58.061113 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:58.061072    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-324ed8e0-6f5d94f7b-q8x78"]
Aug 05 17:09:58.236008 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:58.235975    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"]
Aug 05 17:09:58.236246 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:58.236218    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx" podUID="90d1bc16-b32f-43b6-aeca-c4f4624f2604" containerName="istio-proxy" containerID="cri-o://295d495502866883d5f4ec48339700a2331fb4cd32e53a720682d3a88b360030" gracePeriod=30
Aug 05 17:09:59.076894 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.076864    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"]
Aug 05 17:09:59.077264 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.077246    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c596abe9-392e-473f-856e-b576ec0378aa" containerName="payload-pre-processing"
Aug 05 17:09:59.077264 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.077258    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c596abe9-392e-473f-856e-b576ec0378aa" containerName="payload-pre-processing"
Aug 05 17:09:59.077364 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.077269    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fefcc46-5a02-474b-a675-47d29af76bd9" containerName="payload-processing"
Aug 05 17:09:59.077364 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.077275    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fefcc46-5a02-474b-a675-47d29af76bd9" containerName="payload-processing"
Aug 05 17:09:59.077364 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.077332    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c596abe9-392e-473f-856e-b576ec0378aa" containerName="payload-pre-processing"
Aug 05 17:09:59.077364 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.077341    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fefcc46-5a02-474b-a675-47d29af76bd9" containerName="payload-processing"
Aug 05 17:09:59.081657 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.081641    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.085080 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.085058    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-8bdcbc9e-openshift-default-dockercfg-sq5nh\""
Aug 05 17:09:59.105114 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.105077    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"]
Aug 05 17:09:59.159833 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.159798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-data\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.160066 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.159851    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfj46\" (UniqueName: \"kubernetes.io/projected/2b9c5da3-f689-4a65-96b4-942968f42ec8-kube-api-access-hfj46\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.160066 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.159941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-token\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.160066 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.160017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-workload-certs\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.160066 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.160050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-envoy\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.160335 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.160119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b9c5da3-f689-4a65-96b4-942968f42ec8-istiod-ca-cert\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.160335 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.160226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-podinfo\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.160335 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.160273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-credential-socket\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.160335 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.160303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-workload-socket\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.261702 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.261672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-podinfo\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.261892 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.261712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-credential-socket\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.261892 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.261731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-workload-socket\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.261892 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.261769    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-data\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.261892 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.261786    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfj46\" (UniqueName: \"kubernetes.io/projected/2b9c5da3-f689-4a65-96b4-942968f42ec8-kube-api-access-hfj46\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.261892 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.261804    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-token\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.261892 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.261833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-workload-certs\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.261892 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.261850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-envoy\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.261892 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.261882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b9c5da3-f689-4a65-96b4-942968f42ec8-istiod-ca-cert\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.262388 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.262237    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-credential-socket\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.262388 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.262300    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-workload-socket\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.262388 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.262336    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-workload-certs\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.262388 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.262381    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-data\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.262636 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.262611    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b9c5da3-f689-4a65-96b4-942968f42ec8-istiod-ca-cert\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.264176 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.264155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-envoy\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.264430 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.264414    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-podinfo\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.270674 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.270646    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-token\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.271078 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.271058    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfj46\" (UniqueName: \"kubernetes.io/projected/2b9c5da3-f689-4a65-96b4-942968f42ec8-kube-api-access-hfj46\") pod \"e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") " pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.391813 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.391719    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:09:59.537902 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.537873    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"]
Aug 05 17:09:59.538821 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:09:59.538778    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b9c5da3_f689_4a65_96b4_942968f42ec8.slice/crio-a5412ef0b9c025bc5c1bebd5a3964b5ddad4574c013e77569d271691ce675e48 WatchSource:0}: Error finding container a5412ef0b9c025bc5c1bebd5a3964b5ddad4574c013e77569d271691ce675e48: Status 404 returned error can't find the container with id a5412ef0b9c025bc5c1bebd5a3964b5ddad4574c013e77569d271691ce675e48
Aug 05 17:09:59.541455 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.541412    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:09:59.541538 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.541514    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:09:59.541579 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.541562    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:09:59.953241 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:09:59.953211    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c596abe9-392e-473f-856e-b576ec0378aa" path="/var/lib/kubelet/pods/c596abe9-392e-473f-856e-b576ec0378aa/volumes"
Aug 05 17:10:00.043758 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:00.043724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs" event={"ID":"2b9c5da3-f689-4a65-96b4-942968f42ec8","Type":"ContainerStarted","Data":"a2e99e19e1a73a98fdcf050e948fbaa03426e7f8d4f1ac8934f18f5638042ca7"}
Aug 05 17:10:00.043921 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:00.043784    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs" event={"ID":"2b9c5da3-f689-4a65-96b4-942968f42ec8","Type":"ContainerStarted","Data":"a5412ef0b9c025bc5c1bebd5a3964b5ddad4574c013e77569d271691ce675e48"}
Aug 05 17:10:00.392527 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:00.392491    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:10:00.397439 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:00.397414    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:10:00.425857 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:00.425806    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs" podStartSLOduration=1.4257899 podStartE2EDuration="1.4257899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:09:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:10:00.07527203 +0000 UTC m=+1872.657343686" watchObservedRunningTime="2026-08-05 17:10:00.4257899 +0000 UTC m=+1873.007861555"
Aug 05 17:10:01.049051 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:01.049019    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:10:01.049922 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:01.049904    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:10:03.419938 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.419904    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"]
Aug 05 17:10:03.424019 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.423992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"
Aug 05 17:10:03.426975 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.426953    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-8bdcbc9e\""
Aug 05 17:10:03.427109 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.426984    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-8bdcbc9e-dockercfg-xk4k4\""
Aug 05 17:10:03.437980 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.437956    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"]
Aug 05 17:10:03.502500 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.502431    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7e6053d-5076-46ad-af3d-a97048cb398f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd\" (UID: \"e7e6053d-5076-46ad-af3d-a97048cb398f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"
Aug 05 17:10:03.502500 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.502490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dnjp\" (UniqueName: \"kubernetes.io/projected/e7e6053d-5076-46ad-af3d-a97048cb398f-kube-api-access-2dnjp\") pod \"payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd\" (UID: \"e7e6053d-5076-46ad-af3d-a97048cb398f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"
Aug 05 17:10:03.512516 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.512490    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"]
Aug 05 17:10:03.514281 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.514264    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:10:03.515726 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.515712    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"
Aug 05 17:10:03.531395 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.530665    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"]
Aug 05 17:10:03.602900 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.602869    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-token\") pod \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") "
Aug 05 17:10:03.603071 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.602972    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-workload-certs\") pod \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") "
Aug 05 17:10:03.603071 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603022    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd6rd\" (UniqueName: \"kubernetes.io/projected/90d1bc16-b32f-43b6-aeca-c4f4624f2604-kube-api-access-sd6rd\") pod \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") "
Aug 05 17:10:03.603071 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603058    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-workload-socket\") pod \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") "
Aug 05 17:10:03.603224 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603090    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-data\") pod \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") "
Aug 05 17:10:03.603281 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603244    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "90d1bc16-b32f-43b6-aeca-c4f4624f2604" (UID: "90d1bc16-b32f-43b6-aeca-c4f4624f2604"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:10:03.603281 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603260    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istiod-ca-cert\") pod \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") "
Aug 05 17:10:03.603395 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603330    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-podinfo\") pod \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") "
Aug 05 17:10:03.603395 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603341    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "90d1bc16-b32f-43b6-aeca-c4f4624f2604" (UID: "90d1bc16-b32f-43b6-aeca-c4f4624f2604"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:10:03.603395 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603371    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-data" (OuterVolumeSpecName: "istio-data") pod "90d1bc16-b32f-43b6-aeca-c4f4624f2604" (UID: "90d1bc16-b32f-43b6-aeca-c4f4624f2604"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:10:03.603547 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603521    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "90d1bc16-b32f-43b6-aeca-c4f4624f2604" (UID: "90d1bc16-b32f-43b6-aeca-c4f4624f2604"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:10:03.603691 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603667    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-credential-socket\") pod \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") "
Aug 05 17:10:03.603814 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603698    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-envoy\") pod \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\" (UID: \"90d1bc16-b32f-43b6-aeca-c4f4624f2604\") "
Aug 05 17:10:03.603889 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7e6053d-5076-46ad-af3d-a97048cb398f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd\" (UID: \"e7e6053d-5076-46ad-af3d-a97048cb398f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"
Aug 05 17:10:03.603948 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603896    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "90d1bc16-b32f-43b6-aeca-c4f4624f2604" (UID: "90d1bc16-b32f-43b6-aeca-c4f4624f2604"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:10:03.603948 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24n6s\" (UniqueName: \"kubernetes.io/projected/6141e7c1-2bf7-4df7-8006-a9126be2545d-kube-api-access-24n6s\") pod \"payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk\" (UID: \"6141e7c1-2bf7-4df7-8006-a9126be2545d\") " pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"
Aug 05 17:10:03.604069 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dnjp\" (UniqueName: \"kubernetes.io/projected/e7e6053d-5076-46ad-af3d-a97048cb398f-kube-api-access-2dnjp\") pod \"payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd\" (UID: \"e7e6053d-5076-46ad-af3d-a97048cb398f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"
Aug 05 17:10:03.604069 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.603969    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6141e7c1-2bf7-4df7-8006-a9126be2545d-plugins-config-volume\") pod \"payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk\" (UID: \"6141e7c1-2bf7-4df7-8006-a9126be2545d\") " pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"
Aug 05 17:10:03.604206 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.604081    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-workload-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:03.604206 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.604118    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-data\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:03.604206 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.604131    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istiod-ca-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:03.604206 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.604142    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-credential-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:03.604206 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.604154    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-workload-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:03.604782 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.604755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7e6053d-5076-46ad-af3d-a97048cb398f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd\" (UID: \"e7e6053d-5076-46ad-af3d-a97048cb398f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"
Aug 05 17:10:03.605397 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.605375    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90d1bc16-b32f-43b6-aeca-c4f4624f2604-kube-api-access-sd6rd" (OuterVolumeSpecName: "kube-api-access-sd6rd") pod "90d1bc16-b32f-43b6-aeca-c4f4624f2604" (UID: "90d1bc16-b32f-43b6-aeca-c4f4624f2604"). InnerVolumeSpecName "kube-api-access-sd6rd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:10:03.605534 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.605511    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "90d1bc16-b32f-43b6-aeca-c4f4624f2604" (UID: "90d1bc16-b32f-43b6-aeca-c4f4624f2604"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:10:03.605581 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.605517    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-token" (OuterVolumeSpecName: "istio-token") pod "90d1bc16-b32f-43b6-aeca-c4f4624f2604" (UID: "90d1bc16-b32f-43b6-aeca-c4f4624f2604"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:10:03.605897 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.605876    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "90d1bc16-b32f-43b6-aeca-c4f4624f2604" (UID: "90d1bc16-b32f-43b6-aeca-c4f4624f2604"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:10:03.613447 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.613421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dnjp\" (UniqueName: \"kubernetes.io/projected/e7e6053d-5076-46ad-af3d-a97048cb398f-kube-api-access-2dnjp\") pod \"payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd\" (UID: \"e7e6053d-5076-46ad-af3d-a97048cb398f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"
Aug 05 17:10:03.705074 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.705038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24n6s\" (UniqueName: \"kubernetes.io/projected/6141e7c1-2bf7-4df7-8006-a9126be2545d-kube-api-access-24n6s\") pod \"payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk\" (UID: \"6141e7c1-2bf7-4df7-8006-a9126be2545d\") " pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"
Aug 05 17:10:03.705243 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.705085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6141e7c1-2bf7-4df7-8006-a9126be2545d-plugins-config-volume\") pod \"payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk\" (UID: \"6141e7c1-2bf7-4df7-8006-a9126be2545d\") " pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"
Aug 05 17:10:03.705243 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.705158    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-podinfo\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:03.705243 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.705172    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-envoy\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:03.705243 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.705181    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90d1bc16-b32f-43b6-aeca-c4f4624f2604-istio-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:03.705243 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.705189    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd6rd\" (UniqueName: \"kubernetes.io/projected/90d1bc16-b32f-43b6-aeca-c4f4624f2604-kube-api-access-sd6rd\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:03.705863 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.705844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6141e7c1-2bf7-4df7-8006-a9126be2545d-plugins-config-volume\") pod \"payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk\" (UID: \"6141e7c1-2bf7-4df7-8006-a9126be2545d\") " pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"
Aug 05 17:10:03.713906 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.713887    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24n6s\" (UniqueName: \"kubernetes.io/projected/6141e7c1-2bf7-4df7-8006-a9126be2545d-kube-api-access-24n6s\") pod \"payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk\" (UID: \"6141e7c1-2bf7-4df7-8006-a9126be2545d\") " pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"
Aug 05 17:10:03.737834 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.737802    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"
Aug 05 17:10:03.826698 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.826661    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"
Aug 05 17:10:03.889376 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.889337    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"]
Aug 05 17:10:03.890407 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:10:03.890352    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e6053d_5076_46ad_af3d_a97048cb398f.slice/crio-d75e63efa53010b054f531b7577e3756168cf706fcc7ca3139cf061ddf2bf541 WatchSource:0}: Error finding container d75e63efa53010b054f531b7577e3756168cf706fcc7ca3139cf061ddf2bf541: Status 404 returned error can't find the container with id d75e63efa53010b054f531b7577e3756168cf706fcc7ca3139cf061ddf2bf541
Aug 05 17:10:03.992069 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:03.992047    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"]
Aug 05 17:10:03.993580 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:10:03.993552    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6141e7c1_2bf7_4df7_8006_a9126be2545d.slice/crio-67edb78248c639deba4763cfe0cdaf21b95320e21bfa70459f96113ea6931e5e WatchSource:0}: Error finding container 67edb78248c639deba4763cfe0cdaf21b95320e21bfa70459f96113ea6931e5e: Status 404 returned error can't find the container with id 67edb78248c639deba4763cfe0cdaf21b95320e21bfa70459f96113ea6931e5e
Aug 05 17:10:04.067863 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.067832    2565 generic.go:356] "Generic (PLEG): container finished" podID="90d1bc16-b32f-43b6-aeca-c4f4624f2604" containerID="295d495502866883d5f4ec48339700a2331fb4cd32e53a720682d3a88b360030" exitCode=0
Aug 05 17:10:04.068052 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.067892    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"
Aug 05 17:10:04.068052 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.067924    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx" event={"ID":"90d1bc16-b32f-43b6-aeca-c4f4624f2604","Type":"ContainerDied","Data":"295d495502866883d5f4ec48339700a2331fb4cd32e53a720682d3a88b360030"}
Aug 05 17:10:04.068052 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.068006    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx" event={"ID":"90d1bc16-b32f-43b6-aeca-c4f4624f2604","Type":"ContainerDied","Data":"6f7852e37aea7b7a89b010107b7201769413ce9278cd4b5a4c4aae366186e7f8"}
Aug 05 17:10:04.068052 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.068041    2565 scope.go:117] "RemoveContainer" containerID="295d495502866883d5f4ec48339700a2331fb4cd32e53a720682d3a88b360030"
Aug 05 17:10:04.069849 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.069827    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk" event={"ID":"6141e7c1-2bf7-4df7-8006-a9126be2545d","Type":"ContainerStarted","Data":"c65c9c34895c6fb12a243763855d46f8cc6ead15cce8af51ed11507c9f1e850d"}
Aug 05 17:10:04.070117 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.070079    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk" event={"ID":"6141e7c1-2bf7-4df7-8006-a9126be2545d","Type":"ContainerStarted","Data":"67edb78248c639deba4763cfe0cdaf21b95320e21bfa70459f96113ea6931e5e"}
Aug 05 17:10:04.070373 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.070356    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"
Aug 05 17:10:04.072729 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.072580    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd" event={"ID":"e7e6053d-5076-46ad-af3d-a97048cb398f","Type":"ContainerStarted","Data":"6d65489e5573e92fc866cb2b3e55fb8f2315f339b7c5c2b809554d8fd6f94ae2"}
Aug 05 17:10:04.072729 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.072622    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd" event={"ID":"e7e6053d-5076-46ad-af3d-a97048cb398f","Type":"ContainerStarted","Data":"d75e63efa53010b054f531b7577e3756168cf706fcc7ca3139cf061ddf2bf541"}
Aug 05 17:10:04.072729 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.072659    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"
Aug 05 17:10:04.078716 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.078698    2565 scope.go:117] "RemoveContainer" containerID="97a20cdb7293a153a0b10d3fe596040dcddb1d6575a1a168f024def670b61e0f"
Aug 05 17:10:04.088777 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.088755    2565 scope.go:117] "RemoveContainer" containerID="295d495502866883d5f4ec48339700a2331fb4cd32e53a720682d3a88b360030"
Aug 05 17:10:04.089130 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:10:04.089089    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"295d495502866883d5f4ec48339700a2331fb4cd32e53a720682d3a88b360030\": container with ID starting with 295d495502866883d5f4ec48339700a2331fb4cd32e53a720682d3a88b360030 not found: ID does not exist" containerID="295d495502866883d5f4ec48339700a2331fb4cd32e53a720682d3a88b360030"
Aug 05 17:10:04.089233 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.089136    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"295d495502866883d5f4ec48339700a2331fb4cd32e53a720682d3a88b360030"} err="failed to get container status \"295d495502866883d5f4ec48339700a2331fb4cd32e53a720682d3a88b360030\": rpc error: code = NotFound desc = could not find container \"295d495502866883d5f4ec48339700a2331fb4cd32e53a720682d3a88b360030\": container with ID starting with 295d495502866883d5f4ec48339700a2331fb4cd32e53a720682d3a88b360030 not found: ID does not exist"
Aug 05 17:10:04.089233 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.089153    2565 scope.go:117] "RemoveContainer" containerID="97a20cdb7293a153a0b10d3fe596040dcddb1d6575a1a168f024def670b61e0f"
Aug 05 17:10:04.089481 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:10:04.089452    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97a20cdb7293a153a0b10d3fe596040dcddb1d6575a1a168f024def670b61e0f\": container with ID starting with 97a20cdb7293a153a0b10d3fe596040dcddb1d6575a1a168f024def670b61e0f not found: ID does not exist" containerID="97a20cdb7293a153a0b10d3fe596040dcddb1d6575a1a168f024def670b61e0f"
Aug 05 17:10:04.089531 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.089493    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97a20cdb7293a153a0b10d3fe596040dcddb1d6575a1a168f024def670b61e0f"} err="failed to get container status \"97a20cdb7293a153a0b10d3fe596040dcddb1d6575a1a168f024def670b61e0f\": rpc error: code = NotFound desc = could not find container \"97a20cdb7293a153a0b10d3fe596040dcddb1d6575a1a168f024def670b61e0f\": container with ID starting with 97a20cdb7293a153a0b10d3fe596040dcddb1d6575a1a168f024def670b61e0f not found: ID does not exist"
Aug 05 17:10:04.104805 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.104758    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk" podStartSLOduration=1.104744207 podStartE2EDuration="1.104744207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:10:04.103352183 +0000 UTC m=+1876.685423839" watchObservedRunningTime="2026-08-05 17:10:04.104744207 +0000 UTC m=+1876.686815863"
Aug 05 17:10:04.133425 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.133371    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd" podStartSLOduration=1.133355387 podStartE2EDuration="1.133355387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:10:04.131898575 +0000 UTC m=+1876.713970264" watchObservedRunningTime="2026-08-05 17:10:04.133355387 +0000 UTC m=+1876.715427043"
Aug 05 17:10:04.152934 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.152905    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"]
Aug 05 17:10:04.159150 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:04.159119    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-324ed8e0-openshift-default-677765d8bb-rnstx"]
Aug 05 17:10:05.955631 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:05.955601    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90d1bc16-b32f-43b6-aeca-c4f4624f2604" path="/var/lib/kubelet/pods/90d1bc16-b32f-43b6-aeca-c4f4624f2604/volumes"
Aug 05 17:10:15.081152 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:15.081119    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"
Aug 05 17:10:16.050913 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:16.050876    2565 patch_prober.go:28] interesting pod/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 05 17:10:16.051185 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:16.050935    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs" podUID="2b9c5da3-f689-4a65-96b4-942968f42ec8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 05 17:10:16.087089 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:16.087058    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"
Aug 05 17:10:16.143331 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:16.143299    2565 generic.go:356] "Generic (PLEG): container finished" podID="2b9c5da3-f689-4a65-96b4-942968f42ec8" containerID="a2e99e19e1a73a98fdcf050e948fbaa03426e7f8d4f1ac8934f18f5638042ca7" exitCode=0
Aug 05 17:10:16.143530 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:16.143368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs" event={"ID":"2b9c5da3-f689-4a65-96b4-942968f42ec8","Type":"ContainerDied","Data":"a2e99e19e1a73a98fdcf050e948fbaa03426e7f8d4f1ac8934f18f5638042ca7"}
Aug 05 17:10:16.143753 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:16.143739    2565 scope.go:117] "RemoveContainer" containerID="a2e99e19e1a73a98fdcf050e948fbaa03426e7f8d4f1ac8934f18f5638042ca7"
Aug 05 17:10:16.144776 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:16.144744    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:10:16.144890 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:16.144829    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:10:16.144890 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:16.144878    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:10:17.161145 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:17.159931    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs" event={"ID":"2b9c5da3-f689-4a65-96b4-942968f42ec8","Type":"ContainerStarted","Data":"1e47bde5ae550c8a25d708e6ea89fd86a03c5d32901850801d4b43060119eb9e"}
Aug 05 17:10:17.392642 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:17.392608    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:10:17.392801 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:17.392733    2565 patch_prober.go:28] interesting pod/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 05 17:10:17.392801 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:17.392782    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs" podUID="2b9c5da3-f689-4a65-96b4-942968f42ec8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 05 17:10:18.392084 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:18.392048    2565 patch_prober.go:28] interesting pod/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 05 17:10:18.392500 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:18.392128    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs" podUID="2b9c5da3-f689-4a65-96b4-942968f42ec8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 05 17:10:19.392989 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:19.392950    2565 patch_prober.go:28] interesting pod/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 05 17:10:19.393400 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:19.393004    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs" podUID="2b9c5da3-f689-4a65-96b4-942968f42ec8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 05 17:10:20.393000 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:20.392964    2565 patch_prober.go:28] interesting pod/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 05 17:10:20.393484 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:20.393025    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs" podUID="2b9c5da3-f689-4a65-96b4-942968f42ec8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 05 17:10:21.392351 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:21.392320    2565 patch_prober.go:28] interesting pod/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Aug 05 17:10:21.392530 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:21.392376    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs" podUID="2b9c5da3-f689-4a65-96b4-942968f42ec8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Aug 05 17:10:22.297788 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.297755    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"]
Aug 05 17:10:22.298269 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.297988    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk" podUID="6141e7c1-2bf7-4df7-8006-a9126be2545d" containerName="payload-processing" containerID="cri-o://c65c9c34895c6fb12a243763855d46f8cc6ead15cce8af51ed11507c9f1e850d" gracePeriod=30
Aug 05 17:10:22.310911 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.310888    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"]
Aug 05 17:10:22.311083 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.311064    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd" podUID="e7e6053d-5076-46ad-af3d-a97048cb398f" containerName="payload-pre-processing" containerID="cri-o://6d65489e5573e92fc866cb2b3e55fb8f2315f339b7c5c2b809554d8fd6f94ae2" gracePeriod=30
Aug 05 17:10:22.396225 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.396203    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:10:22.396496 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.396478    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:10:22.397212 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.397193    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:10:22.607272 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.607247    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"
Aug 05 17:10:22.609243 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.609221    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"
Aug 05 17:10:22.681019 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.680985    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24n6s\" (UniqueName: \"kubernetes.io/projected/6141e7c1-2bf7-4df7-8006-a9126be2545d-kube-api-access-24n6s\") pod \"6141e7c1-2bf7-4df7-8006-a9126be2545d\" (UID: \"6141e7c1-2bf7-4df7-8006-a9126be2545d\") "
Aug 05 17:10:22.681233 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.681047    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6141e7c1-2bf7-4df7-8006-a9126be2545d-plugins-config-volume\") pod \"6141e7c1-2bf7-4df7-8006-a9126be2545d\" (UID: \"6141e7c1-2bf7-4df7-8006-a9126be2545d\") "
Aug 05 17:10:22.681233 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.681111    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dnjp\" (UniqueName: \"kubernetes.io/projected/e7e6053d-5076-46ad-af3d-a97048cb398f-kube-api-access-2dnjp\") pod \"e7e6053d-5076-46ad-af3d-a97048cb398f\" (UID: \"e7e6053d-5076-46ad-af3d-a97048cb398f\") "
Aug 05 17:10:22.681233 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.681166    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7e6053d-5076-46ad-af3d-a97048cb398f-plugins-config-volume\") pod \"e7e6053d-5076-46ad-af3d-a97048cb398f\" (UID: \"e7e6053d-5076-46ad-af3d-a97048cb398f\") "
Aug 05 17:10:22.681559 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.681530    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6141e7c1-2bf7-4df7-8006-a9126be2545d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6141e7c1-2bf7-4df7-8006-a9126be2545d" (UID: "6141e7c1-2bf7-4df7-8006-a9126be2545d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:10:22.681795 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.681764    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7e6053d-5076-46ad-af3d-a97048cb398f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e7e6053d-5076-46ad-af3d-a97048cb398f" (UID: "e7e6053d-5076-46ad-af3d-a97048cb398f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:10:22.683537 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.683499    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e6053d-5076-46ad-af3d-a97048cb398f-kube-api-access-2dnjp" (OuterVolumeSpecName: "kube-api-access-2dnjp") pod "e7e6053d-5076-46ad-af3d-a97048cb398f" (UID: "e7e6053d-5076-46ad-af3d-a97048cb398f"). InnerVolumeSpecName "kube-api-access-2dnjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:10:22.684985 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.684967    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6141e7c1-2bf7-4df7-8006-a9126be2545d-kube-api-access-24n6s" (OuterVolumeSpecName: "kube-api-access-24n6s") pod "6141e7c1-2bf7-4df7-8006-a9126be2545d" (UID: "6141e7c1-2bf7-4df7-8006-a9126be2545d"). InnerVolumeSpecName "kube-api-access-24n6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:10:22.693868 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.693846    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"]
Aug 05 17:10:22.782309 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.782273    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7e6053d-5076-46ad-af3d-a97048cb398f-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:22.782309 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.782303    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24n6s\" (UniqueName: \"kubernetes.io/projected/6141e7c1-2bf7-4df7-8006-a9126be2545d-kube-api-access-24n6s\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:22.782309 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.782312    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6141e7c1-2bf7-4df7-8006-a9126be2545d-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:22.782545 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:22.782321    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dnjp\" (UniqueName: \"kubernetes.io/projected/e7e6053d-5076-46ad-af3d-a97048cb398f-kube-api-access-2dnjp\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:23.198813 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.198780    2565 generic.go:356] "Generic (PLEG): container finished" podID="e7e6053d-5076-46ad-af3d-a97048cb398f" containerID="6d65489e5573e92fc866cb2b3e55fb8f2315f339b7c5c2b809554d8fd6f94ae2" exitCode=0
Aug 05 17:10:23.198999 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.198831    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"
Aug 05 17:10:23.198999 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.198870    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd" event={"ID":"e7e6053d-5076-46ad-af3d-a97048cb398f","Type":"ContainerDied","Data":"6d65489e5573e92fc866cb2b3e55fb8f2315f339b7c5c2b809554d8fd6f94ae2"}
Aug 05 17:10:23.198999 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.198922    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd" event={"ID":"e7e6053d-5076-46ad-af3d-a97048cb398f","Type":"ContainerDied","Data":"d75e63efa53010b054f531b7577e3756168cf706fcc7ca3139cf061ddf2bf541"}
Aug 05 17:10:23.198999 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.198948    2565 scope.go:117] "RemoveContainer" containerID="6d65489e5573e92fc866cb2b3e55fb8f2315f339b7c5c2b809554d8fd6f94ae2"
Aug 05 17:10:23.200205 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.200176    2565 generic.go:356] "Generic (PLEG): container finished" podID="6141e7c1-2bf7-4df7-8006-a9126be2545d" containerID="c65c9c34895c6fb12a243763855d46f8cc6ead15cce8af51ed11507c9f1e850d" exitCode=0
Aug 05 17:10:23.200332 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.200213    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk" event={"ID":"6141e7c1-2bf7-4df7-8006-a9126be2545d","Type":"ContainerDied","Data":"c65c9c34895c6fb12a243763855d46f8cc6ead15cce8af51ed11507c9f1e850d"}
Aug 05 17:10:23.200332 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.200232    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"
Aug 05 17:10:23.200332 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.200260    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk" event={"ID":"6141e7c1-2bf7-4df7-8006-a9126be2545d","Type":"ContainerDied","Data":"67edb78248c639deba4763cfe0cdaf21b95320e21bfa70459f96113ea6931e5e"}
Aug 05 17:10:23.200708 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.200688    2565 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs" secret="" err="secret \"e2e-derive-8bdcbc9e-openshift-default-dockercfg-sq5nh\" not found"
Aug 05 17:10:23.208730 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.208716    2565 scope.go:117] "RemoveContainer" containerID="6d65489e5573e92fc866cb2b3e55fb8f2315f339b7c5c2b809554d8fd6f94ae2"
Aug 05 17:10:23.208969 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:10:23.208953    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d65489e5573e92fc866cb2b3e55fb8f2315f339b7c5c2b809554d8fd6f94ae2\": container with ID starting with 6d65489e5573e92fc866cb2b3e55fb8f2315f339b7c5c2b809554d8fd6f94ae2 not found: ID does not exist" containerID="6d65489e5573e92fc866cb2b3e55fb8f2315f339b7c5c2b809554d8fd6f94ae2"
Aug 05 17:10:23.209022 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.208978    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d65489e5573e92fc866cb2b3e55fb8f2315f339b7c5c2b809554d8fd6f94ae2"} err="failed to get container status \"6d65489e5573e92fc866cb2b3e55fb8f2315f339b7c5c2b809554d8fd6f94ae2\": rpc error: code = NotFound desc = could not find container \"6d65489e5573e92fc866cb2b3e55fb8f2315f339b7c5c2b809554d8fd6f94ae2\": container with ID starting with 6d65489e5573e92fc866cb2b3e55fb8f2315f339b7c5c2b809554d8fd6f94ae2 not found: ID does not exist"
Aug 05 17:10:23.209022 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.208995    2565 scope.go:117] "RemoveContainer" containerID="c65c9c34895c6fb12a243763855d46f8cc6ead15cce8af51ed11507c9f1e850d"
Aug 05 17:10:23.216989 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.216973    2565 scope.go:117] "RemoveContainer" containerID="c65c9c34895c6fb12a243763855d46f8cc6ead15cce8af51ed11507c9f1e850d"
Aug 05 17:10:23.217605 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:10:23.217584    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c65c9c34895c6fb12a243763855d46f8cc6ead15cce8af51ed11507c9f1e850d\": container with ID starting with c65c9c34895c6fb12a243763855d46f8cc6ead15cce8af51ed11507c9f1e850d not found: ID does not exist" containerID="c65c9c34895c6fb12a243763855d46f8cc6ead15cce8af51ed11507c9f1e850d"
Aug 05 17:10:23.217686 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.217612    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c65c9c34895c6fb12a243763855d46f8cc6ead15cce8af51ed11507c9f1e850d"} err="failed to get container status \"c65c9c34895c6fb12a243763855d46f8cc6ead15cce8af51ed11507c9f1e850d\": rpc error: code = NotFound desc = could not find container \"c65c9c34895c6fb12a243763855d46f8cc6ead15cce8af51ed11507c9f1e850d\": container with ID starting with c65c9c34895c6fb12a243763855d46f8cc6ead15cce8af51ed11507c9f1e850d not found: ID does not exist"
Aug 05 17:10:23.229660 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.229632    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"]
Aug 05 17:10:23.238127 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.238091    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-8bdcbc9e-6d6dd446db-vssxk"]
Aug 05 17:10:23.253295 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.253274    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"]
Aug 05 17:10:23.256803 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.256784    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8bdcbc9e-7b4559974d-wr2sd"]
Aug 05 17:10:23.952608 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.952567    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6141e7c1-2bf7-4df7-8006-a9126be2545d" path="/var/lib/kubelet/pods/6141e7c1-2bf7-4df7-8006-a9126be2545d/volumes"
Aug 05 17:10:23.953192 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:23.953158    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7e6053d-5076-46ad-af3d-a97048cb398f" path="/var/lib/kubelet/pods/e7e6053d-5076-46ad-af3d-a97048cb398f/volumes"
Aug 05 17:10:24.207583 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:24.207501    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs" podUID="2b9c5da3-f689-4a65-96b4-942968f42ec8" containerName="istio-proxy" containerID="cri-o://1e47bde5ae550c8a25d708e6ea89fd86a03c5d32901850801d4b43060119eb9e" gracePeriod=30
Aug 05 17:10:29.462792 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.462770    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:10:29.530375 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530305    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-token\") pod \"2b9c5da3-f689-4a65-96b4-942968f42ec8\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") "
Aug 05 17:10:29.530375 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530337    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-credential-socket\") pod \"2b9c5da3-f689-4a65-96b4-942968f42ec8\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") "
Aug 05 17:10:29.530375 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530368    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-podinfo\") pod \"2b9c5da3-f689-4a65-96b4-942968f42ec8\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") "
Aug 05 17:10:29.530619 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530419    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-workload-certs\") pod \"2b9c5da3-f689-4a65-96b4-942968f42ec8\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") "
Aug 05 17:10:29.530619 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530444    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-envoy\") pod \"2b9c5da3-f689-4a65-96b4-942968f42ec8\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") "
Aug 05 17:10:29.530619 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530470    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-workload-socket\") pod \"2b9c5da3-f689-4a65-96b4-942968f42ec8\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") "
Aug 05 17:10:29.530619 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530502    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b9c5da3-f689-4a65-96b4-942968f42ec8-istiod-ca-cert\") pod \"2b9c5da3-f689-4a65-96b4-942968f42ec8\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") "
Aug 05 17:10:29.530619 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530541    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfj46\" (UniqueName: \"kubernetes.io/projected/2b9c5da3-f689-4a65-96b4-942968f42ec8-kube-api-access-hfj46\") pod \"2b9c5da3-f689-4a65-96b4-942968f42ec8\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") "
Aug 05 17:10:29.530619 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530582    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-data\") pod \"2b9c5da3-f689-4a65-96b4-942968f42ec8\" (UID: \"2b9c5da3-f689-4a65-96b4-942968f42ec8\") "
Aug 05 17:10:29.530926 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530654    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2b9c5da3-f689-4a65-96b4-942968f42ec8" (UID: "2b9c5da3-f689-4a65-96b4-942968f42ec8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:10:29.530926 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530706    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2b9c5da3-f689-4a65-96b4-942968f42ec8" (UID: "2b9c5da3-f689-4a65-96b4-942968f42ec8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:10:29.530926 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530841    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-data" (OuterVolumeSpecName: "istio-data") pod "2b9c5da3-f689-4a65-96b4-942968f42ec8" (UID: "2b9c5da3-f689-4a65-96b4-942968f42ec8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:10:29.530926 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530901    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2b9c5da3-f689-4a65-96b4-942968f42ec8" (UID: "2b9c5da3-f689-4a65-96b4-942968f42ec8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:10:29.531169 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530946    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-data\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:29.531169 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530979    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-credential-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:29.531169 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.530996    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-workload-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:29.531169 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.531012    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b9c5da3-f689-4a65-96b4-942968f42ec8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2b9c5da3-f689-4a65-96b4-942968f42ec8" (UID: "2b9c5da3-f689-4a65-96b4-942968f42ec8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:10:29.532757 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.532728    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2b9c5da3-f689-4a65-96b4-942968f42ec8" (UID: "2b9c5da3-f689-4a65-96b4-942968f42ec8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:10:29.532869 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.532841    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b9c5da3-f689-4a65-96b4-942968f42ec8-kube-api-access-hfj46" (OuterVolumeSpecName: "kube-api-access-hfj46") pod "2b9c5da3-f689-4a65-96b4-942968f42ec8" (UID: "2b9c5da3-f689-4a65-96b4-942968f42ec8"). InnerVolumeSpecName "kube-api-access-hfj46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:10:29.532932 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.532919    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-token" (OuterVolumeSpecName: "istio-token") pod "2b9c5da3-f689-4a65-96b4-942968f42ec8" (UID: "2b9c5da3-f689-4a65-96b4-942968f42ec8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:10:29.532967 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.532940    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2b9c5da3-f689-4a65-96b4-942968f42ec8" (UID: "2b9c5da3-f689-4a65-96b4-942968f42ec8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:10:29.631488 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.631461    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfj46\" (UniqueName: \"kubernetes.io/projected/2b9c5da3-f689-4a65-96b4-942968f42ec8-kube-api-access-hfj46\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:29.631488 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.631485    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:29.631488 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.631495    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-podinfo\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:29.631710 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.631502    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-istio-envoy\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:29.631710 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.631512    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b9c5da3-f689-4a65-96b4-942968f42ec8-workload-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:29.631710 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:29.631520    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b9c5da3-f689-4a65-96b4-942968f42ec8-istiod-ca-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:10:30.246301 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:30.246205    2565 generic.go:356] "Generic (PLEG): container finished" podID="2b9c5da3-f689-4a65-96b4-942968f42ec8" containerID="1e47bde5ae550c8a25d708e6ea89fd86a03c5d32901850801d4b43060119eb9e" exitCode=0
Aug 05 17:10:30.246301 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:30.246265    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"
Aug 05 17:10:30.246512 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:30.246304    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs" event={"ID":"2b9c5da3-f689-4a65-96b4-942968f42ec8","Type":"ContainerDied","Data":"1e47bde5ae550c8a25d708e6ea89fd86a03c5d32901850801d4b43060119eb9e"}
Aug 05 17:10:30.246512 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:30.246372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs" event={"ID":"2b9c5da3-f689-4a65-96b4-942968f42ec8","Type":"ContainerDied","Data":"a5412ef0b9c025bc5c1bebd5a3964b5ddad4574c013e77569d271691ce675e48"}
Aug 05 17:10:30.246512 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:30.246406    2565 scope.go:117] "RemoveContainer" containerID="1e47bde5ae550c8a25d708e6ea89fd86a03c5d32901850801d4b43060119eb9e"
Aug 05 17:10:30.255306 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:30.255291    2565 scope.go:117] "RemoveContainer" containerID="a2e99e19e1a73a98fdcf050e948fbaa03426e7f8d4f1ac8934f18f5638042ca7"
Aug 05 17:10:30.262953 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:30.262934    2565 scope.go:117] "RemoveContainer" containerID="1e47bde5ae550c8a25d708e6ea89fd86a03c5d32901850801d4b43060119eb9e"
Aug 05 17:10:30.263206 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:10:30.263183    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e47bde5ae550c8a25d708e6ea89fd86a03c5d32901850801d4b43060119eb9e\": container with ID starting with 1e47bde5ae550c8a25d708e6ea89fd86a03c5d32901850801d4b43060119eb9e not found: ID does not exist" containerID="1e47bde5ae550c8a25d708e6ea89fd86a03c5d32901850801d4b43060119eb9e"
Aug 05 17:10:30.263295 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:30.263213    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e47bde5ae550c8a25d708e6ea89fd86a03c5d32901850801d4b43060119eb9e"} err="failed to get container status \"1e47bde5ae550c8a25d708e6ea89fd86a03c5d32901850801d4b43060119eb9e\": rpc error: code = NotFound desc = could not find container \"1e47bde5ae550c8a25d708e6ea89fd86a03c5d32901850801d4b43060119eb9e\": container with ID starting with 1e47bde5ae550c8a25d708e6ea89fd86a03c5d32901850801d4b43060119eb9e not found: ID does not exist"
Aug 05 17:10:30.263295 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:30.263234    2565 scope.go:117] "RemoveContainer" containerID="a2e99e19e1a73a98fdcf050e948fbaa03426e7f8d4f1ac8934f18f5638042ca7"
Aug 05 17:10:30.263504 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:10:30.263485    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2e99e19e1a73a98fdcf050e948fbaa03426e7f8d4f1ac8934f18f5638042ca7\": container with ID starting with a2e99e19e1a73a98fdcf050e948fbaa03426e7f8d4f1ac8934f18f5638042ca7 not found: ID does not exist" containerID="a2e99e19e1a73a98fdcf050e948fbaa03426e7f8d4f1ac8934f18f5638042ca7"
Aug 05 17:10:30.263552 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:30.263510    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2e99e19e1a73a98fdcf050e948fbaa03426e7f8d4f1ac8934f18f5638042ca7"} err="failed to get container status \"a2e99e19e1a73a98fdcf050e948fbaa03426e7f8d4f1ac8934f18f5638042ca7\": rpc error: code = NotFound desc = could not find container \"a2e99e19e1a73a98fdcf050e948fbaa03426e7f8d4f1ac8934f18f5638042ca7\": container with ID starting with a2e99e19e1a73a98fdcf050e948fbaa03426e7f8d4f1ac8934f18f5638042ca7 not found: ID does not exist"
Aug 05 17:10:30.275661 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:30.275640    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"]
Aug 05 17:10:30.277766 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:30.277745    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-8bdcbc9e-openshift-default-7ccb87998d-qmlvs"]
Aug 05 17:10:31.952969 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:10:31.952934    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b9c5da3-f689-4a65-96b4-942968f42ec8" path="/var/lib/kubelet/pods/2b9c5da3-f689-4a65-96b4-942968f42ec8/volumes"
Aug 05 17:12:35.693879 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.693837    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"]
Aug 05 17:12:35.694426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694229    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90d1bc16-b32f-43b6-aeca-c4f4624f2604" containerName="istio-proxy"
Aug 05 17:12:35.694426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694242    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90d1bc16-b32f-43b6-aeca-c4f4624f2604" containerName="istio-proxy"
Aug 05 17:12:35.694426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694294    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6141e7c1-2bf7-4df7-8006-a9126be2545d" containerName="payload-processing"
Aug 05 17:12:35.694426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694300    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6141e7c1-2bf7-4df7-8006-a9126be2545d" containerName="payload-processing"
Aug 05 17:12:35.694426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694308    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90d1bc16-b32f-43b6-aeca-c4f4624f2604" containerName="istio-proxy"
Aug 05 17:12:35.694426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694315    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="90d1bc16-b32f-43b6-aeca-c4f4624f2604" containerName="istio-proxy"
Aug 05 17:12:35.694426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694323    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b9c5da3-f689-4a65-96b4-942968f42ec8" containerName="istio-proxy"
Aug 05 17:12:35.694426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694330    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b9c5da3-f689-4a65-96b4-942968f42ec8" containerName="istio-proxy"
Aug 05 17:12:35.694426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694341    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b9c5da3-f689-4a65-96b4-942968f42ec8" containerName="istio-proxy"
Aug 05 17:12:35.694426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694346    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b9c5da3-f689-4a65-96b4-942968f42ec8" containerName="istio-proxy"
Aug 05 17:12:35.694426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694355    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e6053d-5076-46ad-af3d-a97048cb398f" containerName="payload-pre-processing"
Aug 05 17:12:35.694426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694360    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e6053d-5076-46ad-af3d-a97048cb398f" containerName="payload-pre-processing"
Aug 05 17:12:35.694957 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694482    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b9c5da3-f689-4a65-96b4-942968f42ec8" containerName="istio-proxy"
Aug 05 17:12:35.694957 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694495    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="90d1bc16-b32f-43b6-aeca-c4f4624f2604" containerName="istio-proxy"
Aug 05 17:12:35.694957 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694505    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b9c5da3-f689-4a65-96b4-942968f42ec8" containerName="istio-proxy"
Aug 05 17:12:35.694957 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694515    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6141e7c1-2bf7-4df7-8006-a9126be2545d" containerName="payload-processing"
Aug 05 17:12:35.694957 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.694524    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7e6053d-5076-46ad-af3d-a97048cb398f" containerName="payload-pre-processing"
Aug 05 17:12:35.698160 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.698139    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.702202 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.702172    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-12b0b9f5-openshift-default-dockercfg-79c6v\""
Aug 05 17:12:35.739542 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.739505    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"]
Aug 05 17:12:35.821823 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.821785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2jzw\" (UniqueName: \"kubernetes.io/projected/9434221b-7bfa-4742-85ab-ebd6df6192d2-kube-api-access-n2jzw\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.821823 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.821827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9434221b-7bfa-4742-85ab-ebd6df6192d2-istiod-ca-cert\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.822089 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.821856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-workload-socket\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.822089 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.821921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-token\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.822089 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.821969    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-data\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.822089 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.822030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-workload-certs\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.822089 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.822054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-credential-socket\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.822089 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.822070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-podinfo\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.822309 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.822114    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-envoy\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.922679 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.922634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-workload-certs\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.922679 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.922681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-credential-socket\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.922921 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.922697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-podinfo\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.922921 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.922816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-envoy\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.922921 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.922848    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2jzw\" (UniqueName: \"kubernetes.io/projected/9434221b-7bfa-4742-85ab-ebd6df6192d2-kube-api-access-n2jzw\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.922921 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.922876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9434221b-7bfa-4742-85ab-ebd6df6192d2-istiod-ca-cert\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.923162 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.922922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-workload-socket\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.923162 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.922966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-token\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.923162 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.922996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-data\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.923162 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.923148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-credential-socket\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.923434 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.923405    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-workload-socket\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.923570 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.923411    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-data\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.923570 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.923529    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-workload-certs\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.923696 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.923651    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9434221b-7bfa-4742-85ab-ebd6df6192d2-istiod-ca-cert\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.925083 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.925049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-envoy\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.925425 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.925408    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-podinfo\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.934570 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.934543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2jzw\" (UniqueName: \"kubernetes.io/projected/9434221b-7bfa-4742-85ab-ebd6df6192d2-kube-api-access-n2jzw\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:35.938362 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:35.938338    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-token\") pod \"e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") " pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:36.008219 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:36.008135    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:36.160591 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:36.160567    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"]
Aug 05 17:12:36.161877 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:12:36.161848    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9434221b_7bfa_4742_85ab_ebd6df6192d2.slice/crio-1ba20c5b2b3f521a0e02bd85b21aa6c8ce89a2582c1fa3f4e580842956cb06ab WatchSource:0}: Error finding container 1ba20c5b2b3f521a0e02bd85b21aa6c8ce89a2582c1fa3f4e580842956cb06ab: Status 404 returned error can't find the container with id 1ba20c5b2b3f521a0e02bd85b21aa6c8ce89a2582c1fa3f4e580842956cb06ab
Aug 05 17:12:36.163904 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:36.163871    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:12:36.163983 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:36.163934    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:12:36.163983 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:36.163961    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:12:36.899656 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:36.899618    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z" event={"ID":"9434221b-7bfa-4742-85ab-ebd6df6192d2","Type":"ContainerStarted","Data":"61792d528638ba2d8130d23e602e49ec9de7d73ef11c26297573bdcc32621046"}
Aug 05 17:12:36.900176 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:36.899676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z" event={"ID":"9434221b-7bfa-4742-85ab-ebd6df6192d2","Type":"ContainerStarted","Data":"1ba20c5b2b3f521a0e02bd85b21aa6c8ce89a2582c1fa3f4e580842956cb06ab"}
Aug 05 17:12:36.929617 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:36.929564    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z" podStartSLOduration=1.929548829 podStartE2EDuration="1.929548829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:36.925842386 +0000 UTC m=+2029.507914042" watchObservedRunningTime="2026-08-05 17:12:36.929548829 +0000 UTC m=+2029.511620484"
Aug 05 17:12:37.008561 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:37.008532    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:37.013596 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:37.013573    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:37.904700 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:37.904667    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:37.905742 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:37.905725    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:41.640968 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.640931    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"]
Aug 05 17:12:41.641630 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.641611    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="90d1bc16-b32f-43b6-aeca-c4f4624f2604" containerName="istio-proxy"
Aug 05 17:12:41.645031 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.645012    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"
Aug 05 17:12:41.665060 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.665039    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-12b0b9f5\""
Aug 05 17:12:41.711349 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.711313    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"]
Aug 05 17:12:41.777121 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.777064    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f097871-40ae-444c-bcb6-ca4711013057-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft\" (UID: \"7f097871-40ae-444c-bcb6-ca4711013057\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"
Aug 05 17:12:41.777299 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.777127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vj77\" (UniqueName: \"kubernetes.io/projected/7f097871-40ae-444c-bcb6-ca4711013057-kube-api-access-4vj77\") pod \"payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft\" (UID: \"7f097871-40ae-444c-bcb6-ca4711013057\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"
Aug 05 17:12:41.878362 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.878327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f097871-40ae-444c-bcb6-ca4711013057-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft\" (UID: \"7f097871-40ae-444c-bcb6-ca4711013057\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"
Aug 05 17:12:41.878362 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.878363    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vj77\" (UniqueName: \"kubernetes.io/projected/7f097871-40ae-444c-bcb6-ca4711013057-kube-api-access-4vj77\") pod \"payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft\" (UID: \"7f097871-40ae-444c-bcb6-ca4711013057\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"
Aug 05 17:12:41.879092 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.879065    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f097871-40ae-444c-bcb6-ca4711013057-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft\" (UID: \"7f097871-40ae-444c-bcb6-ca4711013057\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"
Aug 05 17:12:41.899273 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.899206    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vj77\" (UniqueName: \"kubernetes.io/projected/7f097871-40ae-444c-bcb6-ca4711013057-kube-api-access-4vj77\") pod \"payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft\" (UID: \"7f097871-40ae-444c-bcb6-ca4711013057\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"
Aug 05 17:12:41.923288 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.923263    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"]
Aug 05 17:12:41.926844 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.926827    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"
Aug 05 17:12:41.931238 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.931221    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-12b0b9f5-dockercfg-p6v9n\""
Aug 05 17:12:41.954254 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.954229    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"]
Aug 05 17:12:41.955574 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:41.955554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"
Aug 05 17:12:42.083769 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:42.083737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6t48\" (UniqueName: \"kubernetes.io/projected/5b513b3e-638d-4782-8d3f-0ba72f0779d9-kube-api-access-s6t48\") pod \"payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5\" (UID: \"5b513b3e-638d-4782-8d3f-0ba72f0779d9\") " pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"
Aug 05 17:12:42.083932 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:42.083786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b513b3e-638d-4782-8d3f-0ba72f0779d9-plugins-config-volume\") pod \"payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5\" (UID: \"5b513b3e-638d-4782-8d3f-0ba72f0779d9\") " pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"
Aug 05 17:12:42.115945 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:42.115923    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"]
Aug 05 17:12:42.118428 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:12:42.118401    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f097871_40ae_444c_bcb6_ca4711013057.slice/crio-55facb9a554f30267b3c68717c1b965ed0a27912a676f806d35b7da6608e17de WatchSource:0}: Error finding container 55facb9a554f30267b3c68717c1b965ed0a27912a676f806d35b7da6608e17de: Status 404 returned error can't find the container with id 55facb9a554f30267b3c68717c1b965ed0a27912a676f806d35b7da6608e17de
Aug 05 17:12:42.185319 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:42.185297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6t48\" (UniqueName: \"kubernetes.io/projected/5b513b3e-638d-4782-8d3f-0ba72f0779d9-kube-api-access-s6t48\") pod \"payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5\" (UID: \"5b513b3e-638d-4782-8d3f-0ba72f0779d9\") " pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"
Aug 05 17:12:42.185413 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:42.185335    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b513b3e-638d-4782-8d3f-0ba72f0779d9-plugins-config-volume\") pod \"payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5\" (UID: \"5b513b3e-638d-4782-8d3f-0ba72f0779d9\") " pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"
Aug 05 17:12:42.186019 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:42.186000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b513b3e-638d-4782-8d3f-0ba72f0779d9-plugins-config-volume\") pod \"payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5\" (UID: \"5b513b3e-638d-4782-8d3f-0ba72f0779d9\") " pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"
Aug 05 17:12:42.204589 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:42.204564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6t48\" (UniqueName: \"kubernetes.io/projected/5b513b3e-638d-4782-8d3f-0ba72f0779d9-kube-api-access-s6t48\") pod \"payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5\" (UID: \"5b513b3e-638d-4782-8d3f-0ba72f0779d9\") " pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"
Aug 05 17:12:42.237965 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:42.237939    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"
Aug 05 17:12:42.388286 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:42.388239    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"]
Aug 05 17:12:42.390846 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:12:42.390824    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b513b3e_638d_4782_8d3f_0ba72f0779d9.slice/crio-a6fd104f6c0563585f56641523631de8af7b506efaa52aaadb613961c92de841 WatchSource:0}: Error finding container a6fd104f6c0563585f56641523631de8af7b506efaa52aaadb613961c92de841: Status 404 returned error can't find the container with id a6fd104f6c0563585f56641523631de8af7b506efaa52aaadb613961c92de841
Aug 05 17:12:42.932410 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:42.932372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft" event={"ID":"7f097871-40ae-444c-bcb6-ca4711013057","Type":"ContainerStarted","Data":"125ca45c765bc868183ca7e8fc75822083b975d4258ba0cc6c6656baef11baa2"}
Aug 05 17:12:42.932873 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:42.932441    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft" event={"ID":"7f097871-40ae-444c-bcb6-ca4711013057","Type":"ContainerStarted","Data":"55facb9a554f30267b3c68717c1b965ed0a27912a676f806d35b7da6608e17de"}
Aug 05 17:12:42.932873 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:42.932505    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"
Aug 05 17:12:42.934113 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:42.934072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5" event={"ID":"5b513b3e-638d-4782-8d3f-0ba72f0779d9","Type":"ContainerStarted","Data":"6f19c06eacbb934862b6a400e7c31542fdd5339ef1d0b844337fea75366e4035"}
Aug 05 17:12:42.934231 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:42.934135    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5" event={"ID":"5b513b3e-638d-4782-8d3f-0ba72f0779d9","Type":"ContainerStarted","Data":"a6fd104f6c0563585f56641523631de8af7b506efaa52aaadb613961c92de841"}
Aug 05 17:12:42.934288 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:42.934227    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"
Aug 05 17:12:43.022352 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:43.022304    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5" podStartSLOduration=2.022287696 podStartE2EDuration="2.022287696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:43.000459626 +0000 UTC m=+2035.582531318" watchObservedRunningTime="2026-08-05 17:12:43.022287696 +0000 UTC m=+2035.604359351"
Aug 05 17:12:43.022836 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:43.022804    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft" podStartSLOduration=2.022794678 podStartE2EDuration="2.022794678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:42.970801591 +0000 UTC m=+2035.552873248" watchObservedRunningTime="2026-08-05 17:12:43.022794678 +0000 UTC m=+2035.604866332"
Aug 05 17:12:52.953273 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:52.951916    2565 patch_prober.go:28] interesting pod/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": read tcp 10.132.0.2:53900->10.132.0.64:15021: read: connection reset by peer" start-of-body=
Aug 05 17:12:52.953273 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:52.951989    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z" podUID="9434221b-7bfa-4742-85ab-ebd6df6192d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": read tcp 10.132.0.2:53900->10.132.0.64:15021: read: connection reset by peer"
Aug 05 17:12:53.001647 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:53.001617    2565 generic.go:356] "Generic (PLEG): container finished" podID="9434221b-7bfa-4742-85ab-ebd6df6192d2" containerID="61792d528638ba2d8130d23e602e49ec9de7d73ef11c26297573bdcc32621046" exitCode=0
Aug 05 17:12:53.001790 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:53.001693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z" event={"ID":"9434221b-7bfa-4742-85ab-ebd6df6192d2","Type":"ContainerDied","Data":"61792d528638ba2d8130d23e602e49ec9de7d73ef11c26297573bdcc32621046"}
Aug 05 17:12:53.002108 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:53.002085    2565 scope.go:117] "RemoveContainer" containerID="61792d528638ba2d8130d23e602e49ec9de7d73ef11c26297573bdcc32621046"
Aug 05 17:12:53.003031 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:53.002999    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:12:53.003086 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:53.003062    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:12:53.003157 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:53.003137    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:12:53.962673 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:53.962639    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"
Aug 05 17:12:53.963191 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:53.962727    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"
Aug 05 17:12:54.009341 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:54.009308    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z" event={"ID":"9434221b-7bfa-4742-85ab-ebd6df6192d2","Type":"ContainerStarted","Data":"315f8e09b5941cbd87ee7628eaba032dcc72ce467e7cb390604b5b044168e1e6"}
Aug 05 17:12:55.009170 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:55.009133    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:12:55.009581 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:55.009309    2565 patch_prober.go:28] interesting pod/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Aug 05 17:12:55.009581 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:55.009361    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z" podUID="9434221b-7bfa-4742-85ab-ebd6df6192d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Aug 05 17:12:56.008712 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:56.008682    2565 patch_prober.go:28] interesting pod/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Aug 05 17:12:56.008892 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:56.008737    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z" podUID="9434221b-7bfa-4742-85ab-ebd6df6192d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Aug 05 17:12:57.009000 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:57.008965    2565 patch_prober.go:28] interesting pod/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Aug 05 17:12:57.009418 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:57.009020    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z" podUID="9434221b-7bfa-4742-85ab-ebd6df6192d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Aug 05 17:12:58.008598 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:58.008557    2565 patch_prober.go:28] interesting pod/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Aug 05 17:12:58.008774 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:58.008632    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z" podUID="9434221b-7bfa-4742-85ab-ebd6df6192d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Aug 05 17:12:59.009031 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:59.008994    2565 patch_prober.go:28] interesting pod/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Aug 05 17:12:59.009453 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:12:59.009062    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z" podUID="9434221b-7bfa-4742-85ab-ebd6df6192d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Aug 05 17:13:00.011806 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:00.011776    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:13:00.012307 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:00.012178    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:13:00.012757 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:00.012737    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:13:11.130610 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.130525    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"]
Aug 05 17:13:11.131067 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.130772    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5" podUID="5b513b3e-638d-4782-8d3f-0ba72f0779d9" containerName="payload-processing" containerID="cri-o://6f19c06eacbb934862b6a400e7c31542fdd5339ef1d0b844337fea75366e4035" gracePeriod=30
Aug 05 17:13:11.143994 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.143966    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"]
Aug 05 17:13:11.144325 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.144209    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft" podUID="7f097871-40ae-444c-bcb6-ca4711013057" containerName="payload-pre-processing" containerID="cri-o://125ca45c765bc868183ca7e8fc75822083b975d4258ba0cc6c6656baef11baa2" gracePeriod=30
Aug 05 17:13:11.439542 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.439516    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"
Aug 05 17:13:11.442421 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.442399    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"
Aug 05 17:13:11.553851 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.553818    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vj77\" (UniqueName: \"kubernetes.io/projected/7f097871-40ae-444c-bcb6-ca4711013057-kube-api-access-4vj77\") pod \"7f097871-40ae-444c-bcb6-ca4711013057\" (UID: \"7f097871-40ae-444c-bcb6-ca4711013057\") "
Aug 05 17:13:11.554035 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.553895    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f097871-40ae-444c-bcb6-ca4711013057-plugins-config-volume\") pod \"7f097871-40ae-444c-bcb6-ca4711013057\" (UID: \"7f097871-40ae-444c-bcb6-ca4711013057\") "
Aug 05 17:13:11.554035 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.553938    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b513b3e-638d-4782-8d3f-0ba72f0779d9-plugins-config-volume\") pod \"5b513b3e-638d-4782-8d3f-0ba72f0779d9\" (UID: \"5b513b3e-638d-4782-8d3f-0ba72f0779d9\") "
Aug 05 17:13:11.554035 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.553978    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6t48\" (UniqueName: \"kubernetes.io/projected/5b513b3e-638d-4782-8d3f-0ba72f0779d9-kube-api-access-s6t48\") pod \"5b513b3e-638d-4782-8d3f-0ba72f0779d9\" (UID: \"5b513b3e-638d-4782-8d3f-0ba72f0779d9\") "
Aug 05 17:13:11.554263 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.554239    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f097871-40ae-444c-bcb6-ca4711013057-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7f097871-40ae-444c-bcb6-ca4711013057" (UID: "7f097871-40ae-444c-bcb6-ca4711013057"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:13:11.554420 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.554388    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b513b3e-638d-4782-8d3f-0ba72f0779d9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5b513b3e-638d-4782-8d3f-0ba72f0779d9" (UID: "5b513b3e-638d-4782-8d3f-0ba72f0779d9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:13:11.555858 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.555837    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f097871-40ae-444c-bcb6-ca4711013057-kube-api-access-4vj77" (OuterVolumeSpecName: "kube-api-access-4vj77") pod "7f097871-40ae-444c-bcb6-ca4711013057" (UID: "7f097871-40ae-444c-bcb6-ca4711013057"). InnerVolumeSpecName "kube-api-access-4vj77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:13:11.556051 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.556032    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b513b3e-638d-4782-8d3f-0ba72f0779d9-kube-api-access-s6t48" (OuterVolumeSpecName: "kube-api-access-s6t48") pod "5b513b3e-638d-4782-8d3f-0ba72f0779d9" (UID: "5b513b3e-638d-4782-8d3f-0ba72f0779d9"). InnerVolumeSpecName "kube-api-access-s6t48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:13:11.655386 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.655356    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vj77\" (UniqueName: \"kubernetes.io/projected/7f097871-40ae-444c-bcb6-ca4711013057-kube-api-access-4vj77\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:13:11.655386 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.655381    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f097871-40ae-444c-bcb6-ca4711013057-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:13:11.655386 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.655391    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b513b3e-638d-4782-8d3f-0ba72f0779d9-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:13:11.655604 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:11.655401    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6t48\" (UniqueName: \"kubernetes.io/projected/5b513b3e-638d-4782-8d3f-0ba72f0779d9-kube-api-access-s6t48\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:13:12.100849 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.100821    2565 generic.go:356] "Generic (PLEG): container finished" podID="5b513b3e-638d-4782-8d3f-0ba72f0779d9" containerID="6f19c06eacbb934862b6a400e7c31542fdd5339ef1d0b844337fea75366e4035" exitCode=0
Aug 05 17:13:12.101027 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.100864    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"
Aug 05 17:13:12.101027 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.100913    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5" event={"ID":"5b513b3e-638d-4782-8d3f-0ba72f0779d9","Type":"ContainerDied","Data":"6f19c06eacbb934862b6a400e7c31542fdd5339ef1d0b844337fea75366e4035"}
Aug 05 17:13:12.101027 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.100967    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5" event={"ID":"5b513b3e-638d-4782-8d3f-0ba72f0779d9","Type":"ContainerDied","Data":"a6fd104f6c0563585f56641523631de8af7b506efaa52aaadb613961c92de841"}
Aug 05 17:13:12.101027 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.100998    2565 scope.go:117] "RemoveContainer" containerID="6f19c06eacbb934862b6a400e7c31542fdd5339ef1d0b844337fea75366e4035"
Aug 05 17:13:12.102506 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.102481    2565 generic.go:356] "Generic (PLEG): container finished" podID="7f097871-40ae-444c-bcb6-ca4711013057" containerID="125ca45c765bc868183ca7e8fc75822083b975d4258ba0cc6c6656baef11baa2" exitCode=0
Aug 05 17:13:12.102620 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.102528    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft" event={"ID":"7f097871-40ae-444c-bcb6-ca4711013057","Type":"ContainerDied","Data":"125ca45c765bc868183ca7e8fc75822083b975d4258ba0cc6c6656baef11baa2"}
Aug 05 17:13:12.102620 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.102552    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"
Aug 05 17:13:12.102620 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.102571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft" event={"ID":"7f097871-40ae-444c-bcb6-ca4711013057","Type":"ContainerDied","Data":"55facb9a554f30267b3c68717c1b965ed0a27912a676f806d35b7da6608e17de"}
Aug 05 17:13:12.109850 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.109812    2565 scope.go:117] "RemoveContainer" containerID="6f19c06eacbb934862b6a400e7c31542fdd5339ef1d0b844337fea75366e4035"
Aug 05 17:13:12.110126 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:13:12.110082    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f19c06eacbb934862b6a400e7c31542fdd5339ef1d0b844337fea75366e4035\": container with ID starting with 6f19c06eacbb934862b6a400e7c31542fdd5339ef1d0b844337fea75366e4035 not found: ID does not exist" containerID="6f19c06eacbb934862b6a400e7c31542fdd5339ef1d0b844337fea75366e4035"
Aug 05 17:13:12.110190 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.110125    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f19c06eacbb934862b6a400e7c31542fdd5339ef1d0b844337fea75366e4035"} err="failed to get container status \"6f19c06eacbb934862b6a400e7c31542fdd5339ef1d0b844337fea75366e4035\": rpc error: code = NotFound desc = could not find container \"6f19c06eacbb934862b6a400e7c31542fdd5339ef1d0b844337fea75366e4035\": container with ID starting with 6f19c06eacbb934862b6a400e7c31542fdd5339ef1d0b844337fea75366e4035 not found: ID does not exist"
Aug 05 17:13:12.110190 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.110142    2565 scope.go:117] "RemoveContainer" containerID="125ca45c765bc868183ca7e8fc75822083b975d4258ba0cc6c6656baef11baa2"
Aug 05 17:13:12.122455 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.122433    2565 scope.go:117] "RemoveContainer" containerID="125ca45c765bc868183ca7e8fc75822083b975d4258ba0cc6c6656baef11baa2"
Aug 05 17:13:12.122756 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:13:12.122736    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"125ca45c765bc868183ca7e8fc75822083b975d4258ba0cc6c6656baef11baa2\": container with ID starting with 125ca45c765bc868183ca7e8fc75822083b975d4258ba0cc6c6656baef11baa2 not found: ID does not exist" containerID="125ca45c765bc868183ca7e8fc75822083b975d4258ba0cc6c6656baef11baa2"
Aug 05 17:13:12.122813 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.122764    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"125ca45c765bc868183ca7e8fc75822083b975d4258ba0cc6c6656baef11baa2"} err="failed to get container status \"125ca45c765bc868183ca7e8fc75822083b975d4258ba0cc6c6656baef11baa2\": rpc error: code = NotFound desc = could not find container \"125ca45c765bc868183ca7e8fc75822083b975d4258ba0cc6c6656baef11baa2\": container with ID starting with 125ca45c765bc868183ca7e8fc75822083b975d4258ba0cc6c6656baef11baa2 not found: ID does not exist"
Aug 05 17:13:12.131603 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.131583    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"]
Aug 05 17:13:12.138361 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.138341    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-12b0b9f5-fdb899f56-dvkft"]
Aug 05 17:13:12.161145 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.161122    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"]
Aug 05 17:13:12.164693 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:12.164650    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-12b0b9f5-59b656b4cd-76jg5"]
Aug 05 17:13:13.952886 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:13.952844    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b513b3e-638d-4782-8d3f-0ba72f0779d9" path="/var/lib/kubelet/pods/5b513b3e-638d-4782-8d3f-0ba72f0779d9/volumes"
Aug 05 17:13:13.953523 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:13.953401    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f097871-40ae-444c-bcb6-ca4711013057" path="/var/lib/kubelet/pods/7f097871-40ae-444c-bcb6-ca4711013057/volumes"
Aug 05 17:13:18.773820 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:18.773790    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"]
Aug 05 17:13:18.774239 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:18.774027    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z" podUID="9434221b-7bfa-4742-85ab-ebd6df6192d2" containerName="istio-proxy" containerID="cri-o://315f8e09b5941cbd87ee7628eaba032dcc72ce467e7cb390604b5b044168e1e6" gracePeriod=30
Aug 05 17:13:24.025662 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.025638    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:13:24.165572 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.165543    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-envoy\") pod \"9434221b-7bfa-4742-85ab-ebd6df6192d2\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") "
Aug 05 17:13:24.165572 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.165578    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-podinfo\") pod \"9434221b-7bfa-4742-85ab-ebd6df6192d2\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") "
Aug 05 17:13:24.165843 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.165604    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-data\") pod \"9434221b-7bfa-4742-85ab-ebd6df6192d2\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") "
Aug 05 17:13:24.165843 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.165619    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-workload-certs\") pod \"9434221b-7bfa-4742-85ab-ebd6df6192d2\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") "
Aug 05 17:13:24.165843 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.165830    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2jzw\" (UniqueName: \"kubernetes.io/projected/9434221b-7bfa-4742-85ab-ebd6df6192d2-kube-api-access-n2jzw\") pod \"9434221b-7bfa-4742-85ab-ebd6df6192d2\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") "
Aug 05 17:13:24.166003 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.165888    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-workload-socket\") pod \"9434221b-7bfa-4742-85ab-ebd6df6192d2\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") "
Aug 05 17:13:24.166003 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.165898    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "9434221b-7bfa-4742-85ab-ebd6df6192d2" (UID: "9434221b-7bfa-4742-85ab-ebd6df6192d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:13:24.166003 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.165915    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9434221b-7bfa-4742-85ab-ebd6df6192d2" (UID: "9434221b-7bfa-4742-85ab-ebd6df6192d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:13:24.166003 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.165923    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-token\") pod \"9434221b-7bfa-4742-85ab-ebd6df6192d2\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") "
Aug 05 17:13:24.166003 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.165967    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-credential-socket\") pod \"9434221b-7bfa-4742-85ab-ebd6df6192d2\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") "
Aug 05 17:13:24.166278 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.166005    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9434221b-7bfa-4742-85ab-ebd6df6192d2-istiod-ca-cert\") pod \"9434221b-7bfa-4742-85ab-ebd6df6192d2\" (UID: \"9434221b-7bfa-4742-85ab-ebd6df6192d2\") "
Aug 05 17:13:24.166278 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.166142    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9434221b-7bfa-4742-85ab-ebd6df6192d2" (UID: "9434221b-7bfa-4742-85ab-ebd6df6192d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:13:24.166417 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.166395    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-workload-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:13:24.166473 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.166437    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-data\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:13:24.166473 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.166451    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-workload-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:13:24.166730 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.166709    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9434221b-7bfa-4742-85ab-ebd6df6192d2" (UID: "9434221b-7bfa-4742-85ab-ebd6df6192d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:13:24.166905 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.166767    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9434221b-7bfa-4742-85ab-ebd6df6192d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9434221b-7bfa-4742-85ab-ebd6df6192d2" (UID: "9434221b-7bfa-4742-85ab-ebd6df6192d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:13:24.167336 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.167310    2565 generic.go:356] "Generic (PLEG): container finished" podID="9434221b-7bfa-4742-85ab-ebd6df6192d2" containerID="315f8e09b5941cbd87ee7628eaba032dcc72ce467e7cb390604b5b044168e1e6" exitCode=0
Aug 05 17:13:24.167447 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.167392    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"
Aug 05 17:13:24.167447 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.167420    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z" event={"ID":"9434221b-7bfa-4742-85ab-ebd6df6192d2","Type":"ContainerDied","Data":"315f8e09b5941cbd87ee7628eaba032dcc72ce467e7cb390604b5b044168e1e6"}
Aug 05 17:13:24.167568 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.167540    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z" event={"ID":"9434221b-7bfa-4742-85ab-ebd6df6192d2","Type":"ContainerDied","Data":"1ba20c5b2b3f521a0e02bd85b21aa6c8ce89a2582c1fa3f4e580842956cb06ab"}
Aug 05 17:13:24.167619 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.167593    2565 scope.go:117] "RemoveContainer" containerID="315f8e09b5941cbd87ee7628eaba032dcc72ce467e7cb390604b5b044168e1e6"
Aug 05 17:13:24.168296 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.168269    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9434221b-7bfa-4742-85ab-ebd6df6192d2" (UID: "9434221b-7bfa-4742-85ab-ebd6df6192d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:13:24.168398 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.168320    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9434221b-7bfa-4742-85ab-ebd6df6192d2-kube-api-access-n2jzw" (OuterVolumeSpecName: "kube-api-access-n2jzw") pod "9434221b-7bfa-4742-85ab-ebd6df6192d2" (UID: "9434221b-7bfa-4742-85ab-ebd6df6192d2"). InnerVolumeSpecName "kube-api-access-n2jzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:13:24.168467 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.168393    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "9434221b-7bfa-4742-85ab-ebd6df6192d2" (UID: "9434221b-7bfa-4742-85ab-ebd6df6192d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:13:24.168467 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.168431    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9434221b-7bfa-4742-85ab-ebd6df6192d2" (UID: "9434221b-7bfa-4742-85ab-ebd6df6192d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:13:24.185413 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.185391    2565 scope.go:117] "RemoveContainer" containerID="61792d528638ba2d8130d23e602e49ec9de7d73ef11c26297573bdcc32621046"
Aug 05 17:13:24.193189 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.193169    2565 scope.go:117] "RemoveContainer" containerID="315f8e09b5941cbd87ee7628eaba032dcc72ce467e7cb390604b5b044168e1e6"
Aug 05 17:13:24.193466 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:13:24.193444    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"315f8e09b5941cbd87ee7628eaba032dcc72ce467e7cb390604b5b044168e1e6\": container with ID starting with 315f8e09b5941cbd87ee7628eaba032dcc72ce467e7cb390604b5b044168e1e6 not found: ID does not exist" containerID="315f8e09b5941cbd87ee7628eaba032dcc72ce467e7cb390604b5b044168e1e6"
Aug 05 17:13:24.193540 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.193475    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"315f8e09b5941cbd87ee7628eaba032dcc72ce467e7cb390604b5b044168e1e6"} err="failed to get container status \"315f8e09b5941cbd87ee7628eaba032dcc72ce467e7cb390604b5b044168e1e6\": rpc error: code = NotFound desc = could not find container \"315f8e09b5941cbd87ee7628eaba032dcc72ce467e7cb390604b5b044168e1e6\": container with ID starting with 315f8e09b5941cbd87ee7628eaba032dcc72ce467e7cb390604b5b044168e1e6 not found: ID does not exist"
Aug 05 17:13:24.193540 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.193492    2565 scope.go:117] "RemoveContainer" containerID="61792d528638ba2d8130d23e602e49ec9de7d73ef11c26297573bdcc32621046"
Aug 05 17:13:24.193733 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:13:24.193713    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61792d528638ba2d8130d23e602e49ec9de7d73ef11c26297573bdcc32621046\": container with ID starting with 61792d528638ba2d8130d23e602e49ec9de7d73ef11c26297573bdcc32621046 not found: ID does not exist" containerID="61792d528638ba2d8130d23e602e49ec9de7d73ef11c26297573bdcc32621046"
Aug 05 17:13:24.193779 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.193741    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61792d528638ba2d8130d23e602e49ec9de7d73ef11c26297573bdcc32621046"} err="failed to get container status \"61792d528638ba2d8130d23e602e49ec9de7d73ef11c26297573bdcc32621046\": rpc error: code = NotFound desc = could not find container \"61792d528638ba2d8130d23e602e49ec9de7d73ef11c26297573bdcc32621046\": container with ID starting with 61792d528638ba2d8130d23e602e49ec9de7d73ef11c26297573bdcc32621046 not found: ID does not exist"
Aug 05 17:13:24.267165 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.267126    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2jzw\" (UniqueName: \"kubernetes.io/projected/9434221b-7bfa-4742-85ab-ebd6df6192d2-kube-api-access-n2jzw\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:13:24.267165 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.267157    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:13:24.267165 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.267168    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-credential-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:13:24.267393 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.267177    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9434221b-7bfa-4742-85ab-ebd6df6192d2-istiod-ca-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:13:24.267393 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.267186    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-envoy\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:13:24.267393 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.267193    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9434221b-7bfa-4742-85ab-ebd6df6192d2-istio-podinfo\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:13:24.495748 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.495716    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"]
Aug 05 17:13:24.507651 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:24.507623    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-12b0b9f5-openshift-default-7794c8774d-vv78z"]
Aug 05 17:13:25.953523 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:13:25.953495    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9434221b-7bfa-4742-85ab-ebd6df6192d2" path="/var/lib/kubelet/pods/9434221b-7bfa-4742-85ab-ebd6df6192d2/volumes"
Aug 05 17:14:02.714710 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:02.714677    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"]
Aug 05 17:14:02.715147 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:02.714853    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh" podUID="8775deea-6203-4dc8-8689-0a5ef3dfdb10" containerName="manager" containerID="cri-o://948ce646c99e2de3a6f74de260b9a9eb4a9f3754e6b80d8f346a26f9ad07d105" gracePeriod=10
Aug 05 17:14:02.985301 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:02.985278    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"
Aug 05 17:14:03.101818 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.101781    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwr8f\" (UniqueName: \"kubernetes.io/projected/8775deea-6203-4dc8-8689-0a5ef3dfdb10-kube-api-access-rwr8f\") pod \"8775deea-6203-4dc8-8689-0a5ef3dfdb10\" (UID: \"8775deea-6203-4dc8-8689-0a5ef3dfdb10\") "
Aug 05 17:14:03.102005 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.101841    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8775deea-6203-4dc8-8689-0a5ef3dfdb10-extensions-socket-volume\") pod \"8775deea-6203-4dc8-8689-0a5ef3dfdb10\" (UID: \"8775deea-6203-4dc8-8689-0a5ef3dfdb10\") "
Aug 05 17:14:03.102261 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.102234    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8775deea-6203-4dc8-8689-0a5ef3dfdb10-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8775deea-6203-4dc8-8689-0a5ef3dfdb10" (UID: "8775deea-6203-4dc8-8689-0a5ef3dfdb10"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:14:03.103766 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.103740    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8775deea-6203-4dc8-8689-0a5ef3dfdb10-kube-api-access-rwr8f" (OuterVolumeSpecName: "kube-api-access-rwr8f") pod "8775deea-6203-4dc8-8689-0a5ef3dfdb10" (UID: "8775deea-6203-4dc8-8689-0a5ef3dfdb10"). InnerVolumeSpecName "kube-api-access-rwr8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:14:03.202938 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.202901    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwr8f\" (UniqueName: \"kubernetes.io/projected/8775deea-6203-4dc8-8689-0a5ef3dfdb10-kube-api-access-rwr8f\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:14:03.202938 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.202932    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8775deea-6203-4dc8-8689-0a5ef3dfdb10-extensions-socket-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:14:03.374331 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.374295    2565 generic.go:356] "Generic (PLEG): container finished" podID="8775deea-6203-4dc8-8689-0a5ef3dfdb10" containerID="948ce646c99e2de3a6f74de260b9a9eb4a9f3754e6b80d8f346a26f9ad07d105" exitCode=0
Aug 05 17:14:03.374331 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.374333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh" event={"ID":"8775deea-6203-4dc8-8689-0a5ef3dfdb10","Type":"ContainerDied","Data":"948ce646c99e2de3a6f74de260b9a9eb4a9f3754e6b80d8f346a26f9ad07d105"}
Aug 05 17:14:03.374548 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.374354    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"
Aug 05 17:14:03.374548 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.374402    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh" event={"ID":"8775deea-6203-4dc8-8689-0a5ef3dfdb10","Type":"ContainerDied","Data":"8ce17da52e519dc49f9b02877b9e89d2184c93030968a9064ee49ef409210d59"}
Aug 05 17:14:03.374548 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.374424    2565 scope.go:117] "RemoveContainer" containerID="948ce646c99e2de3a6f74de260b9a9eb4a9f3754e6b80d8f346a26f9ad07d105"
Aug 05 17:14:03.384292 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.384276    2565 scope.go:117] "RemoveContainer" containerID="948ce646c99e2de3a6f74de260b9a9eb4a9f3754e6b80d8f346a26f9ad07d105"
Aug 05 17:14:03.384546 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:14:03.384527    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"948ce646c99e2de3a6f74de260b9a9eb4a9f3754e6b80d8f346a26f9ad07d105\": container with ID starting with 948ce646c99e2de3a6f74de260b9a9eb4a9f3754e6b80d8f346a26f9ad07d105 not found: ID does not exist" containerID="948ce646c99e2de3a6f74de260b9a9eb4a9f3754e6b80d8f346a26f9ad07d105"
Aug 05 17:14:03.384588 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.384555    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"948ce646c99e2de3a6f74de260b9a9eb4a9f3754e6b80d8f346a26f9ad07d105"} err="failed to get container status \"948ce646c99e2de3a6f74de260b9a9eb4a9f3754e6b80d8f346a26f9ad07d105\": rpc error: code = NotFound desc = could not find container \"948ce646c99e2de3a6f74de260b9a9eb4a9f3754e6b80d8f346a26f9ad07d105\": container with ID starting with 948ce646c99e2de3a6f74de260b9a9eb4a9f3754e6b80d8f346a26f9ad07d105 not found: ID does not exist"
Aug 05 17:14:03.416734 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.416707    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"]
Aug 05 17:14:03.418756 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.418734    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-knrnh"]
Aug 05 17:14:03.952841 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:14:03.952806    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8775deea-6203-4dc8-8689-0a5ef3dfdb10" path="/var/lib/kubelet/pods/8775deea-6203-4dc8-8689-0a5ef3dfdb10/volumes"
Aug 05 17:15:00.154762 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.154727    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765835-shgrn"]
Aug 05 17:15:00.155244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.155065    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9434221b-7bfa-4742-85ab-ebd6df6192d2" containerName="istio-proxy"
Aug 05 17:15:00.155244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.155076    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9434221b-7bfa-4742-85ab-ebd6df6192d2" containerName="istio-proxy"
Aug 05 17:15:00.155244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.155085    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f097871-40ae-444c-bcb6-ca4711013057" containerName="payload-pre-processing"
Aug 05 17:15:00.155244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.155090    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f097871-40ae-444c-bcb6-ca4711013057" containerName="payload-pre-processing"
Aug 05 17:15:00.155244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.155114    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8775deea-6203-4dc8-8689-0a5ef3dfdb10" containerName="manager"
Aug 05 17:15:00.155244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.155124    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8775deea-6203-4dc8-8689-0a5ef3dfdb10" containerName="manager"
Aug 05 17:15:00.155244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.155139    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9434221b-7bfa-4742-85ab-ebd6df6192d2" containerName="istio-proxy"
Aug 05 17:15:00.155244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.155145    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9434221b-7bfa-4742-85ab-ebd6df6192d2" containerName="istio-proxy"
Aug 05 17:15:00.155244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.155153    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b513b3e-638d-4782-8d3f-0ba72f0779d9" containerName="payload-processing"
Aug 05 17:15:00.155244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.155159    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b513b3e-638d-4782-8d3f-0ba72f0779d9" containerName="payload-processing"
Aug 05 17:15:00.155244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.155212    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f097871-40ae-444c-bcb6-ca4711013057" containerName="payload-pre-processing"
Aug 05 17:15:00.155244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.155221    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8775deea-6203-4dc8-8689-0a5ef3dfdb10" containerName="manager"
Aug 05 17:15:00.155244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.155227    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b513b3e-638d-4782-8d3f-0ba72f0779d9" containerName="payload-processing"
Aug 05 17:15:00.155244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.155234    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9434221b-7bfa-4742-85ab-ebd6df6192d2" containerName="istio-proxy"
Aug 05 17:15:00.155244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.155239    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9434221b-7bfa-4742-85ab-ebd6df6192d2" containerName="istio-proxy"
Aug 05 17:15:00.158233 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.158217    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-shgrn"
Aug 05 17:15:00.161726 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.161695    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:15:00.167278 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.167263    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-shgrn"
Aug 05 17:15:00.174192 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.174169    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765835-shgrn"]
Aug 05 17:15:00.299559 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.299531    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765835-shgrn"]
Aug 05 17:15:00.300582 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:15:00.300554    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2324861_6a4a_499b_bb71_183dedc3fcb8.slice/crio-7e9e4cd2f37f7982abf47fe54c3f3113f3ef4030cef8a0611aef38bed259ad92 WatchSource:0}: Error finding container 7e9e4cd2f37f7982abf47fe54c3f3113f3ef4030cef8a0611aef38bed259ad92: Status 404 returned error can't find the container with id 7e9e4cd2f37f7982abf47fe54c3f3113f3ef4030cef8a0611aef38bed259ad92
Aug 05 17:15:00.650289 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.650256    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-shgrn" event={"ID":"a2324861-6a4a-499b-bb71-183dedc3fcb8","Type":"ContainerStarted","Data":"3647344b57f0ecaccc4bb8a62ab4e65a61ff427b0700619e8ffd624e9d2de758"}
Aug 05 17:15:00.650462 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.650308    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-shgrn" event={"ID":"a2324861-6a4a-499b-bb71-183dedc3fcb8","Type":"ContainerStarted","Data":"7e9e4cd2f37f7982abf47fe54c3f3113f3ef4030cef8a0611aef38bed259ad92"}
Aug 05 17:15:00.667866 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:00.667825    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-shgrn" podStartSLOduration=0.667813292 podStartE2EDuration="667.813292ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:00.667481746 +0000 UTC m=+2173.249553414" watchObservedRunningTime="2026-08-05 17:15:00.667813292 +0000 UTC m=+2173.249884947"
Aug 05 17:15:01.656835 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:01.656804    2565 generic.go:356] "Generic (PLEG): container finished" podID="a2324861-6a4a-499b-bb71-183dedc3fcb8" containerID="3647344b57f0ecaccc4bb8a62ab4e65a61ff427b0700619e8ffd624e9d2de758" exitCode=0
Aug 05 17:15:01.657248 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:01.656865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-shgrn" event={"ID":"a2324861-6a4a-499b-bb71-183dedc3fcb8","Type":"ContainerDied","Data":"3647344b57f0ecaccc4bb8a62ab4e65a61ff427b0700619e8ffd624e9d2de758"}
Aug 05 17:15:02.796074 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:02.796051    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-shgrn"
Aug 05 17:15:03.668462 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:03.668434    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-shgrn" event={"ID":"a2324861-6a4a-499b-bb71-183dedc3fcb8","Type":"ContainerDied","Data":"7e9e4cd2f37f7982abf47fe54c3f3113f3ef4030cef8a0611aef38bed259ad92"}
Aug 05 17:15:03.668634 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:03.668481    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e9e4cd2f37f7982abf47fe54c3f3113f3ef4030cef8a0611aef38bed259ad92"
Aug 05 17:15:03.668634 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:03.668443    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-shgrn"
Aug 05 17:15:18.364362 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:18.364327    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc"]
Aug 05 17:15:18.364904 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:18.364667    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2324861-6a4a-499b-bb71-183dedc3fcb8" containerName="cleanup"
Aug 05 17:15:18.364904 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:18.364685    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2324861-6a4a-499b-bb71-183dedc3fcb8" containerName="cleanup"
Aug 05 17:15:18.364904 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:18.364751    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2324861-6a4a-499b-bb71-183dedc3fcb8" containerName="cleanup"
Aug 05 17:15:18.367729 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:18.367713    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc"
Aug 05 17:15:18.370945 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:18.370925    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-69w5h\""
Aug 05 17:15:18.384717 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:18.384691    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc"]
Aug 05 17:15:18.434972 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:18.434941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9pfs\" (UniqueName: \"kubernetes.io/projected/4d8cd1e8-8354-49b0-98d6-1b77f8e15530-kube-api-access-q9pfs\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cjvvc\" (UID: \"4d8cd1e8-8354-49b0-98d6-1b77f8e15530\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc"
Aug 05 17:15:18.435165 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:18.435072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d8cd1e8-8354-49b0-98d6-1b77f8e15530-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cjvvc\" (UID: \"4d8cd1e8-8354-49b0-98d6-1b77f8e15530\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc"
Aug 05 17:15:18.535943 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:18.535898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d8cd1e8-8354-49b0-98d6-1b77f8e15530-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cjvvc\" (UID: \"4d8cd1e8-8354-49b0-98d6-1b77f8e15530\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc"
Aug 05 17:15:18.536129 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:18.535951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9pfs\" (UniqueName: \"kubernetes.io/projected/4d8cd1e8-8354-49b0-98d6-1b77f8e15530-kube-api-access-q9pfs\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cjvvc\" (UID: \"4d8cd1e8-8354-49b0-98d6-1b77f8e15530\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc"
Aug 05 17:15:18.536278 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:18.536259    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d8cd1e8-8354-49b0-98d6-1b77f8e15530-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cjvvc\" (UID: \"4d8cd1e8-8354-49b0-98d6-1b77f8e15530\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc"
Aug 05 17:15:18.545699 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:18.545679    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9pfs\" (UniqueName: \"kubernetes.io/projected/4d8cd1e8-8354-49b0-98d6-1b77f8e15530-kube-api-access-q9pfs\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cjvvc\" (UID: \"4d8cd1e8-8354-49b0-98d6-1b77f8e15530\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc"
Aug 05 17:15:18.677436 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:18.677366    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc"
Aug 05 17:15:18.827402 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:18.827375    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc"]
Aug 05 17:15:18.828284 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:15:18.828257    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8cd1e8_8354_49b0_98d6_1b77f8e15530.slice/crio-dd49fa2ff0ad5927fc732a5b4873e8e4de3775e62df4af4d753b2e683cf8fa37 WatchSource:0}: Error finding container dd49fa2ff0ad5927fc732a5b4873e8e4de3775e62df4af4d753b2e683cf8fa37: Status 404 returned error can't find the container with id dd49fa2ff0ad5927fc732a5b4873e8e4de3775e62df4af4d753b2e683cf8fa37
Aug 05 17:15:19.752136 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:19.752084    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc" event={"ID":"4d8cd1e8-8354-49b0-98d6-1b77f8e15530","Type":"ContainerStarted","Data":"29579bc6b23f2ddb542663af8b14aae3d15067875606f86cfc04094f2476aa07"}
Aug 05 17:15:19.752534 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:19.752182    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc" event={"ID":"4d8cd1e8-8354-49b0-98d6-1b77f8e15530","Type":"ContainerStarted","Data":"dd49fa2ff0ad5927fc732a5b4873e8e4de3775e62df4af4d753b2e683cf8fa37"}
Aug 05 17:15:19.752534 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:19.752239    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc"
Aug 05 17:15:19.778891 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:19.778845    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc" podStartSLOduration=1.778830284 podStartE2EDuration="1.778830284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:19.775938131 +0000 UTC m=+2192.358009803" watchObservedRunningTime="2026-08-05 17:15:19.778830284 +0000 UTC m=+2192.360901940"
Aug 05 17:15:30.759422 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:30.759392    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cjvvc"
Aug 05 17:15:37.804366 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:37.804334    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"]
Aug 05 17:15:37.807991 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:37.807972    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:37.812169 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:37.812151    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-dcd532bc-openshift-default-dockercfg-7mtvt\""
Aug 05 17:15:37.838479 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:37.838449    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"]
Aug 05 17:15:37.905438 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:37.905402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bts4f\" (UniqueName: \"kubernetes.io/projected/50300a24-0b19-4103-ac0b-39607a50e164-kube-api-access-bts4f\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:37.905640 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:37.905459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50300a24-0b19-4103-ac0b-39607a50e164-istiod-ca-cert\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:37.905640 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:37.905491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50300a24-0b19-4103-ac0b-39607a50e164-istio-token\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:37.905640 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:37.905585    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-workload-socket\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:37.905640 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:37.905628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-credential-socket\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:37.905897 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:37.905655    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50300a24-0b19-4103-ac0b-39607a50e164-istio-podinfo\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:37.905897 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:37.905795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-istio-envoy\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:37.906001 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:37.905912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-istio-data\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:37.906049 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:37.906033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-workload-certs\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.006473 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.006438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-credential-socket\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.006473 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.006472    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50300a24-0b19-4103-ac0b-39607a50e164-istio-podinfo\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.006733 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.006518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-istio-envoy\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.006733 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.006536    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-istio-data\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.006733 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.006558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-workload-certs\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.006733 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.006579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bts4f\" (UniqueName: \"kubernetes.io/projected/50300a24-0b19-4103-ac0b-39607a50e164-kube-api-access-bts4f\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.006733 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.006606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50300a24-0b19-4103-ac0b-39607a50e164-istiod-ca-cert\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.006733 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.006631    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50300a24-0b19-4103-ac0b-39607a50e164-istio-token\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.006733 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.006676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-workload-socket\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.007087 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.006918    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-credential-socket\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.007087 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.006964    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-workload-certs\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.007087 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.007008    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-workload-socket\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.007452 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.007428    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-istio-data\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.007520 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.007431    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50300a24-0b19-4103-ac0b-39607a50e164-istiod-ca-cert\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.008833 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.008811    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-istio-envoy\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.009014 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.008998    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50300a24-0b19-4103-ac0b-39607a50e164-istio-podinfo\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.026740 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.026706    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bts4f\" (UniqueName: \"kubernetes.io/projected/50300a24-0b19-4103-ac0b-39607a50e164-kube-api-access-bts4f\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.029909 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.029886    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50300a24-0b19-4103-ac0b-39607a50e164-istio-token\") pod \"e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") " pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.117387 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.117299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:38.266239 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.266215    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"]
Aug 05 17:15:38.268514 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:15:38.268486    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50300a24_0b19_4103_ac0b_39607a50e164.slice/crio-841b2daeafa2a88bc72a4faab8b90105374c20813449b3280774ab41c779ba4f WatchSource:0}: Error finding container 841b2daeafa2a88bc72a4faab8b90105374c20813449b3280774ab41c779ba4f: Status 404 returned error can't find the container with id 841b2daeafa2a88bc72a4faab8b90105374c20813449b3280774ab41c779ba4f
Aug 05 17:15:38.273109 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.273065    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:15:38.273203 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.273159    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:15:38.273203 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.273187    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:15:38.853562 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.853519    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7" event={"ID":"50300a24-0b19-4103-ac0b-39607a50e164","Type":"ContainerStarted","Data":"dee2d2a72fd011a4ca166a4f4b2c13aacd6a1583c50635794ae6077ee4482d6b"}
Aug 05 17:15:38.854003 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.853623    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7" event={"ID":"50300a24-0b19-4103-ac0b-39607a50e164","Type":"ContainerStarted","Data":"841b2daeafa2a88bc72a4faab8b90105374c20813449b3280774ab41c779ba4f"}
Aug 05 17:15:38.888403 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:38.888357    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7" podStartSLOduration=1.888341636 podStartE2EDuration="1.888341636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:38.88777902 +0000 UTC m=+2211.469850676" watchObservedRunningTime="2026-08-05 17:15:38.888341636 +0000 UTC m=+2211.470413292"
Aug 05 17:15:39.118300 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:39.118223    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:39.122990 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:39.122969    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:39.860218 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:39.860186    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:39.861045 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:39.861028    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:43.610832 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.610796    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"]
Aug 05 17:15:43.614436 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.614419    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"
Aug 05 17:15:43.619764 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.619745    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-dcd532bc-dockercfg-nms8f\""
Aug 05 17:15:43.619935 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.619913    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-dcd532bc\""
Aug 05 17:15:43.645490 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.645464    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"]
Aug 05 17:15:43.648805 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.648787    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"
Aug 05 17:15:43.663998 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.663975    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/397bc9b5-a121-469c-bc80-eeebf9fb4a7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h\" (UID: \"397bc9b5-a121-469c-bc80-eeebf9fb4a7a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"
Aug 05 17:15:43.664274 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.664251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs4pw\" (UniqueName: \"kubernetes.io/projected/397bc9b5-a121-469c-bc80-eeebf9fb4a7a-kube-api-access-cs4pw\") pod \"payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h\" (UID: \"397bc9b5-a121-469c-bc80-eeebf9fb4a7a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"
Aug 05 17:15:43.665648 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.665632    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"]
Aug 05 17:15:43.687330 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.687307    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"]
Aug 05 17:15:43.765793 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.765759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/397bc9b5-a121-469c-bc80-eeebf9fb4a7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h\" (UID: \"397bc9b5-a121-469c-bc80-eeebf9fb4a7a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"
Aug 05 17:15:43.765960 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.765801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24e3c44d-e5bc-4b0c-9162-124c7b68df0d-plugins-config-volume\") pod \"payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b\" (UID: \"24e3c44d-e5bc-4b0c-9162-124c7b68df0d\") " pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"
Aug 05 17:15:43.765960 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.765835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8qgf\" (UniqueName: \"kubernetes.io/projected/24e3c44d-e5bc-4b0c-9162-124c7b68df0d-kube-api-access-c8qgf\") pod \"payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b\" (UID: \"24e3c44d-e5bc-4b0c-9162-124c7b68df0d\") " pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"
Aug 05 17:15:43.765960 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.765876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs4pw\" (UniqueName: \"kubernetes.io/projected/397bc9b5-a121-469c-bc80-eeebf9fb4a7a-kube-api-access-cs4pw\") pod \"payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h\" (UID: \"397bc9b5-a121-469c-bc80-eeebf9fb4a7a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"
Aug 05 17:15:43.766514 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.766493    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/397bc9b5-a121-469c-bc80-eeebf9fb4a7a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h\" (UID: \"397bc9b5-a121-469c-bc80-eeebf9fb4a7a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"
Aug 05 17:15:43.781471 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.781446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs4pw\" (UniqueName: \"kubernetes.io/projected/397bc9b5-a121-469c-bc80-eeebf9fb4a7a-kube-api-access-cs4pw\") pod \"payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h\" (UID: \"397bc9b5-a121-469c-bc80-eeebf9fb4a7a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"
Aug 05 17:15:43.866870 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.866717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8qgf\" (UniqueName: \"kubernetes.io/projected/24e3c44d-e5bc-4b0c-9162-124c7b68df0d-kube-api-access-c8qgf\") pod \"payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b\" (UID: \"24e3c44d-e5bc-4b0c-9162-124c7b68df0d\") " pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"
Aug 05 17:15:43.867056 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.866922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24e3c44d-e5bc-4b0c-9162-124c7b68df0d-plugins-config-volume\") pod \"payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b\" (UID: \"24e3c44d-e5bc-4b0c-9162-124c7b68df0d\") " pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"
Aug 05 17:15:43.867644 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.867624    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24e3c44d-e5bc-4b0c-9162-124c7b68df0d-plugins-config-volume\") pod \"payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b\" (UID: \"24e3c44d-e5bc-4b0c-9162-124c7b68df0d\") " pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"
Aug 05 17:15:43.885041 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.885013    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8qgf\" (UniqueName: \"kubernetes.io/projected/24e3c44d-e5bc-4b0c-9162-124c7b68df0d-kube-api-access-c8qgf\") pod \"payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b\" (UID: \"24e3c44d-e5bc-4b0c-9162-124c7b68df0d\") " pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"
Aug 05 17:15:43.924707 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.924681    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"
Aug 05 17:15:43.958478 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:43.958447    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"
Aug 05 17:15:44.137202 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:44.137114    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"]
Aug 05 17:15:44.145416 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:15:44.145375    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24e3c44d_e5bc_4b0c_9162_124c7b68df0d.slice/crio-2d8b43a82699897a03bc328885fc994589973fa9f69c6d7a0669c11510d09522 WatchSource:0}: Error finding container 2d8b43a82699897a03bc328885fc994589973fa9f69c6d7a0669c11510d09522: Status 404 returned error can't find the container with id 2d8b43a82699897a03bc328885fc994589973fa9f69c6d7a0669c11510d09522
Aug 05 17:15:44.310798 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:44.310773    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"]
Aug 05 17:15:44.312702 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:15:44.312677    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397bc9b5_a121_469c_bc80_eeebf9fb4a7a.slice/crio-c809ecf5d723338b89933024116a6da63b3132d60c974a1dca5bfc55e68fbc97 WatchSource:0}: Error finding container c809ecf5d723338b89933024116a6da63b3132d60c974a1dca5bfc55e68fbc97: Status 404 returned error can't find the container with id c809ecf5d723338b89933024116a6da63b3132d60c974a1dca5bfc55e68fbc97
Aug 05 17:15:44.889012 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:44.888969    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h" event={"ID":"397bc9b5-a121-469c-bc80-eeebf9fb4a7a","Type":"ContainerStarted","Data":"0593b77835f0d4d007b8abf0866cd39e24226e462441aef4de7a0a49b82e25a0"}
Aug 05 17:15:44.889494 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:44.889037    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"
Aug 05 17:15:44.889494 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:44.889064    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h" event={"ID":"397bc9b5-a121-469c-bc80-eeebf9fb4a7a","Type":"ContainerStarted","Data":"c809ecf5d723338b89933024116a6da63b3132d60c974a1dca5bfc55e68fbc97"}
Aug 05 17:15:44.890652 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:44.890626    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b" event={"ID":"24e3c44d-e5bc-4b0c-9162-124c7b68df0d","Type":"ContainerStarted","Data":"e43325c7f35b75d6db6583c3d33ab051cbf04e8cd8b3f2ec1f966074c96607f1"}
Aug 05 17:15:44.890761 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:44.890667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b" event={"ID":"24e3c44d-e5bc-4b0c-9162-124c7b68df0d","Type":"ContainerStarted","Data":"2d8b43a82699897a03bc328885fc994589973fa9f69c6d7a0669c11510d09522"}
Aug 05 17:15:44.890821 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:44.890777    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"
Aug 05 17:15:44.914869 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:44.914818    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h" podStartSLOduration=1.9148042269999999 podStartE2EDuration="1.914804227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:44.912618429 +0000 UTC m=+2217.494690085" watchObservedRunningTime="2026-08-05 17:15:44.914804227 +0000 UTC m=+2217.496875883"
Aug 05 17:15:44.944172 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:44.944128    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b" podStartSLOduration=1.9441145020000001 podStartE2EDuration="1.944114502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:44.942603229 +0000 UTC m=+2217.524674907" watchObservedRunningTime="2026-08-05 17:15:44.944114502 +0000 UTC m=+2217.526186154"
Aug 05 17:15:55.691915 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:55.691245    2565 patch_prober.go:28] interesting pod/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": read tcp 10.132.0.2:36796->10.132.0.69:15021: read: connection reset by peer" start-of-body=
Aug 05 17:15:55.691915 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:55.691344    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7" podUID="50300a24-0b19-4103-ac0b-39607a50e164" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": read tcp 10.132.0.2:36796->10.132.0.69:15021: read: connection reset by peer"
Aug 05 17:15:55.898658 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:55.898585    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"
Aug 05 17:15:55.898801 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:55.898663    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"
Aug 05 17:15:55.959228 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:55.959143    2565 generic.go:356] "Generic (PLEG): container finished" podID="50300a24-0b19-4103-ac0b-39607a50e164" containerID="dee2d2a72fd011a4ca166a4f4b2c13aacd6a1583c50635794ae6077ee4482d6b" exitCode=0
Aug 05 17:15:55.959228 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:55.959194    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7" event={"ID":"50300a24-0b19-4103-ac0b-39607a50e164","Type":"ContainerDied","Data":"dee2d2a72fd011a4ca166a4f4b2c13aacd6a1583c50635794ae6077ee4482d6b"}
Aug 05 17:15:55.959703 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:55.959639    2565 scope.go:117] "RemoveContainer" containerID="dee2d2a72fd011a4ca166a4f4b2c13aacd6a1583c50635794ae6077ee4482d6b"
Aug 05 17:15:55.961288 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:55.961251    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:15:55.961380 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:55.961344    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:15:55.961424 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:55.961392    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:15:56.966800 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:56.966763    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7" event={"ID":"50300a24-0b19-4103-ac0b-39607a50e164","Type":"ContainerStarted","Data":"b4c69eecb03b94db2972a67dd426320aace5648ec4504ddfb314ad8acb972b87"}
Aug 05 17:15:57.117710 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:57.117678    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:15:57.117928 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:57.117906    2565 patch_prober.go:28] interesting pod/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Aug 05 17:15:57.117975 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:57.117959    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7" podUID="50300a24-0b19-4103-ac0b-39607a50e164" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Aug 05 17:15:58.117749 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:58.117717    2565 patch_prober.go:28] interesting pod/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Aug 05 17:15:58.118159 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:58.117767    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7" podUID="50300a24-0b19-4103-ac0b-39607a50e164" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Aug 05 17:15:59.118390 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:59.118356    2565 patch_prober.go:28] interesting pod/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Aug 05 17:15:59.118767 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:15:59.118436    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7" podUID="50300a24-0b19-4103-ac0b-39607a50e164" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Aug 05 17:16:00.118349 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:16:00.118312    2565 patch_prober.go:28] interesting pod/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Aug 05 17:16:00.118541 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:16:00.118375    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7" podUID="50300a24-0b19-4103-ac0b-39607a50e164" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Aug 05 17:16:01.117760 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:16:01.117728    2565 patch_prober.go:28] interesting pod/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Aug 05 17:16:01.117932 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:16:01.117794    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7" podUID="50300a24-0b19-4103-ac0b-39607a50e164" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Aug 05 17:16:02.121107 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:16:02.121063    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:16:02.121769 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:16:02.121379    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:16:02.121969 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:16:02.121951    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:17:01.292879 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.292849    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"]
Aug 05 17:17:01.293390 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.293081    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h" podUID="397bc9b5-a121-469c-bc80-eeebf9fb4a7a" containerName="payload-pre-processing" containerID="cri-o://0593b77835f0d4d007b8abf0866cd39e24226e462441aef4de7a0a49b82e25a0" gracePeriod=30
Aug 05 17:17:01.305860 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.305833    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"]
Aug 05 17:17:01.306035 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.306017    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b" podUID="24e3c44d-e5bc-4b0c-9162-124c7b68df0d" containerName="payload-processing" containerID="cri-o://e43325c7f35b75d6db6583c3d33ab051cbf04e8cd8b3f2ec1f966074c96607f1" gracePeriod=30
Aug 05 17:17:01.567301 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.567276    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"
Aug 05 17:17:01.584889 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.584866    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"
Aug 05 17:17:01.628262 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.628227    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs4pw\" (UniqueName: \"kubernetes.io/projected/397bc9b5-a121-469c-bc80-eeebf9fb4a7a-kube-api-access-cs4pw\") pod \"397bc9b5-a121-469c-bc80-eeebf9fb4a7a\" (UID: \"397bc9b5-a121-469c-bc80-eeebf9fb4a7a\") "
Aug 05 17:17:01.628433 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.628328    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8qgf\" (UniqueName: \"kubernetes.io/projected/24e3c44d-e5bc-4b0c-9162-124c7b68df0d-kube-api-access-c8qgf\") pod \"24e3c44d-e5bc-4b0c-9162-124c7b68df0d\" (UID: \"24e3c44d-e5bc-4b0c-9162-124c7b68df0d\") "
Aug 05 17:17:01.628433 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.628364    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/397bc9b5-a121-469c-bc80-eeebf9fb4a7a-plugins-config-volume\") pod \"397bc9b5-a121-469c-bc80-eeebf9fb4a7a\" (UID: \"397bc9b5-a121-469c-bc80-eeebf9fb4a7a\") "
Aug 05 17:17:01.628433 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.628391    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24e3c44d-e5bc-4b0c-9162-124c7b68df0d-plugins-config-volume\") pod \"24e3c44d-e5bc-4b0c-9162-124c7b68df0d\" (UID: \"24e3c44d-e5bc-4b0c-9162-124c7b68df0d\") "
Aug 05 17:17:01.629077 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.629036    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24e3c44d-e5bc-4b0c-9162-124c7b68df0d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "24e3c44d-e5bc-4b0c-9162-124c7b68df0d" (UID: "24e3c44d-e5bc-4b0c-9162-124c7b68df0d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:17:01.629903 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.629865    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/397bc9b5-a121-469c-bc80-eeebf9fb4a7a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "397bc9b5-a121-469c-bc80-eeebf9fb4a7a" (UID: "397bc9b5-a121-469c-bc80-eeebf9fb4a7a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:17:01.631775 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.631752    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/397bc9b5-a121-469c-bc80-eeebf9fb4a7a-kube-api-access-cs4pw" (OuterVolumeSpecName: "kube-api-access-cs4pw") pod "397bc9b5-a121-469c-bc80-eeebf9fb4a7a" (UID: "397bc9b5-a121-469c-bc80-eeebf9fb4a7a"). InnerVolumeSpecName "kube-api-access-cs4pw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:17:01.632499 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.632465    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24e3c44d-e5bc-4b0c-9162-124c7b68df0d-kube-api-access-c8qgf" (OuterVolumeSpecName: "kube-api-access-c8qgf") pod "24e3c44d-e5bc-4b0c-9162-124c7b68df0d" (UID: "24e3c44d-e5bc-4b0c-9162-124c7b68df0d"). InnerVolumeSpecName "kube-api-access-c8qgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:17:01.730060 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.730026    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8qgf\" (UniqueName: \"kubernetes.io/projected/24e3c44d-e5bc-4b0c-9162-124c7b68df0d-kube-api-access-c8qgf\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:17:01.730060 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.730056    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/397bc9b5-a121-469c-bc80-eeebf9fb4a7a-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:17:01.730060 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.730065    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24e3c44d-e5bc-4b0c-9162-124c7b68df0d-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:17:01.730326 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:01.730074    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs4pw\" (UniqueName: \"kubernetes.io/projected/397bc9b5-a121-469c-bc80-eeebf9fb4a7a-kube-api-access-cs4pw\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:17:02.301210 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.301178    2565 generic.go:356] "Generic (PLEG): container finished" podID="397bc9b5-a121-469c-bc80-eeebf9fb4a7a" containerID="0593b77835f0d4d007b8abf0866cd39e24226e462441aef4de7a0a49b82e25a0" exitCode=0
Aug 05 17:17:02.301634 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.301235    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"
Aug 05 17:17:02.301634 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.301260    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h" event={"ID":"397bc9b5-a121-469c-bc80-eeebf9fb4a7a","Type":"ContainerDied","Data":"0593b77835f0d4d007b8abf0866cd39e24226e462441aef4de7a0a49b82e25a0"}
Aug 05 17:17:02.301634 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.301315    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h" event={"ID":"397bc9b5-a121-469c-bc80-eeebf9fb4a7a","Type":"ContainerDied","Data":"c809ecf5d723338b89933024116a6da63b3132d60c974a1dca5bfc55e68fbc97"}
Aug 05 17:17:02.301634 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.301346    2565 scope.go:117] "RemoveContainer" containerID="0593b77835f0d4d007b8abf0866cd39e24226e462441aef4de7a0a49b82e25a0"
Aug 05 17:17:02.302714 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.302694    2565 generic.go:356] "Generic (PLEG): container finished" podID="24e3c44d-e5bc-4b0c-9162-124c7b68df0d" containerID="e43325c7f35b75d6db6583c3d33ab051cbf04e8cd8b3f2ec1f966074c96607f1" exitCode=0
Aug 05 17:17:02.302801 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.302736    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"
Aug 05 17:17:02.302801 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.302758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b" event={"ID":"24e3c44d-e5bc-4b0c-9162-124c7b68df0d","Type":"ContainerDied","Data":"e43325c7f35b75d6db6583c3d33ab051cbf04e8cd8b3f2ec1f966074c96607f1"}
Aug 05 17:17:02.302894 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.302798    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b" event={"ID":"24e3c44d-e5bc-4b0c-9162-124c7b68df0d","Type":"ContainerDied","Data":"2d8b43a82699897a03bc328885fc994589973fa9f69c6d7a0669c11510d09522"}
Aug 05 17:17:02.316338 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.316319    2565 scope.go:117] "RemoveContainer" containerID="0593b77835f0d4d007b8abf0866cd39e24226e462441aef4de7a0a49b82e25a0"
Aug 05 17:17:02.316607 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:17:02.316586    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0593b77835f0d4d007b8abf0866cd39e24226e462441aef4de7a0a49b82e25a0\": container with ID starting with 0593b77835f0d4d007b8abf0866cd39e24226e462441aef4de7a0a49b82e25a0 not found: ID does not exist" containerID="0593b77835f0d4d007b8abf0866cd39e24226e462441aef4de7a0a49b82e25a0"
Aug 05 17:17:02.316668 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.316616    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0593b77835f0d4d007b8abf0866cd39e24226e462441aef4de7a0a49b82e25a0"} err="failed to get container status \"0593b77835f0d4d007b8abf0866cd39e24226e462441aef4de7a0a49b82e25a0\": rpc error: code = NotFound desc = could not find container \"0593b77835f0d4d007b8abf0866cd39e24226e462441aef4de7a0a49b82e25a0\": container with ID starting with 0593b77835f0d4d007b8abf0866cd39e24226e462441aef4de7a0a49b82e25a0 not found: ID does not exist"
Aug 05 17:17:02.316668 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.316632    2565 scope.go:117] "RemoveContainer" containerID="e43325c7f35b75d6db6583c3d33ab051cbf04e8cd8b3f2ec1f966074c96607f1"
Aug 05 17:17:02.324522 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.324502    2565 scope.go:117] "RemoveContainer" containerID="e43325c7f35b75d6db6583c3d33ab051cbf04e8cd8b3f2ec1f966074c96607f1"
Aug 05 17:17:02.324802 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:17:02.324784    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e43325c7f35b75d6db6583c3d33ab051cbf04e8cd8b3f2ec1f966074c96607f1\": container with ID starting with e43325c7f35b75d6db6583c3d33ab051cbf04e8cd8b3f2ec1f966074c96607f1 not found: ID does not exist" containerID="e43325c7f35b75d6db6583c3d33ab051cbf04e8cd8b3f2ec1f966074c96607f1"
Aug 05 17:17:02.324861 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.324809    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e43325c7f35b75d6db6583c3d33ab051cbf04e8cd8b3f2ec1f966074c96607f1"} err="failed to get container status \"e43325c7f35b75d6db6583c3d33ab051cbf04e8cd8b3f2ec1f966074c96607f1\": rpc error: code = NotFound desc = could not find container \"e43325c7f35b75d6db6583c3d33ab051cbf04e8cd8b3f2ec1f966074c96607f1\": container with ID starting with e43325c7f35b75d6db6583c3d33ab051cbf04e8cd8b3f2ec1f966074c96607f1 not found: ID does not exist"
Aug 05 17:17:02.329947 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.329925    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"]
Aug 05 17:17:02.335797 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.335776    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dcd532bc-ddf6dcb46-nlk4b"]
Aug 05 17:17:02.356713 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.356688    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"]
Aug 05 17:17:02.361804 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:02.361784    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-dcd532bc-8685958fb8-hcf4h"]
Aug 05 17:17:03.953111 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:03.953069    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24e3c44d-e5bc-4b0c-9162-124c7b68df0d" path="/var/lib/kubelet/pods/24e3c44d-e5bc-4b0c-9162-124c7b68df0d/volumes"
Aug 05 17:17:03.953576 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:03.953551    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="397bc9b5-a121-469c-bc80-eeebf9fb4a7a" path="/var/lib/kubelet/pods/397bc9b5-a121-469c-bc80-eeebf9fb4a7a/volumes"
Aug 05 17:17:56.574882 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:56.574846    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"]
Aug 05 17:17:56.575383 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:17:56.575045    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7" podUID="50300a24-0b19-4103-ac0b-39607a50e164" containerName="istio-proxy" containerID="cri-o://b4c69eecb03b94db2972a67dd426320aace5648ec4504ddfb314ad8acb972b87" gracePeriod=30
Aug 05 17:18:01.819964 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.819937    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:18:01.861676 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.861592    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bts4f\" (UniqueName: \"kubernetes.io/projected/50300a24-0b19-4103-ac0b-39607a50e164-kube-api-access-bts4f\") pod \"50300a24-0b19-4103-ac0b-39607a50e164\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") "
Aug 05 17:18:01.861676 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.861644    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-workload-certs\") pod \"50300a24-0b19-4103-ac0b-39607a50e164\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") "
Aug 05 17:18:01.861917 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.861751    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50300a24-0b19-4103-ac0b-39607a50e164-istio-token\") pod \"50300a24-0b19-4103-ac0b-39607a50e164\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") "
Aug 05 17:18:01.861917 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.861798    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-credential-socket\") pod \"50300a24-0b19-4103-ac0b-39607a50e164\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") "
Aug 05 17:18:01.861917 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.861827    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-istio-envoy\") pod \"50300a24-0b19-4103-ac0b-39607a50e164\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") "
Aug 05 17:18:01.861917 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.861848    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-workload-socket\") pod \"50300a24-0b19-4103-ac0b-39607a50e164\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") "
Aug 05 17:18:01.861917 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.861865    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50300a24-0b19-4103-ac0b-39607a50e164-istio-podinfo\") pod \"50300a24-0b19-4103-ac0b-39607a50e164\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") "
Aug 05 17:18:01.862244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.861924    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "50300a24-0b19-4103-ac0b-39607a50e164" (UID: "50300a24-0b19-4103-ac0b-39607a50e164"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:18:01.862244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.861949    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-istio-data\") pod \"50300a24-0b19-4103-ac0b-39607a50e164\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") "
Aug 05 17:18:01.862244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.861980    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50300a24-0b19-4103-ac0b-39607a50e164-istiod-ca-cert\") pod \"50300a24-0b19-4103-ac0b-39607a50e164\" (UID: \"50300a24-0b19-4103-ac0b-39607a50e164\") "
Aug 05 17:18:01.862244 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.862140    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "50300a24-0b19-4103-ac0b-39607a50e164" (UID: "50300a24-0b19-4103-ac0b-39607a50e164"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:18:01.862471 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.862268    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-workload-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:18:01.862471 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.862316    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-credential-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:18:01.862471 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.862324    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "50300a24-0b19-4103-ac0b-39607a50e164" (UID: "50300a24-0b19-4103-ac0b-39607a50e164"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:18:01.862471 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.862427    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50300a24-0b19-4103-ac0b-39607a50e164-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "50300a24-0b19-4103-ac0b-39607a50e164" (UID: "50300a24-0b19-4103-ac0b-39607a50e164"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:18:01.862680 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.862511    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-istio-data" (OuterVolumeSpecName: "istio-data") pod "50300a24-0b19-4103-ac0b-39607a50e164" (UID: "50300a24-0b19-4103-ac0b-39607a50e164"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:18:01.863938 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.863909    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50300a24-0b19-4103-ac0b-39607a50e164-kube-api-access-bts4f" (OuterVolumeSpecName: "kube-api-access-bts4f") pod "50300a24-0b19-4103-ac0b-39607a50e164" (UID: "50300a24-0b19-4103-ac0b-39607a50e164"). InnerVolumeSpecName "kube-api-access-bts4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:18:01.864154 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.864119    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50300a24-0b19-4103-ac0b-39607a50e164-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "50300a24-0b19-4103-ac0b-39607a50e164" (UID: "50300a24-0b19-4103-ac0b-39607a50e164"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:18:01.864344 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.864319    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50300a24-0b19-4103-ac0b-39607a50e164-istio-token" (OuterVolumeSpecName: "istio-token") pod "50300a24-0b19-4103-ac0b-39607a50e164" (UID: "50300a24-0b19-4103-ac0b-39607a50e164"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:18:01.864420 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.864386    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "50300a24-0b19-4103-ac0b-39607a50e164" (UID: "50300a24-0b19-4103-ac0b-39607a50e164"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:18:01.962891 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.962862    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bts4f\" (UniqueName: \"kubernetes.io/projected/50300a24-0b19-4103-ac0b-39607a50e164-kube-api-access-bts4f\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:18:01.963004 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.962895    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50300a24-0b19-4103-ac0b-39607a50e164-istio-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:18:01.963004 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.962910    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-istio-envoy\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:18:01.963004 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.962923    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-workload-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:18:01.963004 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.962936    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50300a24-0b19-4103-ac0b-39607a50e164-istio-podinfo\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:18:01.963004 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.962948    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50300a24-0b19-4103-ac0b-39607a50e164-istio-data\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:18:01.963004 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:01.962961    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50300a24-0b19-4103-ac0b-39607a50e164-istiod-ca-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:18:02.626711 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:02.626674    2565 generic.go:356] "Generic (PLEG): container finished" podID="50300a24-0b19-4103-ac0b-39607a50e164" containerID="b4c69eecb03b94db2972a67dd426320aace5648ec4504ddfb314ad8acb972b87" exitCode=0
Aug 05 17:18:02.626904 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:02.626728    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"
Aug 05 17:18:02.626904 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:02.626762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7" event={"ID":"50300a24-0b19-4103-ac0b-39607a50e164","Type":"ContainerDied","Data":"b4c69eecb03b94db2972a67dd426320aace5648ec4504ddfb314ad8acb972b87"}
Aug 05 17:18:02.626904 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:02.626820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7" event={"ID":"50300a24-0b19-4103-ac0b-39607a50e164","Type":"ContainerDied","Data":"841b2daeafa2a88bc72a4faab8b90105374c20813449b3280774ab41c779ba4f"}
Aug 05 17:18:02.626904 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:02.626844    2565 scope.go:117] "RemoveContainer" containerID="b4c69eecb03b94db2972a67dd426320aace5648ec4504ddfb314ad8acb972b87"
Aug 05 17:18:02.640190 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:02.636433    2565 scope.go:117] "RemoveContainer" containerID="dee2d2a72fd011a4ca166a4f4b2c13aacd6a1583c50635794ae6077ee4482d6b"
Aug 05 17:18:02.650331 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:02.650311    2565 scope.go:117] "RemoveContainer" containerID="b4c69eecb03b94db2972a67dd426320aace5648ec4504ddfb314ad8acb972b87"
Aug 05 17:18:02.650605 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:18:02.650578    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4c69eecb03b94db2972a67dd426320aace5648ec4504ddfb314ad8acb972b87\": container with ID starting with b4c69eecb03b94db2972a67dd426320aace5648ec4504ddfb314ad8acb972b87 not found: ID does not exist" containerID="b4c69eecb03b94db2972a67dd426320aace5648ec4504ddfb314ad8acb972b87"
Aug 05 17:18:02.650662 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:02.650618    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4c69eecb03b94db2972a67dd426320aace5648ec4504ddfb314ad8acb972b87"} err="failed to get container status \"b4c69eecb03b94db2972a67dd426320aace5648ec4504ddfb314ad8acb972b87\": rpc error: code = NotFound desc = could not find container \"b4c69eecb03b94db2972a67dd426320aace5648ec4504ddfb314ad8acb972b87\": container with ID starting with b4c69eecb03b94db2972a67dd426320aace5648ec4504ddfb314ad8acb972b87 not found: ID does not exist"
Aug 05 17:18:02.650662 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:02.650636    2565 scope.go:117] "RemoveContainer" containerID="dee2d2a72fd011a4ca166a4f4b2c13aacd6a1583c50635794ae6077ee4482d6b"
Aug 05 17:18:02.650886 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:18:02.650870    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dee2d2a72fd011a4ca166a4f4b2c13aacd6a1583c50635794ae6077ee4482d6b\": container with ID starting with dee2d2a72fd011a4ca166a4f4b2c13aacd6a1583c50635794ae6077ee4482d6b not found: ID does not exist" containerID="dee2d2a72fd011a4ca166a4f4b2c13aacd6a1583c50635794ae6077ee4482d6b"
Aug 05 17:18:02.650943 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:02.650890    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dee2d2a72fd011a4ca166a4f4b2c13aacd6a1583c50635794ae6077ee4482d6b"} err="failed to get container status \"dee2d2a72fd011a4ca166a4f4b2c13aacd6a1583c50635794ae6077ee4482d6b\": rpc error: code = NotFound desc = could not find container \"dee2d2a72fd011a4ca166a4f4b2c13aacd6a1583c50635794ae6077ee4482d6b\": container with ID starting with dee2d2a72fd011a4ca166a4f4b2c13aacd6a1583c50635794ae6077ee4482d6b not found: ID does not exist"
Aug 05 17:18:02.651052 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:02.651033    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"]
Aug 05 17:18:02.657173 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:02.657152    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-dcd532bc-openshift-default-9b7649f56-hsbl7"]
Aug 05 17:18:03.953060 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:18:03.953028    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50300a24-0b19-4103-ac0b-39607a50e164" path="/var/lib/kubelet/pods/50300a24-0b19-4103-ac0b-39607a50e164/volumes"
Aug 05 17:19:07.576137 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.576092    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"]
Aug 05 17:19:07.576632 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.576612    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50300a24-0b19-4103-ac0b-39607a50e164" containerName="istio-proxy"
Aug 05 17:19:07.576632 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.576630    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="50300a24-0b19-4103-ac0b-39607a50e164" containerName="istio-proxy"
Aug 05 17:19:07.576770 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.576658    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24e3c44d-e5bc-4b0c-9162-124c7b68df0d" containerName="payload-processing"
Aug 05 17:19:07.576770 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.576668    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="24e3c44d-e5bc-4b0c-9162-124c7b68df0d" containerName="payload-processing"
Aug 05 17:19:07.576770 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.576694    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397bc9b5-a121-469c-bc80-eeebf9fb4a7a" containerName="payload-pre-processing"
Aug 05 17:19:07.576770 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.576703    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="397bc9b5-a121-469c-bc80-eeebf9fb4a7a" containerName="payload-pre-processing"
Aug 05 17:19:07.576770 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.576721    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50300a24-0b19-4103-ac0b-39607a50e164" containerName="istio-proxy"
Aug 05 17:19:07.576770 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.576730    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="50300a24-0b19-4103-ac0b-39607a50e164" containerName="istio-proxy"
Aug 05 17:19:07.577063 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.576809    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="50300a24-0b19-4103-ac0b-39607a50e164" containerName="istio-proxy"
Aug 05 17:19:07.577063 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.576821    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="397bc9b5-a121-469c-bc80-eeebf9fb4a7a" containerName="payload-pre-processing"
Aug 05 17:19:07.577063 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.576835    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="24e3c44d-e5bc-4b0c-9162-124c7b68df0d" containerName="payload-processing"
Aug 05 17:19:07.580041 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.580018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.583213 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.583191    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c15c3d-openshift-default-dockercfg-m74mz\""
Aug 05 17:19:07.591557 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.591495    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"]
Aug 05 17:19:07.612971 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.612946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-istio-envoy\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.613164 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.612991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twl8c\" (UniqueName: \"kubernetes.io/projected/06650891-34d1-4559-9331-8327425fb25d-kube-api-access-twl8c\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.613164 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.613024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06650891-34d1-4559-9331-8327425fb25d-istio-podinfo\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.613164 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.613060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06650891-34d1-4559-9331-8327425fb25d-istiod-ca-cert\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.613357 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.613157    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-workload-socket\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.613357 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.613230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-istio-data\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.613462 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.613341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06650891-34d1-4559-9331-8327425fb25d-istio-token\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.613462 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.613388    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-credential-socket\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.613462 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.613429    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-workload-certs\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.714433 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.714391    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-workload-socket\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.714433 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.714430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-istio-data\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.714708 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.714488    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06650891-34d1-4559-9331-8327425fb25d-istio-token\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.714708 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.714515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-credential-socket\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.714708 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.714550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-workload-certs\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.714708 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.714588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-istio-envoy\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.714708 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.714628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twl8c\" (UniqueName: \"kubernetes.io/projected/06650891-34d1-4559-9331-8327425fb25d-kube-api-access-twl8c\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.714708 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.714660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06650891-34d1-4559-9331-8327425fb25d-istio-podinfo\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.714708 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.714690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06650891-34d1-4559-9331-8327425fb25d-istiod-ca-cert\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.715089 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.714854    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-workload-socket\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.715089 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.714928    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-credential-socket\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.715089 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.715030    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-workload-certs\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.715089 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.715041    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-istio-data\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.715360 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.715345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06650891-34d1-4559-9331-8327425fb25d-istiod-ca-cert\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.717037 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.717004    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-istio-envoy\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.717252 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.717236    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06650891-34d1-4559-9331-8327425fb25d-istio-podinfo\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.723317 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.723290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06650891-34d1-4559-9331-8327425fb25d-istio-token\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.723420 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.723351    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twl8c\" (UniqueName: \"kubernetes.io/projected/06650891-34d1-4559-9331-8327425fb25d-kube-api-access-twl8c\") pod \"e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") " pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:07.891243 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:07.891153    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:08.032958 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:08.032929    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"]
Aug 05 17:19:08.033781 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:19:08.033746    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06650891_34d1_4559_9331_8327425fb25d.slice/crio-349f4ed028606b47d270f00295718359b50bf4b94499984e890b52089653b08f WatchSource:0}: Error finding container 349f4ed028606b47d270f00295718359b50bf4b94499984e890b52089653b08f: Status 404 returned error can't find the container with id 349f4ed028606b47d270f00295718359b50bf4b94499984e890b52089653b08f
Aug 05 17:19:08.036223 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:08.036190    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:08.036337 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:08.036258    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:08.036337 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:08.036290    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:08.969794 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:08.969764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f" event={"ID":"06650891-34d1-4559-9331-8327425fb25d","Type":"ContainerStarted","Data":"a9862900b60f06d6579736eff24839fd46e5c5e0232d749e9e06b409998bdd02"}
Aug 05 17:19:08.970254 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:08.969809    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f" event={"ID":"06650891-34d1-4559-9331-8327425fb25d","Type":"ContainerStarted","Data":"349f4ed028606b47d270f00295718359b50bf4b94499984e890b52089653b08f"}
Aug 05 17:19:09.007209 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:09.007160    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f" podStartSLOduration=2.007145689 podStartE2EDuration="2.007145689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:19:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:19:09.003720262 +0000 UTC m=+2421.585791919" watchObservedRunningTime="2026-08-05 17:19:09.007145689 +0000 UTC m=+2421.589217344"
Aug 05 17:19:09.892164 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:09.892133    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:09.896952 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:09.896930    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:09.974663 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:09.974636    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:09.975516 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:09.975496    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:13.038566 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.038526    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"]
Aug 05 17:19:13.039034 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.038939    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="50300a24-0b19-4103-ac0b-39607a50e164" containerName="istio-proxy"
Aug 05 17:19:13.042080 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.042055    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"
Aug 05 17:19:13.044916 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.044896    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-c15c3d\""
Aug 05 17:19:13.045017 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.044968    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-c15c3d-dockercfg-nqz7c\""
Aug 05 17:19:13.058995 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.058964    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"]
Aug 05 17:19:13.074511 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.074482    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"]
Aug 05 17:19:13.079507 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.079485    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"
Aug 05 17:19:13.094403 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.094381    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"]
Aug 05 17:19:13.166135 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.166081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7kk9\" (UniqueName: \"kubernetes.io/projected/2c195a72-2c93-46eb-89e3-a25a52c1de0d-kube-api-access-f7kk9\") pod \"payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls\" (UID: \"2c195a72-2c93-46eb-89e3-a25a52c1de0d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"
Aug 05 17:19:13.166306 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.166224    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c72f91bb-8cbd-4d8b-b2b1-3d0db185009b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw\" (UID: \"c72f91bb-8cbd-4d8b-b2b1-3d0db185009b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"
Aug 05 17:19:13.166372 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.166307    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c195a72-2c93-46eb-89e3-a25a52c1de0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls\" (UID: \"2c195a72-2c93-46eb-89e3-a25a52c1de0d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"
Aug 05 17:19:13.166372 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.166342    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs9t6\" (UniqueName: \"kubernetes.io/projected/c72f91bb-8cbd-4d8b-b2b1-3d0db185009b-kube-api-access-bs9t6\") pod \"payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw\" (UID: \"c72f91bb-8cbd-4d8b-b2b1-3d0db185009b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"
Aug 05 17:19:13.267238 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.267200    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c72f91bb-8cbd-4d8b-b2b1-3d0db185009b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw\" (UID: \"c72f91bb-8cbd-4d8b-b2b1-3d0db185009b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"
Aug 05 17:19:13.267411 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.267258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c195a72-2c93-46eb-89e3-a25a52c1de0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls\" (UID: \"2c195a72-2c93-46eb-89e3-a25a52c1de0d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"
Aug 05 17:19:13.267411 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.267278    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9t6\" (UniqueName: \"kubernetes.io/projected/c72f91bb-8cbd-4d8b-b2b1-3d0db185009b-kube-api-access-bs9t6\") pod \"payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw\" (UID: \"c72f91bb-8cbd-4d8b-b2b1-3d0db185009b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"
Aug 05 17:19:13.267411 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.267324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7kk9\" (UniqueName: \"kubernetes.io/projected/2c195a72-2c93-46eb-89e3-a25a52c1de0d-kube-api-access-f7kk9\") pod \"payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls\" (UID: \"2c195a72-2c93-46eb-89e3-a25a52c1de0d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"
Aug 05 17:19:13.268156 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.268132    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c195a72-2c93-46eb-89e3-a25a52c1de0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls\" (UID: \"2c195a72-2c93-46eb-89e3-a25a52c1de0d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"
Aug 05 17:19:13.268210 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.268132    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c72f91bb-8cbd-4d8b-b2b1-3d0db185009b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw\" (UID: \"c72f91bb-8cbd-4d8b-b2b1-3d0db185009b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"
Aug 05 17:19:13.277385 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.277362    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs9t6\" (UniqueName: \"kubernetes.io/projected/c72f91bb-8cbd-4d8b-b2b1-3d0db185009b-kube-api-access-bs9t6\") pod \"payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw\" (UID: \"c72f91bb-8cbd-4d8b-b2b1-3d0db185009b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"
Aug 05 17:19:13.277493 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.277402    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7kk9\" (UniqueName: \"kubernetes.io/projected/2c195a72-2c93-46eb-89e3-a25a52c1de0d-kube-api-access-f7kk9\") pod \"payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls\" (UID: \"2c195a72-2c93-46eb-89e3-a25a52c1de0d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"
Aug 05 17:19:13.353138 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.353113    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"
Aug 05 17:19:13.390250 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.390215    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"
Aug 05 17:19:13.514981 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.514944    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"]
Aug 05 17:19:13.515390 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:19:13.515364    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c195a72_2c93_46eb_89e3_a25a52c1de0d.slice/crio-db9cf3b7f16a2b3eec93a11f82f551498be59d7c097ec08cf4dc56cc2d869b89 WatchSource:0}: Error finding container db9cf3b7f16a2b3eec93a11f82f551498be59d7c097ec08cf4dc56cc2d869b89: Status 404 returned error can't find the container with id db9cf3b7f16a2b3eec93a11f82f551498be59d7c097ec08cf4dc56cc2d869b89
Aug 05 17:19:13.763768 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.763745    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"]
Aug 05 17:19:13.765613 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:19:13.765583    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72f91bb_8cbd_4d8b_b2b1_3d0db185009b.slice/crio-c269c15f99463bfb8ae4663b876ce78e52fd7946f02f19f76ca4f8ed3e4999ae WatchSource:0}: Error finding container c269c15f99463bfb8ae4663b876ce78e52fd7946f02f19f76ca4f8ed3e4999ae: Status 404 returned error can't find the container with id c269c15f99463bfb8ae4663b876ce78e52fd7946f02f19f76ca4f8ed3e4999ae
Aug 05 17:19:13.994845 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.994802    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw" event={"ID":"c72f91bb-8cbd-4d8b-b2b1-3d0db185009b","Type":"ContainerStarted","Data":"261299d15dbc868b732aaad82cb9b64eea6155983b26ede4664448e3f8b7536b"}
Aug 05 17:19:13.995031 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.994864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw" event={"ID":"c72f91bb-8cbd-4d8b-b2b1-3d0db185009b","Type":"ContainerStarted","Data":"c269c15f99463bfb8ae4663b876ce78e52fd7946f02f19f76ca4f8ed3e4999ae"}
Aug 05 17:19:13.995031 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.994896    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"
Aug 05 17:19:13.996490 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.996455    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls" event={"ID":"2c195a72-2c93-46eb-89e3-a25a52c1de0d","Type":"ContainerStarted","Data":"f454cb9deda93616291d126b466a5d3191a1bb5f9bb69cd351c676ceeafd439f"}
Aug 05 17:19:13.996596 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.996495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls" event={"ID":"2c195a72-2c93-46eb-89e3-a25a52c1de0d","Type":"ContainerStarted","Data":"db9cf3b7f16a2b3eec93a11f82f551498be59d7c097ec08cf4dc56cc2d869b89"}
Aug 05 17:19:13.996596 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:13.996554    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"
Aug 05 17:19:14.017549 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:14.017471    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw" podStartSLOduration=1.017458604 podStartE2EDuration="1.017458604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:19:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:19:14.015643861 +0000 UTC m=+2426.597715514" watchObservedRunningTime="2026-08-05 17:19:14.017458604 +0000 UTC m=+2426.599530299"
Aug 05 17:19:14.037060 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:14.037000    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls" podStartSLOduration=1.036981276 podStartE2EDuration="1.036981276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:19:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:19:14.036691044 +0000 UTC m=+2426.618762700" watchObservedRunningTime="2026-08-05 17:19:14.036981276 +0000 UTC m=+2426.619052932"
Aug 05 17:19:24.976314 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:24.976275    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Aug 05 17:19:24.976742 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:24.976326    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f" podUID="06650891-34d1-4559-9331-8327425fb25d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Aug 05 17:19:25.003422 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:25.003390    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"
Aug 05 17:19:25.003718 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:25.003699    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"
Aug 05 17:19:25.064270 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:25.064240    2565 generic.go:356] "Generic (PLEG): container finished" podID="06650891-34d1-4559-9331-8327425fb25d" containerID="a9862900b60f06d6579736eff24839fd46e5c5e0232d749e9e06b409998bdd02" exitCode=0
Aug 05 17:19:25.064416 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:25.064289    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f" event={"ID":"06650891-34d1-4559-9331-8327425fb25d","Type":"ContainerDied","Data":"a9862900b60f06d6579736eff24839fd46e5c5e0232d749e9e06b409998bdd02"}
Aug 05 17:19:25.064666 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:25.064650    2565 scope.go:117] "RemoveContainer" containerID="a9862900b60f06d6579736eff24839fd46e5c5e0232d749e9e06b409998bdd02"
Aug 05 17:19:25.065638 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:25.065609    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:25.065734 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:25.065674    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:25.065734 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:25.065703    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:26.071158 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:26.071127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f" event={"ID":"06650891-34d1-4559-9331-8327425fb25d","Type":"ContainerStarted","Data":"b63448da75ce08d27da76c0ed79b4bf4cb9382a77bfd6b3478212e47cb9b51eb"}
Aug 05 17:19:26.891923 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:26.891886    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:26.892170 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:26.892130    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Aug 05 17:19:26.892259 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:26.892188    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f" podUID="06650891-34d1-4559-9331-8327425fb25d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Aug 05 17:19:27.892287 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:27.892250    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Aug 05 17:19:27.892680 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:27.892304    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f" podUID="06650891-34d1-4559-9331-8327425fb25d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Aug 05 17:19:28.892208 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:28.892174    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Aug 05 17:19:28.892400 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:28.892227    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f" podUID="06650891-34d1-4559-9331-8327425fb25d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Aug 05 17:19:29.892491 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:29.892452    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Aug 05 17:19:29.892903 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:29.892533    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f" podUID="06650891-34d1-4559-9331-8327425fb25d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Aug 05 17:19:30.891860 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:30.891823    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Aug 05 17:19:30.892029 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:30.891893    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f" podUID="06650891-34d1-4559-9331-8327425fb25d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Aug 05 17:19:31.896263 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:31.896230    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:31.896677 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:31.896512    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:31.897064 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:31.897046    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:19:36.688112 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.688066    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"]
Aug 05 17:19:36.691699 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.691679    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.694562 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.694543    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-161ce7-openshift-default-dockercfg-krd4z\""
Aug 05 17:19:36.704130 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.704083    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"]
Aug 05 17:19:36.886664 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.886636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-token\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.886834 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.886669    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-workload-socket\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.886834 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.886782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbsrm\" (UniqueName: \"kubernetes.io/projected/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-kube-api-access-sbsrm\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.886834 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.886813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-data\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.886946 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.886843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-podinfo\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.886946 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.886903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-credential-socket\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.886946 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.886933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-workload-certs\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.887085 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.886955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istiod-ca-cert\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.887085 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.886975    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-envoy\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.987846 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.987770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-credential-socket\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.987846 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.987804    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-workload-certs\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.987846 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.987822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istiod-ca-cert\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.988064 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.988015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-envoy\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.988151 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.988068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-token\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.988151 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.988119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-workload-socket\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.988261 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.988236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbsrm\" (UniqueName: \"kubernetes.io/projected/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-kube-api-access-sbsrm\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.988317 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.988269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-data\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.988317 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.988287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-workload-certs\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.988317 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.988304    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-podinfo\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.988551 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.988528    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-workload-socket\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.988631 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.988602    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istiod-ca-cert\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.988631 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.988618    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-data\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.988751 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.988633    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-credential-socket\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.990328 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.990301    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-envoy\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.990594 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.990578    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-podinfo\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.997156 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.997134    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-token\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:36.997289 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:36.997220    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbsrm\" (UniqueName: \"kubernetes.io/projected/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-kube-api-access-sbsrm\") pod \"e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") " pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:37.003061 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:37.003042    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:37.144191 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:37.144168    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"]
Aug 05 17:19:37.145979 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:19:37.145953    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a6b3d3_ca7c_4c5a_a6cc_a12816a12add.slice/crio-f98a71aa5a684a8e3d195c4c49d769df7325f0d711585f0c986a88df07aec62a WatchSource:0}: Error finding container f98a71aa5a684a8e3d195c4c49d769df7325f0d711585f0c986a88df07aec62a: Status 404 returned error can't find the container with id f98a71aa5a684a8e3d195c4c49d769df7325f0d711585f0c986a88df07aec62a
Aug 05 17:19:37.148262 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:37.148230    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:37.148398 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:37.148297    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:37.148398 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:37.148330    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:38.135655 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:38.135621    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn" event={"ID":"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add","Type":"ContainerStarted","Data":"23e58a8187efb4b11464f0ca494bd8713593f92d0e202ae5a1213c2cd9b7d6a3"}
Aug 05 17:19:38.136043 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:38.135688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn" event={"ID":"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add","Type":"ContainerStarted","Data":"f98a71aa5a684a8e3d195c4c49d769df7325f0d711585f0c986a88df07aec62a"}
Aug 05 17:19:38.159250 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:38.159203    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn" podStartSLOduration=2.15918919 podStartE2EDuration="2.15918919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:19:38.157609788 +0000 UTC m=+2450.739681475" watchObservedRunningTime="2026-08-05 17:19:38.15918919 +0000 UTC m=+2450.741260846"
Aug 05 17:19:39.003434 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:39.003396    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:39.008302 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:39.008280    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:39.141368 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:39.141336    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:39.142345 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:39.142326    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:42.245690 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:42.245654    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"]
Aug 05 17:19:42.249195 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:42.249176    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"
Aug 05 17:19:42.252063 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:42.252043    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-161ce7-dockercfg-d9wrm\""
Aug 05 17:19:42.252165 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:42.252070    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-161ce7\""
Aug 05 17:19:42.269346 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:42.269323    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"]
Aug 05 17:19:42.328431 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:42.328384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3a99b0c-c5e0-42cb-83ec-39dde11ac25a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg\" (UID: \"d3a99b0c-c5e0-42cb-83ec-39dde11ac25a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"
Aug 05 17:19:42.328705 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:42.328679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kl89\" (UniqueName: \"kubernetes.io/projected/d3a99b0c-c5e0-42cb-83ec-39dde11ac25a-kube-api-access-7kl89\") pod \"payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg\" (UID: \"d3a99b0c-c5e0-42cb-83ec-39dde11ac25a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"
Aug 05 17:19:42.429246 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:42.429218    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kl89\" (UniqueName: \"kubernetes.io/projected/d3a99b0c-c5e0-42cb-83ec-39dde11ac25a-kube-api-access-7kl89\") pod \"payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg\" (UID: \"d3a99b0c-c5e0-42cb-83ec-39dde11ac25a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"
Aug 05 17:19:42.429412 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:42.429319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3a99b0c-c5e0-42cb-83ec-39dde11ac25a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg\" (UID: \"d3a99b0c-c5e0-42cb-83ec-39dde11ac25a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"
Aug 05 17:19:42.429980 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:42.429962    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3a99b0c-c5e0-42cb-83ec-39dde11ac25a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg\" (UID: \"d3a99b0c-c5e0-42cb-83ec-39dde11ac25a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"
Aug 05 17:19:42.452952 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:42.452927    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kl89\" (UniqueName: \"kubernetes.io/projected/d3a99b0c-c5e0-42cb-83ec-39dde11ac25a-kube-api-access-7kl89\") pod \"payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg\" (UID: \"d3a99b0c-c5e0-42cb-83ec-39dde11ac25a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"
Aug 05 17:19:42.559236 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:42.559203    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"
Aug 05 17:19:42.904174 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:42.904150    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"]
Aug 05 17:19:42.905665 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:19:42.905635    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3a99b0c_c5e0_42cb_83ec_39dde11ac25a.slice/crio-a45b71c6ae8a31a883897af87a93401cc46c4ca2feade68e2024a8fa4474ab72 WatchSource:0}: Error finding container a45b71c6ae8a31a883897af87a93401cc46c4ca2feade68e2024a8fa4474ab72: Status 404 returned error can't find the container with id a45b71c6ae8a31a883897af87a93401cc46c4ca2feade68e2024a8fa4474ab72
Aug 05 17:19:43.164701 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:43.164605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg" event={"ID":"d3a99b0c-c5e0-42cb-83ec-39dde11ac25a","Type":"ContainerStarted","Data":"8a2415bfee19d4e928cf598c2e7c0016cbcecd4497e5294fce9d7d46c474b60b"}
Aug 05 17:19:43.164701 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:43.164684    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"
Aug 05 17:19:43.164879 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:43.164711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg" event={"ID":"d3a99b0c-c5e0-42cb-83ec-39dde11ac25a","Type":"ContainerStarted","Data":"a45b71c6ae8a31a883897af87a93401cc46c4ca2feade68e2024a8fa4474ab72"}
Aug 05 17:19:43.184888 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:43.184840    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg" podStartSLOduration=1.184824404 podStartE2EDuration="1.184824404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:19:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:19:43.184045657 +0000 UTC m=+2455.766117313" watchObservedRunningTime="2026-08-05 17:19:43.184824404 +0000 UTC m=+2455.766896060"
Aug 05 17:19:54.142801 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:54.142761    2565 patch_prober.go:28] interesting pod/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Aug 05 17:19:54.143222 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:54.142833    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn" podUID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Aug 05 17:19:54.171572 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:54.171541    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"
Aug 05 17:19:54.228765 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:54.228678    2565 generic.go:356] "Generic (PLEG): container finished" podID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerID="23e58a8187efb4b11464f0ca494bd8713593f92d0e202ae5a1213c2cd9b7d6a3" exitCode=0
Aug 05 17:19:54.228765 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:54.228748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn" event={"ID":"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add","Type":"ContainerDied","Data":"23e58a8187efb4b11464f0ca494bd8713593f92d0e202ae5a1213c2cd9b7d6a3"}
Aug 05 17:19:54.229174 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:54.229160    2565 scope.go:117] "RemoveContainer" containerID="23e58a8187efb4b11464f0ca494bd8713593f92d0e202ae5a1213c2cd9b7d6a3"
Aug 05 17:19:54.230309 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:54.230276    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:54.230391 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:54.230348    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:54.230391 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:54.230381    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:19:55.238587 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:55.238550    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn" event={"ID":"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add","Type":"ContainerStarted","Data":"5ba139cb00b0e5ce2768f0e453f970af09d148f07d4fa590e8d458a03da41018"}
Aug 05 17:19:56.003201 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:56.003165    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:19:56.003446 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:56.003423    2565 patch_prober.go:28] interesting pod/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Aug 05 17:19:56.003499 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:56.003475    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn" podUID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Aug 05 17:19:57.003932 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:57.003893    2565 patch_prober.go:28] interesting pod/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Aug 05 17:19:57.004372 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:57.003952    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn" podUID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Aug 05 17:19:58.004435 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:58.004401    2565 patch_prober.go:28] interesting pod/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Aug 05 17:19:58.004795 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:58.004454    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn" podUID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Aug 05 17:19:59.003786 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:59.003750    2565 patch_prober.go:28] interesting pod/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Aug 05 17:19:59.003968 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:19:59.003802    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn" podUID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Aug 05 17:20:00.003897 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:00.003863    2565 patch_prober.go:28] interesting pod/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Aug 05 17:20:00.004313 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:00.003917    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn" podUID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Aug 05 17:20:01.007884 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:01.007852    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:20:01.008296 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:01.008082    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:20:01.008796 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:01.008780    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:20:32.313423 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.313385    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"]
Aug 05 17:20:32.316988 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.316968    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.320958 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.320927    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-161ce7\"/\"test-model-161ce7-kserve-self-signed-certs\""
Aug 05 17:20:32.321063 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.321001    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-161ce7\"/\"default-dockercfg-ftrp9\""
Aug 05 17:20:32.321149 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.321067    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-161ce7\"/\"openshift-service-ca.crt\""
Aug 05 17:20:32.321149 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.321116    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-161ce7\"/\"kube-root-ca.crt\""
Aug 05 17:20:32.334421 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.334397    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"]
Aug 05 17:20:32.465735 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.465705    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n5dr\" (UniqueName: \"kubernetes.io/projected/f4225c59-e114-4fdc-a11e-7b148affef73-kube-api-access-7n5dr\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.465735 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.465743    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4225c59-e114-4fdc-a11e-7b148affef73-tls-certs\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.465980 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.465827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-tmp-dir\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.465980 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.465874    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-home\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.465980 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.465933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-dshm\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.465980 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.465964    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-model-cache\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.566898 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.566814    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4225c59-e114-4fdc-a11e-7b148affef73-tls-certs\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.566898 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.566888    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-tmp-dir\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.567134 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.566921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-home\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.567134 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.566973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-dshm\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.567134 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.567007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-model-cache\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.567134 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.567038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n5dr\" (UniqueName: \"kubernetes.io/projected/f4225c59-e114-4fdc-a11e-7b148affef73-kube-api-access-7n5dr\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.567410 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.567333    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-tmp-dir\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.567456 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.567412    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-model-cache\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.567456 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.567438    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-home\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.569287 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.569267    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-dshm\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.569454 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.569437    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4225c59-e114-4fdc-a11e-7b148affef73-tls-certs\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.575693 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.575673    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n5dr\" (UniqueName: \"kubernetes.io/projected/f4225c59-e114-4fdc-a11e-7b148affef73-kube-api-access-7n5dr\") pod \"test-model-161ce7-kserve-cc79ccdf9-fjpqw\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") " pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.625983 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.625962    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:32.770648 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:32.770621    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"]
Aug 05 17:20:32.773379 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:20:32.773348    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4225c59_e114_4fdc_a11e_7b148affef73.slice/crio-18e866349ad900b649cd3b3c7526ff6a50e95d072dc44ed7ae32e183cd54e28f WatchSource:0}: Error finding container 18e866349ad900b649cd3b3c7526ff6a50e95d072dc44ed7ae32e183cd54e28f: Status 404 returned error can't find the container with id 18e866349ad900b649cd3b3c7526ff6a50e95d072dc44ed7ae32e183cd54e28f
Aug 05 17:20:33.464496 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:33.464457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw" event={"ID":"f4225c59-e114-4fdc-a11e-7b148affef73","Type":"ContainerStarted","Data":"896a947c530f824d279af1d9fdf28437af05aea6367e6912506f7c63e43962a9"}
Aug 05 17:20:33.464496 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:33.464500    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw" event={"ID":"f4225c59-e114-4fdc-a11e-7b148affef73","Type":"ContainerStarted","Data":"18e866349ad900b649cd3b3c7526ff6a50e95d072dc44ed7ae32e183cd54e28f"}
Aug 05 17:20:33.486518 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:33.486469    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw" podStartSLOduration=1.48645417 podStartE2EDuration="1.48645417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:20:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:20:33.482587231 +0000 UTC m=+2506.064658886" watchObservedRunningTime="2026-08-05 17:20:33.48645417 +0000 UTC m=+2506.068525825"
Aug 05 17:20:42.626702 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:42.626617    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:42.626702 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:42.626660    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:42.639250 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:42.639224    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:20:43.529388 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:20:43.529357    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:21:20.621982 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:20.621946    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"]
Aug 05 17:21:25.145087 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.145052    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"]
Aug 05 17:21:25.145523 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.145322    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw" podUID="c72f91bb-8cbd-4d8b-b2b1-3d0db185009b" containerName="payload-processing" containerID="cri-o://261299d15dbc868b732aaad82cb9b64eea6155983b26ede4664448e3f8b7536b" gracePeriod=30
Aug 05 17:21:25.171473 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.171447    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"]
Aug 05 17:21:25.171704 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.171661    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls" podUID="2c195a72-2c93-46eb-89e3-a25a52c1de0d" containerName="payload-pre-processing" containerID="cri-o://f454cb9deda93616291d126b466a5d3191a1bb5f9bb69cd351c676ceeafd439f" gracePeriod=30
Aug 05 17:21:25.475255 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.475234    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"
Aug 05 17:21:25.478087 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.478070    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"
Aug 05 17:21:25.635728 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.635693    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7kk9\" (UniqueName: \"kubernetes.io/projected/2c195a72-2c93-46eb-89e3-a25a52c1de0d-kube-api-access-f7kk9\") pod \"2c195a72-2c93-46eb-89e3-a25a52c1de0d\" (UID: \"2c195a72-2c93-46eb-89e3-a25a52c1de0d\") "
Aug 05 17:21:25.635893 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.635777    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c72f91bb-8cbd-4d8b-b2b1-3d0db185009b-plugins-config-volume\") pod \"c72f91bb-8cbd-4d8b-b2b1-3d0db185009b\" (UID: \"c72f91bb-8cbd-4d8b-b2b1-3d0db185009b\") "
Aug 05 17:21:25.635893 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.635882    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c195a72-2c93-46eb-89e3-a25a52c1de0d-plugins-config-volume\") pod \"2c195a72-2c93-46eb-89e3-a25a52c1de0d\" (UID: \"2c195a72-2c93-46eb-89e3-a25a52c1de0d\") "
Aug 05 17:21:25.636026 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.636009    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs9t6\" (UniqueName: \"kubernetes.io/projected/c72f91bb-8cbd-4d8b-b2b1-3d0db185009b-kube-api-access-bs9t6\") pod \"c72f91bb-8cbd-4d8b-b2b1-3d0db185009b\" (UID: \"c72f91bb-8cbd-4d8b-b2b1-3d0db185009b\") "
Aug 05 17:21:25.636213 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.636181    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c72f91bb-8cbd-4d8b-b2b1-3d0db185009b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c72f91bb-8cbd-4d8b-b2b1-3d0db185009b" (UID: "c72f91bb-8cbd-4d8b-b2b1-3d0db185009b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:25.636333 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.636249    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c195a72-2c93-46eb-89e3-a25a52c1de0d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2c195a72-2c93-46eb-89e3-a25a52c1de0d" (UID: "2c195a72-2c93-46eb-89e3-a25a52c1de0d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:25.636409 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.636361    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c72f91bb-8cbd-4d8b-b2b1-3d0db185009b-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:25.636409 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.636377    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c195a72-2c93-46eb-89e3-a25a52c1de0d-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:25.637851 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.637826    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c195a72-2c93-46eb-89e3-a25a52c1de0d-kube-api-access-f7kk9" (OuterVolumeSpecName: "kube-api-access-f7kk9") pod "2c195a72-2c93-46eb-89e3-a25a52c1de0d" (UID: "2c195a72-2c93-46eb-89e3-a25a52c1de0d"). InnerVolumeSpecName "kube-api-access-f7kk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:25.638046 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.638031    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c72f91bb-8cbd-4d8b-b2b1-3d0db185009b-kube-api-access-bs9t6" (OuterVolumeSpecName: "kube-api-access-bs9t6") pod "c72f91bb-8cbd-4d8b-b2b1-3d0db185009b" (UID: "c72f91bb-8cbd-4d8b-b2b1-3d0db185009b"). InnerVolumeSpecName "kube-api-access-bs9t6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:25.737059 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.736993    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs9t6\" (UniqueName: \"kubernetes.io/projected/c72f91bb-8cbd-4d8b-b2b1-3d0db185009b-kube-api-access-bs9t6\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:25.737059 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.737020    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7kk9\" (UniqueName: \"kubernetes.io/projected/2c195a72-2c93-46eb-89e3-a25a52c1de0d-kube-api-access-f7kk9\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:25.757987 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.757953    2565 generic.go:356] "Generic (PLEG): container finished" podID="2c195a72-2c93-46eb-89e3-a25a52c1de0d" containerID="f454cb9deda93616291d126b466a5d3191a1bb5f9bb69cd351c676ceeafd439f" exitCode=0
Aug 05 17:21:25.758130 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.757997    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"
Aug 05 17:21:25.758130 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.758044    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls" event={"ID":"2c195a72-2c93-46eb-89e3-a25a52c1de0d","Type":"ContainerDied","Data":"f454cb9deda93616291d126b466a5d3191a1bb5f9bb69cd351c676ceeafd439f"}
Aug 05 17:21:25.758130 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.758117    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls" event={"ID":"2c195a72-2c93-46eb-89e3-a25a52c1de0d","Type":"ContainerDied","Data":"db9cf3b7f16a2b3eec93a11f82f551498be59d7c097ec08cf4dc56cc2d869b89"}
Aug 05 17:21:25.758301 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.758151    2565 scope.go:117] "RemoveContainer" containerID="f454cb9deda93616291d126b466a5d3191a1bb5f9bb69cd351c676ceeafd439f"
Aug 05 17:21:25.759573 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.759541    2565 generic.go:356] "Generic (PLEG): container finished" podID="c72f91bb-8cbd-4d8b-b2b1-3d0db185009b" containerID="261299d15dbc868b732aaad82cb9b64eea6155983b26ede4664448e3f8b7536b" exitCode=0
Aug 05 17:21:25.759676 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.759586    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw" event={"ID":"c72f91bb-8cbd-4d8b-b2b1-3d0db185009b","Type":"ContainerDied","Data":"261299d15dbc868b732aaad82cb9b64eea6155983b26ede4664448e3f8b7536b"}
Aug 05 17:21:25.759676 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.759631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw" event={"ID":"c72f91bb-8cbd-4d8b-b2b1-3d0db185009b","Type":"ContainerDied","Data":"c269c15f99463bfb8ae4663b876ce78e52fd7946f02f19f76ca4f8ed3e4999ae"}
Aug 05 17:21:25.759676 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.759589    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"
Aug 05 17:21:25.768444 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.768428    2565 scope.go:117] "RemoveContainer" containerID="f454cb9deda93616291d126b466a5d3191a1bb5f9bb69cd351c676ceeafd439f"
Aug 05 17:21:25.768795 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:21:25.768759    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f454cb9deda93616291d126b466a5d3191a1bb5f9bb69cd351c676ceeafd439f\": container with ID starting with f454cb9deda93616291d126b466a5d3191a1bb5f9bb69cd351c676ceeafd439f not found: ID does not exist" containerID="f454cb9deda93616291d126b466a5d3191a1bb5f9bb69cd351c676ceeafd439f"
Aug 05 17:21:25.768901 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.768803    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f454cb9deda93616291d126b466a5d3191a1bb5f9bb69cd351c676ceeafd439f"} err="failed to get container status \"f454cb9deda93616291d126b466a5d3191a1bb5f9bb69cd351c676ceeafd439f\": rpc error: code = NotFound desc = could not find container \"f454cb9deda93616291d126b466a5d3191a1bb5f9bb69cd351c676ceeafd439f\": container with ID starting with f454cb9deda93616291d126b466a5d3191a1bb5f9bb69cd351c676ceeafd439f not found: ID does not exist"
Aug 05 17:21:25.768901 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.768832    2565 scope.go:117] "RemoveContainer" containerID="261299d15dbc868b732aaad82cb9b64eea6155983b26ede4664448e3f8b7536b"
Aug 05 17:21:25.776777 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.776762    2565 scope.go:117] "RemoveContainer" containerID="261299d15dbc868b732aaad82cb9b64eea6155983b26ede4664448e3f8b7536b"
Aug 05 17:21:25.777031 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:21:25.777013    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"261299d15dbc868b732aaad82cb9b64eea6155983b26ede4664448e3f8b7536b\": container with ID starting with 261299d15dbc868b732aaad82cb9b64eea6155983b26ede4664448e3f8b7536b not found: ID does not exist" containerID="261299d15dbc868b732aaad82cb9b64eea6155983b26ede4664448e3f8b7536b"
Aug 05 17:21:25.777078 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.777039    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"261299d15dbc868b732aaad82cb9b64eea6155983b26ede4664448e3f8b7536b"} err="failed to get container status \"261299d15dbc868b732aaad82cb9b64eea6155983b26ede4664448e3f8b7536b\": rpc error: code = NotFound desc = could not find container \"261299d15dbc868b732aaad82cb9b64eea6155983b26ede4664448e3f8b7536b\": container with ID starting with 261299d15dbc868b732aaad82cb9b64eea6155983b26ede4664448e3f8b7536b not found: ID does not exist"
Aug 05 17:21:25.798532 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.798502    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"]
Aug 05 17:21:25.816668 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.816638    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c15c3d-ff9ffb5d8-k8dls"]
Aug 05 17:21:25.841479 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.841456    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"]
Aug 05 17:21:25.845252 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.845232    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c15c3d-965c6b8d-q8wtw"]
Aug 05 17:21:25.958121 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.954050    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c195a72-2c93-46eb-89e3-a25a52c1de0d" path="/var/lib/kubelet/pods/2c195a72-2c93-46eb-89e3-a25a52c1de0d/volumes"
Aug 05 17:21:25.958121 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:25.954672    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c72f91bb-8cbd-4d8b-b2b1-3d0db185009b" path="/var/lib/kubelet/pods/c72f91bb-8cbd-4d8b-b2b1-3d0db185009b/volumes"
Aug 05 17:21:35.641259 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.641213    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw" podUID="f4225c59-e114-4fdc-a11e-7b148affef73" containerName="main" containerID="cri-o://896a947c530f824d279af1d9fdf28437af05aea6367e6912506f7c63e43962a9" gracePeriod=45
Aug 05 17:21:35.817985 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.817953    2565 generic.go:356] "Generic (PLEG): container finished" podID="f4225c59-e114-4fdc-a11e-7b148affef73" containerID="896a947c530f824d279af1d9fdf28437af05aea6367e6912506f7c63e43962a9" exitCode=0
Aug 05 17:21:35.818171 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.818079    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw" event={"ID":"f4225c59-e114-4fdc-a11e-7b148affef73","Type":"ContainerDied","Data":"896a947c530f824d279af1d9fdf28437af05aea6367e6912506f7c63e43962a9"}
Aug 05 17:21:35.887362 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.887338    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:21:35.930387 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.930322    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4225c59-e114-4fdc-a11e-7b148affef73-tls-certs\") pod \"f4225c59-e114-4fdc-a11e-7b148affef73\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") "
Aug 05 17:21:35.930387 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.930377    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-home\") pod \"f4225c59-e114-4fdc-a11e-7b148affef73\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") "
Aug 05 17:21:35.930580 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.930415    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-tmp-dir\") pod \"f4225c59-e114-4fdc-a11e-7b148affef73\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") "
Aug 05 17:21:35.930580 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.930436    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-dshm\") pod \"f4225c59-e114-4fdc-a11e-7b148affef73\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") "
Aug 05 17:21:35.930580 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.930469    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-model-cache\") pod \"f4225c59-e114-4fdc-a11e-7b148affef73\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") "
Aug 05 17:21:35.930580 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.930492    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n5dr\" (UniqueName: \"kubernetes.io/projected/f4225c59-e114-4fdc-a11e-7b148affef73-kube-api-access-7n5dr\") pod \"f4225c59-e114-4fdc-a11e-7b148affef73\" (UID: \"f4225c59-e114-4fdc-a11e-7b148affef73\") "
Aug 05 17:21:35.930792 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.930708    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-home" (OuterVolumeSpecName: "home") pod "f4225c59-e114-4fdc-a11e-7b148affef73" (UID: "f4225c59-e114-4fdc-a11e-7b148affef73"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:21:35.930792 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.930761    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f4225c59-e114-4fdc-a11e-7b148affef73" (UID: "f4225c59-e114-4fdc-a11e-7b148affef73"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:21:35.930897 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.930781    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-model-cache" (OuterVolumeSpecName: "model-cache") pod "f4225c59-e114-4fdc-a11e-7b148affef73" (UID: "f4225c59-e114-4fdc-a11e-7b148affef73"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:21:35.930953 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.930894    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-home\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:35.930953 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.930913    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-tmp-dir\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:35.930953 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.930929    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-model-cache\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:35.932602 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.932571    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4225c59-e114-4fdc-a11e-7b148affef73-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f4225c59-e114-4fdc-a11e-7b148affef73" (UID: "f4225c59-e114-4fdc-a11e-7b148affef73"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:21:35.932702 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.932675    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4225c59-e114-4fdc-a11e-7b148affef73-kube-api-access-7n5dr" (OuterVolumeSpecName: "kube-api-access-7n5dr") pod "f4225c59-e114-4fdc-a11e-7b148affef73" (UID: "f4225c59-e114-4fdc-a11e-7b148affef73"). InnerVolumeSpecName "kube-api-access-7n5dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:35.932901 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:35.932886    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-dshm" (OuterVolumeSpecName: "dshm") pod "f4225c59-e114-4fdc-a11e-7b148affef73" (UID: "f4225c59-e114-4fdc-a11e-7b148affef73"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:21:36.031519 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:36.031492    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4225c59-e114-4fdc-a11e-7b148affef73-tls-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:36.031519 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:36.031519    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4225c59-e114-4fdc-a11e-7b148affef73-dshm\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:36.031696 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:36.031532    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n5dr\" (UniqueName: \"kubernetes.io/projected/f4225c59-e114-4fdc-a11e-7b148affef73-kube-api-access-7n5dr\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:36.824824 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:36.824795    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"
Aug 05 17:21:36.824824 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:36.824816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw" event={"ID":"f4225c59-e114-4fdc-a11e-7b148affef73","Type":"ContainerDied","Data":"18e866349ad900b649cd3b3c7526ff6a50e95d072dc44ed7ae32e183cd54e28f"}
Aug 05 17:21:36.825368 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:36.824862    2565 scope.go:117] "RemoveContainer" containerID="896a947c530f824d279af1d9fdf28437af05aea6367e6912506f7c63e43962a9"
Aug 05 17:21:36.847475 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:36.847453    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"]
Aug 05 17:21:36.849605 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:36.849586    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-161ce7/test-model-161ce7-kserve-cc79ccdf9-fjpqw"]
Aug 05 17:21:37.953730 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:37.953695    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4225c59-e114-4fdc-a11e-7b148affef73" path="/var/lib/kubelet/pods/f4225c59-e114-4fdc-a11e-7b148affef73/volumes"
Aug 05 17:21:37.993621 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:37.993591    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"]
Aug 05 17:21:37.993863 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:37.993838    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f" podUID="06650891-34d1-4559-9331-8327425fb25d" containerName="istio-proxy" containerID="cri-o://b63448da75ce08d27da76c0ed79b4bf4cb9382a77bfd6b3478212e47cb9b51eb" gracePeriod=30
Aug 05 17:21:43.259183 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.259126    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:21:43.297362 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.297332    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-credential-socket\") pod \"06650891-34d1-4559-9331-8327425fb25d\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") "
Aug 05 17:21:43.297515 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.297402    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06650891-34d1-4559-9331-8327425fb25d-istio-podinfo\") pod \"06650891-34d1-4559-9331-8327425fb25d\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") "
Aug 05 17:21:43.297515 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.297446    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-istio-envoy\") pod \"06650891-34d1-4559-9331-8327425fb25d\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") "
Aug 05 17:21:43.297515 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.297464    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06650891-34d1-4559-9331-8327425fb25d-istiod-ca-cert\") pod \"06650891-34d1-4559-9331-8327425fb25d\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") "
Aug 05 17:21:43.297515 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.297479    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-workload-certs\") pod \"06650891-34d1-4559-9331-8327425fb25d\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") "
Aug 05 17:21:43.297744 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.297519    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06650891-34d1-4559-9331-8327425fb25d-istio-token\") pod \"06650891-34d1-4559-9331-8327425fb25d\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") "
Aug 05 17:21:43.297744 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.297618    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "06650891-34d1-4559-9331-8327425fb25d" (UID: "06650891-34d1-4559-9331-8327425fb25d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:21:43.297744 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.297652    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-istio-data\") pod \"06650891-34d1-4559-9331-8327425fb25d\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") "
Aug 05 17:21:43.297744 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.297683    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-workload-socket\") pod \"06650891-34d1-4559-9331-8327425fb25d\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") "
Aug 05 17:21:43.297952 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.297751    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twl8c\" (UniqueName: \"kubernetes.io/projected/06650891-34d1-4559-9331-8327425fb25d-kube-api-access-twl8c\") pod \"06650891-34d1-4559-9331-8327425fb25d\" (UID: \"06650891-34d1-4559-9331-8327425fb25d\") "
Aug 05 17:21:43.297952 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.297836    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "06650891-34d1-4559-9331-8327425fb25d" (UID: "06650891-34d1-4559-9331-8327425fb25d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:21:43.297952 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.297914    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-istio-data" (OuterVolumeSpecName: "istio-data") pod "06650891-34d1-4559-9331-8327425fb25d" (UID: "06650891-34d1-4559-9331-8327425fb25d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:21:43.298087 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.297995    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "06650891-34d1-4559-9331-8327425fb25d" (UID: "06650891-34d1-4559-9331-8327425fb25d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:21:43.298215 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.298190    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-credential-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:43.298215 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.298218    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-workload-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:43.298402 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.298232    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-istio-data\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:43.298402 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.298244    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-workload-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:43.298518 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.298414    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06650891-34d1-4559-9331-8327425fb25d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "06650891-34d1-4559-9331-8327425fb25d" (UID: "06650891-34d1-4559-9331-8327425fb25d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:43.299798 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.299769    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "06650891-34d1-4559-9331-8327425fb25d" (UID: "06650891-34d1-4559-9331-8327425fb25d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:21:43.299896 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.299832    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/06650891-34d1-4559-9331-8327425fb25d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "06650891-34d1-4559-9331-8327425fb25d" (UID: "06650891-34d1-4559-9331-8327425fb25d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:21:43.299949 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.299925    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06650891-34d1-4559-9331-8327425fb25d-istio-token" (OuterVolumeSpecName: "istio-token") pod "06650891-34d1-4559-9331-8327425fb25d" (UID: "06650891-34d1-4559-9331-8327425fb25d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:43.300268 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.300253    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06650891-34d1-4559-9331-8327425fb25d-kube-api-access-twl8c" (OuterVolumeSpecName: "kube-api-access-twl8c") pod "06650891-34d1-4559-9331-8327425fb25d" (UID: "06650891-34d1-4559-9331-8327425fb25d"). InnerVolumeSpecName "kube-api-access-twl8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:43.398898 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.398867    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06650891-34d1-4559-9331-8327425fb25d-istio-envoy\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:43.398898 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.398892    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06650891-34d1-4559-9331-8327425fb25d-istiod-ca-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:43.398898 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.398901    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06650891-34d1-4559-9331-8327425fb25d-istio-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:43.399166 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.398909    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twl8c\" (UniqueName: \"kubernetes.io/projected/06650891-34d1-4559-9331-8327425fb25d-kube-api-access-twl8c\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:43.399166 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.398918    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06650891-34d1-4559-9331-8327425fb25d-istio-podinfo\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:43.865741 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.865704    2565 generic.go:356] "Generic (PLEG): container finished" podID="06650891-34d1-4559-9331-8327425fb25d" containerID="b63448da75ce08d27da76c0ed79b4bf4cb9382a77bfd6b3478212e47cb9b51eb" exitCode=0
Aug 05 17:21:43.865947 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.865755    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"
Aug 05 17:21:43.865947 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.865792    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f" event={"ID":"06650891-34d1-4559-9331-8327425fb25d","Type":"ContainerDied","Data":"b63448da75ce08d27da76c0ed79b4bf4cb9382a77bfd6b3478212e47cb9b51eb"}
Aug 05 17:21:43.865947 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.865860    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f" event={"ID":"06650891-34d1-4559-9331-8327425fb25d","Type":"ContainerDied","Data":"349f4ed028606b47d270f00295718359b50bf4b94499984e890b52089653b08f"}
Aug 05 17:21:43.865947 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.865891    2565 scope.go:117] "RemoveContainer" containerID="b63448da75ce08d27da76c0ed79b4bf4cb9382a77bfd6b3478212e47cb9b51eb"
Aug 05 17:21:43.875233 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.875216    2565 scope.go:117] "RemoveContainer" containerID="a9862900b60f06d6579736eff24839fd46e5c5e0232d749e9e06b409998bdd02"
Aug 05 17:21:43.882911 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.882893    2565 scope.go:117] "RemoveContainer" containerID="b63448da75ce08d27da76c0ed79b4bf4cb9382a77bfd6b3478212e47cb9b51eb"
Aug 05 17:21:43.883154 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:21:43.883135    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b63448da75ce08d27da76c0ed79b4bf4cb9382a77bfd6b3478212e47cb9b51eb\": container with ID starting with b63448da75ce08d27da76c0ed79b4bf4cb9382a77bfd6b3478212e47cb9b51eb not found: ID does not exist" containerID="b63448da75ce08d27da76c0ed79b4bf4cb9382a77bfd6b3478212e47cb9b51eb"
Aug 05 17:21:43.883206 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.883161    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63448da75ce08d27da76c0ed79b4bf4cb9382a77bfd6b3478212e47cb9b51eb"} err="failed to get container status \"b63448da75ce08d27da76c0ed79b4bf4cb9382a77bfd6b3478212e47cb9b51eb\": rpc error: code = NotFound desc = could not find container \"b63448da75ce08d27da76c0ed79b4bf4cb9382a77bfd6b3478212e47cb9b51eb\": container with ID starting with b63448da75ce08d27da76c0ed79b4bf4cb9382a77bfd6b3478212e47cb9b51eb not found: ID does not exist"
Aug 05 17:21:43.883206 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.883180    2565 scope.go:117] "RemoveContainer" containerID="a9862900b60f06d6579736eff24839fd46e5c5e0232d749e9e06b409998bdd02"
Aug 05 17:21:43.883424 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:21:43.883409    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9862900b60f06d6579736eff24839fd46e5c5e0232d749e9e06b409998bdd02\": container with ID starting with a9862900b60f06d6579736eff24839fd46e5c5e0232d749e9e06b409998bdd02 not found: ID does not exist" containerID="a9862900b60f06d6579736eff24839fd46e5c5e0232d749e9e06b409998bdd02"
Aug 05 17:21:43.883484 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.883427    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9862900b60f06d6579736eff24839fd46e5c5e0232d749e9e06b409998bdd02"} err="failed to get container status \"a9862900b60f06d6579736eff24839fd46e5c5e0232d749e9e06b409998bdd02\": rpc error: code = NotFound desc = could not find container \"a9862900b60f06d6579736eff24839fd46e5c5e0232d749e9e06b409998bdd02\": container with ID starting with a9862900b60f06d6579736eff24839fd46e5c5e0232d749e9e06b409998bdd02 not found: ID does not exist"
Aug 05 17:21:43.900796 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.900776    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"]
Aug 05 17:21:43.906999 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.906978    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c15c3d-openshift-default-6695c9fd7b-bvq5f"]
Aug 05 17:21:43.952976 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:43.952948    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06650891-34d1-4559-9331-8327425fb25d" path="/var/lib/kubelet/pods/06650891-34d1-4559-9331-8327425fb25d/volumes"
Aug 05 17:21:49.073055 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.073019    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"]
Aug 05 17:21:49.073921 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.073850    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg" podUID="d3a99b0c-c5e0-42cb-83ec-39dde11ac25a" containerName="payload-pre-processing" containerID="cri-o://8a2415bfee19d4e928cf598c2e7c0016cbcecd4497e5294fce9d7d46c474b60b" gracePeriod=30
Aug 05 17:21:49.338539 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.338514    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"
Aug 05 17:21:49.451188 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.451156    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3a99b0c-c5e0-42cb-83ec-39dde11ac25a-plugins-config-volume\") pod \"d3a99b0c-c5e0-42cb-83ec-39dde11ac25a\" (UID: \"d3a99b0c-c5e0-42cb-83ec-39dde11ac25a\") "
Aug 05 17:21:49.451349 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.451262    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kl89\" (UniqueName: \"kubernetes.io/projected/d3a99b0c-c5e0-42cb-83ec-39dde11ac25a-kube-api-access-7kl89\") pod \"d3a99b0c-c5e0-42cb-83ec-39dde11ac25a\" (UID: \"d3a99b0c-c5e0-42cb-83ec-39dde11ac25a\") "
Aug 05 17:21:49.451588 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.451560    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3a99b0c-c5e0-42cb-83ec-39dde11ac25a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d3a99b0c-c5e0-42cb-83ec-39dde11ac25a" (UID: "d3a99b0c-c5e0-42cb-83ec-39dde11ac25a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:49.453332 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.453312    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3a99b0c-c5e0-42cb-83ec-39dde11ac25a-kube-api-access-7kl89" (OuterVolumeSpecName: "kube-api-access-7kl89") pod "d3a99b0c-c5e0-42cb-83ec-39dde11ac25a" (UID: "d3a99b0c-c5e0-42cb-83ec-39dde11ac25a"). InnerVolumeSpecName "kube-api-access-7kl89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:49.552756 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.552721    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3a99b0c-c5e0-42cb-83ec-39dde11ac25a-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:49.552756 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.552748    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kl89\" (UniqueName: \"kubernetes.io/projected/d3a99b0c-c5e0-42cb-83ec-39dde11ac25a-kube-api-access-7kl89\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:21:49.898266 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.898237    2565 generic.go:356] "Generic (PLEG): container finished" podID="d3a99b0c-c5e0-42cb-83ec-39dde11ac25a" containerID="8a2415bfee19d4e928cf598c2e7c0016cbcecd4497e5294fce9d7d46c474b60b" exitCode=0
Aug 05 17:21:49.898437 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.898280    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"
Aug 05 17:21:49.898437 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.898330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg" event={"ID":"d3a99b0c-c5e0-42cb-83ec-39dde11ac25a","Type":"ContainerDied","Data":"8a2415bfee19d4e928cf598c2e7c0016cbcecd4497e5294fce9d7d46c474b60b"}
Aug 05 17:21:49.898437 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.898381    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg" event={"ID":"d3a99b0c-c5e0-42cb-83ec-39dde11ac25a","Type":"ContainerDied","Data":"a45b71c6ae8a31a883897af87a93401cc46c4ca2feade68e2024a8fa4474ab72"}
Aug 05 17:21:49.898437 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.898405    2565 scope.go:117] "RemoveContainer" containerID="8a2415bfee19d4e928cf598c2e7c0016cbcecd4497e5294fce9d7d46c474b60b"
Aug 05 17:21:49.911378 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.911179    2565 scope.go:117] "RemoveContainer" containerID="8a2415bfee19d4e928cf598c2e7c0016cbcecd4497e5294fce9d7d46c474b60b"
Aug 05 17:21:49.913384 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:21:49.913357    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a2415bfee19d4e928cf598c2e7c0016cbcecd4497e5294fce9d7d46c474b60b\": container with ID starting with 8a2415bfee19d4e928cf598c2e7c0016cbcecd4497e5294fce9d7d46c474b60b not found: ID does not exist" containerID="8a2415bfee19d4e928cf598c2e7c0016cbcecd4497e5294fce9d7d46c474b60b"
Aug 05 17:21:49.913480 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.913391    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a2415bfee19d4e928cf598c2e7c0016cbcecd4497e5294fce9d7d46c474b60b"} err="failed to get container status \"8a2415bfee19d4e928cf598c2e7c0016cbcecd4497e5294fce9d7d46c474b60b\": rpc error: code = NotFound desc = could not find container \"8a2415bfee19d4e928cf598c2e7c0016cbcecd4497e5294fce9d7d46c474b60b\": container with ID starting with 8a2415bfee19d4e928cf598c2e7c0016cbcecd4497e5294fce9d7d46c474b60b not found: ID does not exist"
Aug 05 17:21:49.925664 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.925642    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"]
Aug 05 17:21:49.929669 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.929642    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-161ce7-5d69db6bf6-rzcxg"]
Aug 05 17:21:49.952448 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:49.952426    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3a99b0c-c5e0-42cb-83ec-39dde11ac25a" path="/var/lib/kubelet/pods/d3a99b0c-c5e0-42cb-83ec-39dde11ac25a/volumes"
Aug 05 17:21:56.574845 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:56.574809    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"]
Aug 05 17:21:56.575384 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:56.575029    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn" podUID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerName="istio-proxy" containerID="cri-o://5ba139cb00b0e5ce2768f0e453f970af09d148f07d4fa590e8d458a03da41018" gracePeriod=30
Aug 05 17:21:57.524468 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524432    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"]
Aug 05 17:21:57.524821 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524808    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06650891-34d1-4559-9331-8327425fb25d" containerName="istio-proxy"
Aug 05 17:21:57.524870 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524822    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="06650891-34d1-4559-9331-8327425fb25d" containerName="istio-proxy"
Aug 05 17:21:57.524870 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524832    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c195a72-2c93-46eb-89e3-a25a52c1de0d" containerName="payload-pre-processing"
Aug 05 17:21:57.524870 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524838    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c195a72-2c93-46eb-89e3-a25a52c1de0d" containerName="payload-pre-processing"
Aug 05 17:21:57.524870 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524847    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c72f91bb-8cbd-4d8b-b2b1-3d0db185009b" containerName="payload-processing"
Aug 05 17:21:57.524870 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524854    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c72f91bb-8cbd-4d8b-b2b1-3d0db185009b" containerName="payload-processing"
Aug 05 17:21:57.524870 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524863    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4225c59-e114-4fdc-a11e-7b148affef73" containerName="main"
Aug 05 17:21:57.524870 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524869    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4225c59-e114-4fdc-a11e-7b148affef73" containerName="main"
Aug 05 17:21:57.525159 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524881    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3a99b0c-c5e0-42cb-83ec-39dde11ac25a" containerName="payload-pre-processing"
Aug 05 17:21:57.525159 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524886    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3a99b0c-c5e0-42cb-83ec-39dde11ac25a" containerName="payload-pre-processing"
Aug 05 17:21:57.525159 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524940    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3a99b0c-c5e0-42cb-83ec-39dde11ac25a" containerName="payload-pre-processing"
Aug 05 17:21:57.525159 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524947    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c72f91bb-8cbd-4d8b-b2b1-3d0db185009b" containerName="payload-processing"
Aug 05 17:21:57.525159 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524956    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="06650891-34d1-4559-9331-8327425fb25d" containerName="istio-proxy"
Aug 05 17:21:57.525159 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524963    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c195a72-2c93-46eb-89e3-a25a52c1de0d" containerName="payload-pre-processing"
Aug 05 17:21:57.525159 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.524970    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4225c59-e114-4fdc-a11e-7b148affef73" containerName="main"
Aug 05 17:21:57.527972 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.527956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.530871 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.530850    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-5e257e-openshift-default-dockercfg-r5pff\""
Aug 05 17:21:57.542676 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.542651    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"]
Aug 05 17:21:57.621906 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.621874    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-istio-envoy\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.622307 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.621916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e625a83-5921-4004-8831-6a14ed003385-istio-podinfo\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.622307 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.621971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-workload-certs\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.622307 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.621989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gph7h\" (UniqueName: \"kubernetes.io/projected/5e625a83-5921-4004-8831-6a14ed003385-kube-api-access-gph7h\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.622307 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.622064    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-credential-socket\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.622307 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.622127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e625a83-5921-4004-8831-6a14ed003385-istio-token\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.622307 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.622152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-workload-socket\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.622307 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.622172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e625a83-5921-4004-8831-6a14ed003385-istiod-ca-cert\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.622307 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.622197    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-istio-data\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.723439 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.723402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e625a83-5921-4004-8831-6a14ed003385-istiod-ca-cert\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.723621 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.723448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-istio-data\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.723621 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.723491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-istio-envoy\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.723621 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.723517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e625a83-5921-4004-8831-6a14ed003385-istio-podinfo\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.723621 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.723551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-workload-certs\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.723621 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.723577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gph7h\" (UniqueName: \"kubernetes.io/projected/5e625a83-5921-4004-8831-6a14ed003385-kube-api-access-gph7h\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.723928 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.723720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-credential-socket\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.723928 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.723834    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e625a83-5921-4004-8831-6a14ed003385-istio-token\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.723928 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.723899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-workload-socket\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.724120 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.723937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-workload-certs\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.724189 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.724148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-credential-socket\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.724255 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.724197    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-istio-data\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.724255 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.724219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e625a83-5921-4004-8831-6a14ed003385-istiod-ca-cert\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.724255 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.724245    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-workload-socket\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.725909 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.725882    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-istio-envoy\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.726056 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.726041    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e625a83-5921-4004-8831-6a14ed003385-istio-podinfo\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.733014 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.732991    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e625a83-5921-4004-8831-6a14ed003385-istio-token\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.733659 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.733638    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gph7h\" (UniqueName: \"kubernetes.io/projected/5e625a83-5921-4004-8831-6a14ed003385-kube-api-access-gph7h\") pod \"e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") " pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.839573 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.839535    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:57.991900 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.991877    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"]
Aug 05 17:21:57.993875 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:21:57.993841    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e625a83_5921_4004_8831_6a14ed003385.slice/crio-30e3304fff60570175ab8a56f7ce96701c87aeeb985824335f6d88d155cfcb3b WatchSource:0}: Error finding container 30e3304fff60570175ab8a56f7ce96701c87aeeb985824335f6d88d155cfcb3b: Status 404 returned error can't find the container with id 30e3304fff60570175ab8a56f7ce96701c87aeeb985824335f6d88d155cfcb3b
Aug 05 17:21:57.996008 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.995974    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:21:57.996134 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.996040    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:21:57.996134 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:57.996065    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:21:58.947905 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:58.947874    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm" event={"ID":"5e625a83-5921-4004-8831-6a14ed003385","Type":"ContainerStarted","Data":"9d828b29d3f4ac246fc2c78ff64c0e9beb8a419b67255764c29cd3b5073155f2"}
Aug 05 17:21:58.948284 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:58.947920    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm" event={"ID":"5e625a83-5921-4004-8831-6a14ed003385","Type":"ContainerStarted","Data":"30e3304fff60570175ab8a56f7ce96701c87aeeb985824335f6d88d155cfcb3b"}
Aug 05 17:21:58.984089 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:58.984041    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm" podStartSLOduration=1.98402626 podStartE2EDuration="1.98402626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:21:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:21:58.9834564 +0000 UTC m=+2591.565528067" watchObservedRunningTime="2026-08-05 17:21:58.98402626 +0000 UTC m=+2591.566097916"
Aug 05 17:21:59.839920 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:59.839873    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:59.845044 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:59.845019    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:59.953842 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:59.953815    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:21:59.954711 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:21:59.954693    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:22:01.010515 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.010480    2565 patch_prober.go:28] interesting pod/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 17:22:01.010965 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.010554    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn" podUID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 17:22:01.826915 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.826890    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:22:01.960736 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.960660    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-workload-socket\") pod \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") "
Aug 05 17:22:01.960736 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.960717    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-data\") pod \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") "
Aug 05 17:22:01.960968 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.960757    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-credential-socket\") pod \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") "
Aug 05 17:22:01.960968 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.960792    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbsrm\" (UniqueName: \"kubernetes.io/projected/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-kube-api-access-sbsrm\") pod \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") "
Aug 05 17:22:01.960968 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.960810    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-podinfo\") pod \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") "
Aug 05 17:22:01.960968 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.960834    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istiod-ca-cert\") pod \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") "
Aug 05 17:22:01.960968 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.960882    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-workload-certs\") pod \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") "
Aug 05 17:22:01.960968 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.960913    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-token\") pod \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") "
Aug 05 17:22:01.960968 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.960958    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-envoy\") pod \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\" (UID: \"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add\") "
Aug 05 17:22:01.961345 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.960964    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" (UID: "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:22:01.961345 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.960980    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-data" (OuterVolumeSpecName: "istio-data") pod "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" (UID: "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:22:01.961345 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.961071    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" (UID: "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:22:01.961345 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.961277    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" (UID: "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:22:01.961345 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.961295    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-data\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:22:01.961345 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.961316    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-credential-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:22:01.961345 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.961331    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-workload-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:22:01.961633 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.961605    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" (UID: "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:22:01.963400 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.963372    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-token" (OuterVolumeSpecName: "istio-token") pod "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" (UID: "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:22:01.963537 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.963397    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-kube-api-access-sbsrm" (OuterVolumeSpecName: "kube-api-access-sbsrm") pod "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" (UID: "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add"). InnerVolumeSpecName "kube-api-access-sbsrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:22:01.963537 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.963503    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" (UID: "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:22:01.963537 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.963502    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" (UID: "d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:22:01.965631 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.965607    2565 generic.go:356] "Generic (PLEG): container finished" podID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerID="5ba139cb00b0e5ce2768f0e453f970af09d148f07d4fa590e8d458a03da41018" exitCode=0
Aug 05 17:22:01.965754 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.965652    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"
Aug 05 17:22:01.965754 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.965687    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn" event={"ID":"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add","Type":"ContainerDied","Data":"5ba139cb00b0e5ce2768f0e453f970af09d148f07d4fa590e8d458a03da41018"}
Aug 05 17:22:01.965754 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.965739    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn" event={"ID":"d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add","Type":"ContainerDied","Data":"f98a71aa5a684a8e3d195c4c49d769df7325f0d711585f0c986a88df07aec62a"}
Aug 05 17:22:01.965927 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.965762    2565 scope.go:117] "RemoveContainer" containerID="5ba139cb00b0e5ce2768f0e453f970af09d148f07d4fa590e8d458a03da41018"
Aug 05 17:22:01.981342 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.981320    2565 scope.go:117] "RemoveContainer" containerID="23e58a8187efb4b11464f0ca494bd8713593f92d0e202ae5a1213c2cd9b7d6a3"
Aug 05 17:22:01.990235 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.990215    2565 scope.go:117] "RemoveContainer" containerID="5ba139cb00b0e5ce2768f0e453f970af09d148f07d4fa590e8d458a03da41018"
Aug 05 17:22:01.990480 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:22:01.990458    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ba139cb00b0e5ce2768f0e453f970af09d148f07d4fa590e8d458a03da41018\": container with ID starting with 5ba139cb00b0e5ce2768f0e453f970af09d148f07d4fa590e8d458a03da41018 not found: ID does not exist" containerID="5ba139cb00b0e5ce2768f0e453f970af09d148f07d4fa590e8d458a03da41018"
Aug 05 17:22:01.990555 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.990494    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ba139cb00b0e5ce2768f0e453f970af09d148f07d4fa590e8d458a03da41018"} err="failed to get container status \"5ba139cb00b0e5ce2768f0e453f970af09d148f07d4fa590e8d458a03da41018\": rpc error: code = NotFound desc = could not find container \"5ba139cb00b0e5ce2768f0e453f970af09d148f07d4fa590e8d458a03da41018\": container with ID starting with 5ba139cb00b0e5ce2768f0e453f970af09d148f07d4fa590e8d458a03da41018 not found: ID does not exist"
Aug 05 17:22:01.990555 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.990521    2565 scope.go:117] "RemoveContainer" containerID="23e58a8187efb4b11464f0ca494bd8713593f92d0e202ae5a1213c2cd9b7d6a3"
Aug 05 17:22:01.990783 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:22:01.990761    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23e58a8187efb4b11464f0ca494bd8713593f92d0e202ae5a1213c2cd9b7d6a3\": container with ID starting with 23e58a8187efb4b11464f0ca494bd8713593f92d0e202ae5a1213c2cd9b7d6a3 not found: ID does not exist" containerID="23e58a8187efb4b11464f0ca494bd8713593f92d0e202ae5a1213c2cd9b7d6a3"
Aug 05 17:22:01.990826 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.990791    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23e58a8187efb4b11464f0ca494bd8713593f92d0e202ae5a1213c2cd9b7d6a3"} err="failed to get container status \"23e58a8187efb4b11464f0ca494bd8713593f92d0e202ae5a1213c2cd9b7d6a3\": rpc error: code = NotFound desc = could not find container \"23e58a8187efb4b11464f0ca494bd8713593f92d0e202ae5a1213c2cd9b7d6a3\": container with ID starting with 23e58a8187efb4b11464f0ca494bd8713593f92d0e202ae5a1213c2cd9b7d6a3 not found: ID does not exist"
Aug 05 17:22:01.994634 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.994614    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"]
Aug 05 17:22:01.999950 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:01.999931    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-161ce7-openshift-default-66b969d874-fh7nn"]
Aug 05 17:22:02.062249 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:02.062217    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbsrm\" (UniqueName: \"kubernetes.io/projected/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-kube-api-access-sbsrm\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:22:02.062249 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:02.062250    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-podinfo\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:22:02.062760 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:02.062266    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istiod-ca-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:22:02.062760 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:02.062279    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-workload-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:22:02.062760 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:02.062290    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:22:02.062760 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:02.062305    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add-istio-envoy\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:22:03.953347 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:03.953315    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" path="/var/lib/kubelet/pods/d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add/volumes"
Aug 05 17:22:15.105626 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:15.104820    2565 patch_prober.go:28] interesting pod/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": read tcp 10.132.0.2:34282->10.132.0.78:15021: read: connection reset by peer" start-of-body=
Aug 05 17:22:15.105626 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:15.104885    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm" podUID="5e625a83-5921-4004-8831-6a14ed003385" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": read tcp 10.132.0.2:34282->10.132.0.78:15021: read: connection reset by peer"
Aug 05 17:22:16.040820 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:16.040790    2565 generic.go:356] "Generic (PLEG): container finished" podID="5e625a83-5921-4004-8831-6a14ed003385" containerID="9d828b29d3f4ac246fc2c78ff64c0e9beb8a419b67255764c29cd3b5073155f2" exitCode=0
Aug 05 17:22:16.041016 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:16.040863    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm" event={"ID":"5e625a83-5921-4004-8831-6a14ed003385","Type":"ContainerDied","Data":"9d828b29d3f4ac246fc2c78ff64c0e9beb8a419b67255764c29cd3b5073155f2"}
Aug 05 17:22:16.041271 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:16.041258    2565 scope.go:117] "RemoveContainer" containerID="9d828b29d3f4ac246fc2c78ff64c0e9beb8a419b67255764c29cd3b5073155f2"
Aug 05 17:22:16.042309 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:16.042284    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:22:16.042383 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:16.042357    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:22:16.042430 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:16.042390    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:22:17.050918 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:17.050886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm" event={"ID":"5e625a83-5921-4004-8831-6a14ed003385","Type":"ContainerStarted","Data":"040c855b285af2872960bea189ad99f683d9543bf032832276b9dc911e5f26ef"}
Aug 05 17:22:17.840290 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:17.840251    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:22:17.840501 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:17.840405    2565 patch_prober.go:28] interesting pod/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Aug 05 17:22:17.840501 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:17.840450    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm" podUID="5e625a83-5921-4004-8831-6a14ed003385" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Aug 05 17:22:18.840926 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:18.840881    2565 patch_prober.go:28] interesting pod/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Aug 05 17:22:18.841456 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:18.840950    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm" podUID="5e625a83-5921-4004-8831-6a14ed003385" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Aug 05 17:22:19.840379 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:19.840336    2565 patch_prober.go:28] interesting pod/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Aug 05 17:22:19.840592 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:19.840406    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm" podUID="5e625a83-5921-4004-8831-6a14ed003385" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Aug 05 17:22:20.840172 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:20.840129    2565 patch_prober.go:28] interesting pod/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Aug 05 17:22:20.840715 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:20.840198    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm" podUID="5e625a83-5921-4004-8831-6a14ed003385" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Aug 05 17:22:21.840815 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:21.840775    2565 patch_prober.go:28] interesting pod/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Aug 05 17:22:21.841405 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:21.841373    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm" podUID="5e625a83-5921-4004-8831-6a14ed003385" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Aug 05 17:22:22.843636 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:22.843604    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:22:22.844006 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:22.843869    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:22:22.844581 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:22.844560    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:22:27.025714 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.025687    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"]
Aug 05 17:22:27.026081 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.026045    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06650891-34d1-4559-9331-8327425fb25d" containerName="istio-proxy"
Aug 05 17:22:27.026081 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.026056    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="06650891-34d1-4559-9331-8327425fb25d" containerName="istio-proxy"
Aug 05 17:22:27.026081 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.026069    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerName="istio-proxy"
Aug 05 17:22:27.026081 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.026074    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerName="istio-proxy"
Aug 05 17:22:27.026081 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.026084    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerName="istio-proxy"
Aug 05 17:22:27.026285 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.026089    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerName="istio-proxy"
Aug 05 17:22:27.026285 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.026191    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="06650891-34d1-4559-9331-8327425fb25d" containerName="istio-proxy"
Aug 05 17:22:27.026285 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.026199    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerName="istio-proxy"
Aug 05 17:22:27.026285 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.026207    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a6b3d3-ca7c-4c5a-a6cc-a12816a12add" containerName="istio-proxy"
Aug 05 17:22:27.029224 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.029205    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.064186 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.064162    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"]
Aug 05 17:22:27.064186 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.064181    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-2db124-openshift-default-dockercfg-24lrs\""
Aug 05 17:22:27.086746 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.086717    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4fqk\" (UniqueName: \"kubernetes.io/projected/92007659-eec7-47a8-97b9-779289dbc107-kube-api-access-x4fqk\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.086873 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.086755    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-istio-envoy\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.086873 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.086777    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92007659-eec7-47a8-97b9-779289dbc107-istiod-ca-cert\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.086952 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.086868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92007659-eec7-47a8-97b9-779289dbc107-istio-podinfo\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.086952 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.086904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-credential-socket\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.086952 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.086924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-istio-data\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.086952 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.086950    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-workload-certs\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.087086 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.086966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92007659-eec7-47a8-97b9-779289dbc107-istio-token\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.087086 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.086981    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-workload-socket\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.188020 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.187990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92007659-eec7-47a8-97b9-779289dbc107-istio-podinfo\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.188238 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.188035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-credential-socket\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.188238 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.188059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-istio-data\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.188238 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.188127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-workload-certs\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.188238 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.188152    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92007659-eec7-47a8-97b9-779289dbc107-istio-token\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.188238 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.188177    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-workload-socket\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.188238 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.188220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4fqk\" (UniqueName: \"kubernetes.io/projected/92007659-eec7-47a8-97b9-779289dbc107-kube-api-access-x4fqk\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.188565 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.188247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-istio-envoy\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.188565 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.188271    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92007659-eec7-47a8-97b9-779289dbc107-istiod-ca-cert\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.188565 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.188446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-credential-socket\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.188565 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.188464    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-istio-data\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.188831 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.188808    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-workload-socket\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.188831 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.188823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-workload-certs\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.189233 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.189214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92007659-eec7-47a8-97b9-779289dbc107-istiod-ca-cert\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.190673 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.190656    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92007659-eec7-47a8-97b9-779289dbc107-istio-podinfo\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.190836 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.190816    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-istio-envoy\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.203158 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.203133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92007659-eec7-47a8-97b9-779289dbc107-istio-token\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.204225 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.204204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4fqk\" (UniqueName: \"kubernetes.io/projected/92007659-eec7-47a8-97b9-779289dbc107-kube-api-access-x4fqk\") pod \"e2e-api-b-2db124-openshift-default-758c49c87b-62pqh\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") " pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.339595 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.339560    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:27.485215 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.485189    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"]
Aug 05 17:22:27.486262 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:22:27.486231    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92007659_eec7_47a8_97b9_779289dbc107.slice/crio-d472352bea8d30c878db8ad9097328081273b882d2b77384fd5c013ab20acc42 WatchSource:0}: Error finding container d472352bea8d30c878db8ad9097328081273b882d2b77384fd5c013ab20acc42: Status 404 returned error can't find the container with id d472352bea8d30c878db8ad9097328081273b882d2b77384fd5c013ab20acc42
Aug 05 17:22:27.488375 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.488344    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:22:27.488457 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.488409    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:22:27.488457 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:27.488439    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:22:28.115358 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:28.115317    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh" event={"ID":"92007659-eec7-47a8-97b9-779289dbc107","Type":"ContainerStarted","Data":"cb821a794b20e2df690fada3294743b6d15cba39501413b870314b00bc2b3b94"}
Aug 05 17:22:28.115747 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:28.115372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh" event={"ID":"92007659-eec7-47a8-97b9-779289dbc107","Type":"ContainerStarted","Data":"d472352bea8d30c878db8ad9097328081273b882d2b77384fd5c013ab20acc42"}
Aug 05 17:22:28.142358 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:28.142309    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh" podStartSLOduration=2.142295906 podStartE2EDuration="2.142295906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:22:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:28.139199458 +0000 UTC m=+2620.721271113" watchObservedRunningTime="2026-08-05 17:22:28.142295906 +0000 UTC m=+2620.724367561"
Aug 05 17:22:28.340801 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:28.340765    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:28.345292 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:28.345270    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:29.121181 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:29.121151    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:29.122337 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:29.122317    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:44.304614 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:44.303850    2565 patch_prober.go:28] interesting pod/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": read tcp 10.132.0.2:44922->10.132.0.79:15021: read: connection reset by peer" start-of-body=
Aug 05 17:22:44.304614 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:44.303918    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh" podUID="92007659-eec7-47a8-97b9-779289dbc107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": read tcp 10.132.0.2:44922->10.132.0.79:15021: read: connection reset by peer"
Aug 05 17:22:45.218215 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:45.218181    2565 generic.go:356] "Generic (PLEG): container finished" podID="92007659-eec7-47a8-97b9-779289dbc107" containerID="cb821a794b20e2df690fada3294743b6d15cba39501413b870314b00bc2b3b94" exitCode=0
Aug 05 17:22:45.218382 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:45.218252    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh" event={"ID":"92007659-eec7-47a8-97b9-779289dbc107","Type":"ContainerDied","Data":"cb821a794b20e2df690fada3294743b6d15cba39501413b870314b00bc2b3b94"}
Aug 05 17:22:45.218687 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:45.218669    2565 scope.go:117] "RemoveContainer" containerID="cb821a794b20e2df690fada3294743b6d15cba39501413b870314b00bc2b3b94"
Aug 05 17:22:45.219735 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:45.219708    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:22:45.219803 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:45.219789    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:22:45.219845 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:45.219825    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:22:46.225105 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:46.225052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh" event={"ID":"92007659-eec7-47a8-97b9-779289dbc107","Type":"ContainerStarted","Data":"904dc945d2a160cea963c6625b9da9afa46fea599ccc558e30dfce7b365b0f8f"}
Aug 05 17:22:46.339755 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:46.339707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:46.340020 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:46.339992    2565 patch_prober.go:28] interesting pod/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Aug 05 17:22:46.340121 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:46.340065    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh" podUID="92007659-eec7-47a8-97b9-779289dbc107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Aug 05 17:22:47.340538 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:47.340502    2565 patch_prober.go:28] interesting pod/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Aug 05 17:22:47.341171 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:47.341136    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh" podUID="92007659-eec7-47a8-97b9-779289dbc107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Aug 05 17:22:48.340228 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:48.340189    2565 patch_prober.go:28] interesting pod/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Aug 05 17:22:48.340516 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:48.340488    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh" podUID="92007659-eec7-47a8-97b9-779289dbc107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Aug 05 17:22:49.340550 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:49.340510    2565 patch_prober.go:28] interesting pod/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Aug 05 17:22:49.341171 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:49.341135    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh" podUID="92007659-eec7-47a8-97b9-779289dbc107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Aug 05 17:22:50.340602 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:50.340564    2565 patch_prober.go:28] interesting pod/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Aug 05 17:22:50.341125 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:50.340631    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh" podUID="92007659-eec7-47a8-97b9-779289dbc107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Aug 05 17:22:51.344081 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:51.344051    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:51.344474 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:51.344343    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:22:51.344948 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:22:51.344930    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:23:03.448571 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:03.448535    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2"]
Aug 05 17:23:03.452038 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:03.452021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2"
Aug 05 17:23:03.454877 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:03.454857    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:23:03.460578 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:03.460551    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2"]
Aug 05 17:23:03.625174 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:03.625139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb89e537-ca5a-4a78-a4ce-c8b02f73138b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2\" (UID: \"bb89e537-ca5a-4a78-a4ce-c8b02f73138b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2"
Aug 05 17:23:03.726844 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:03.726749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb89e537-ca5a-4a78-a4ce-c8b02f73138b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2\" (UID: \"bb89e537-ca5a-4a78-a4ce-c8b02f73138b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2"
Aug 05 17:23:03.727416 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:03.727397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb89e537-ca5a-4a78-a4ce-c8b02f73138b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2\" (UID: \"bb89e537-ca5a-4a78-a4ce-c8b02f73138b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2"
Aug 05 17:23:03.763933 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:03.763903    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2"
Aug 05 17:23:03.902494 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:03.902464    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2"]
Aug 05 17:23:03.904086 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:23:03.904059    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb89e537_ca5a_4a78_a4ce_c8b02f73138b.slice/crio-d967fc45cb9edf5d7eaca58d86f14e93fe7b479988c7e608ecf2ac546fb6ad9b WatchSource:0}: Error finding container d967fc45cb9edf5d7eaca58d86f14e93fe7b479988c7e608ecf2ac546fb6ad9b: Status 404 returned error can't find the container with id d967fc45cb9edf5d7eaca58d86f14e93fe7b479988c7e608ecf2ac546fb6ad9b
Aug 05 17:23:04.333248 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:04.333216    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2" event={"ID":"bb89e537-ca5a-4a78-a4ce-c8b02f73138b","Type":"ContainerStarted","Data":"d967fc45cb9edf5d7eaca58d86f14e93fe7b479988c7e608ecf2ac546fb6ad9b"}
Aug 05 17:23:05.339614 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:05.339577    2565 generic.go:356] "Generic (PLEG): container finished" podID="bb89e537-ca5a-4a78-a4ce-c8b02f73138b" containerID="42b31e013e85b03ffa5ca44acddf328e77c4d1b742c1aea1ddf225d4e082df5e" exitCode=0
Aug 05 17:23:05.340007 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:05.339637    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2" event={"ID":"bb89e537-ca5a-4a78-a4ce-c8b02f73138b","Type":"ContainerDied","Data":"42b31e013e85b03ffa5ca44acddf328e77c4d1b742c1aea1ddf225d4e082df5e"}
Aug 05 17:23:06.478629 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:06.478600    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2"
Aug 05 17:23:06.654810 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:06.654713    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb89e537-ca5a-4a78-a4ce-c8b02f73138b-maas-api-service-ca\") pod \"bb89e537-ca5a-4a78-a4ce-c8b02f73138b\" (UID: \"bb89e537-ca5a-4a78-a4ce-c8b02f73138b\") "
Aug 05 17:23:06.655085 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:06.655060    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb89e537-ca5a-4a78-a4ce-c8b02f73138b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bb89e537-ca5a-4a78-a4ce-c8b02f73138b" (UID: "bb89e537-ca5a-4a78-a4ce-c8b02f73138b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:23:06.756315 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:06.756282    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb89e537-ca5a-4a78-a4ce-c8b02f73138b-maas-api-service-ca\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:07.351839 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:07.351805    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2"
Aug 05 17:23:07.352033 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:07.351810    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2" event={"ID":"bb89e537-ca5a-4a78-a4ce-c8b02f73138b","Type":"ContainerDied","Data":"d967fc45cb9edf5d7eaca58d86f14e93fe7b479988c7e608ecf2ac546fb6ad9b"}
Aug 05 17:23:07.352033 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:07.351933    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d967fc45cb9edf5d7eaca58d86f14e93fe7b479988c7e608ecf2ac546fb6ad9b"
Aug 05 17:23:19.259023 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:19.258980    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2"]
Aug 05 17:23:19.264219 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:19.264194    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e257e-6tlg2"]
Aug 05 17:23:19.952476 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:19.952442    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb89e537-ca5a-4a78-a4ce-c8b02f73138b" path="/var/lib/kubelet/pods/bb89e537-ca5a-4a78-a4ce-c8b02f73138b/volumes"
Aug 05 17:23:26.194260 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:26.194226    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"]
Aug 05 17:23:26.194820 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:26.194445    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm" podUID="5e625a83-5921-4004-8831-6a14ed003385" containerName="istio-proxy" containerID="cri-o://040c855b285af2872960bea189ad99f683d9543bf032832276b9dc911e5f26ef" gracePeriod=30
Aug 05 17:23:31.441992 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.441964    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:23:31.479426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.479343    2565 generic.go:356] "Generic (PLEG): container finished" podID="5e625a83-5921-4004-8831-6a14ed003385" containerID="040c855b285af2872960bea189ad99f683d9543bf032832276b9dc911e5f26ef" exitCode=0
Aug 05 17:23:31.479426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.479392    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"
Aug 05 17:23:31.479660 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.479427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm" event={"ID":"5e625a83-5921-4004-8831-6a14ed003385","Type":"ContainerDied","Data":"040c855b285af2872960bea189ad99f683d9543bf032832276b9dc911e5f26ef"}
Aug 05 17:23:31.479660 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.479515    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm" event={"ID":"5e625a83-5921-4004-8831-6a14ed003385","Type":"ContainerDied","Data":"30e3304fff60570175ab8a56f7ce96701c87aeeb985824335f6d88d155cfcb3b"}
Aug 05 17:23:31.479660 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.479539    2565 scope.go:117] "RemoveContainer" containerID="040c855b285af2872960bea189ad99f683d9543bf032832276b9dc911e5f26ef"
Aug 05 17:23:31.488485 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.488465    2565 scope.go:117] "RemoveContainer" containerID="9d828b29d3f4ac246fc2c78ff64c0e9beb8a419b67255764c29cd3b5073155f2"
Aug 05 17:23:31.496563 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.496542    2565 scope.go:117] "RemoveContainer" containerID="040c855b285af2872960bea189ad99f683d9543bf032832276b9dc911e5f26ef"
Aug 05 17:23:31.496856 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:23:31.496838    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"040c855b285af2872960bea189ad99f683d9543bf032832276b9dc911e5f26ef\": container with ID starting with 040c855b285af2872960bea189ad99f683d9543bf032832276b9dc911e5f26ef not found: ID does not exist" containerID="040c855b285af2872960bea189ad99f683d9543bf032832276b9dc911e5f26ef"
Aug 05 17:23:31.496900 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.496866    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"040c855b285af2872960bea189ad99f683d9543bf032832276b9dc911e5f26ef"} err="failed to get container status \"040c855b285af2872960bea189ad99f683d9543bf032832276b9dc911e5f26ef\": rpc error: code = NotFound desc = could not find container \"040c855b285af2872960bea189ad99f683d9543bf032832276b9dc911e5f26ef\": container with ID starting with 040c855b285af2872960bea189ad99f683d9543bf032832276b9dc911e5f26ef not found: ID does not exist"
Aug 05 17:23:31.496900 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.496895    2565 scope.go:117] "RemoveContainer" containerID="9d828b29d3f4ac246fc2c78ff64c0e9beb8a419b67255764c29cd3b5073155f2"
Aug 05 17:23:31.497200 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:23:31.497173    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d828b29d3f4ac246fc2c78ff64c0e9beb8a419b67255764c29cd3b5073155f2\": container with ID starting with 9d828b29d3f4ac246fc2c78ff64c0e9beb8a419b67255764c29cd3b5073155f2 not found: ID does not exist" containerID="9d828b29d3f4ac246fc2c78ff64c0e9beb8a419b67255764c29cd3b5073155f2"
Aug 05 17:23:31.497277 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.497208    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d828b29d3f4ac246fc2c78ff64c0e9beb8a419b67255764c29cd3b5073155f2"} err="failed to get container status \"9d828b29d3f4ac246fc2c78ff64c0e9beb8a419b67255764c29cd3b5073155f2\": rpc error: code = NotFound desc = could not find container \"9d828b29d3f4ac246fc2c78ff64c0e9beb8a419b67255764c29cd3b5073155f2\": container with ID starting with 9d828b29d3f4ac246fc2c78ff64c0e9beb8a419b67255764c29cd3b5073155f2 not found: ID does not exist"
Aug 05 17:23:31.566080 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566050    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e625a83-5921-4004-8831-6a14ed003385-istio-podinfo\") pod \"5e625a83-5921-4004-8831-6a14ed003385\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") "
Aug 05 17:23:31.566276 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566129    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-workload-certs\") pod \"5e625a83-5921-4004-8831-6a14ed003385\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") "
Aug 05 17:23:31.566276 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566151    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-workload-socket\") pod \"5e625a83-5921-4004-8831-6a14ed003385\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") "
Aug 05 17:23:31.566276 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566174    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gph7h\" (UniqueName: \"kubernetes.io/projected/5e625a83-5921-4004-8831-6a14ed003385-kube-api-access-gph7h\") pod \"5e625a83-5921-4004-8831-6a14ed003385\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") "
Aug 05 17:23:31.566276 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566219    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e625a83-5921-4004-8831-6a14ed003385-istiod-ca-cert\") pod \"5e625a83-5921-4004-8831-6a14ed003385\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") "
Aug 05 17:23:31.566276 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566255    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-credential-socket\") pod \"5e625a83-5921-4004-8831-6a14ed003385\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") "
Aug 05 17:23:31.566557 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566294    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-istio-envoy\") pod \"5e625a83-5921-4004-8831-6a14ed003385\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") "
Aug 05 17:23:31.566557 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566325    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e625a83-5921-4004-8831-6a14ed003385-istio-token\") pod \"5e625a83-5921-4004-8831-6a14ed003385\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") "
Aug 05 17:23:31.566557 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566402    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-istio-data\") pod \"5e625a83-5921-4004-8831-6a14ed003385\" (UID: \"5e625a83-5921-4004-8831-6a14ed003385\") "
Aug 05 17:23:31.566557 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566465    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5e625a83-5921-4004-8831-6a14ed003385" (UID: "5e625a83-5921-4004-8831-6a14ed003385"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:31.566557 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566476    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5e625a83-5921-4004-8831-6a14ed003385" (UID: "5e625a83-5921-4004-8831-6a14ed003385"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:31.566821 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566664    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-istio-data" (OuterVolumeSpecName: "istio-data") pod "5e625a83-5921-4004-8831-6a14ed003385" (UID: "5e625a83-5921-4004-8831-6a14ed003385"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:31.566821 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566687    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e625a83-5921-4004-8831-6a14ed003385-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5e625a83-5921-4004-8831-6a14ed003385" (UID: "5e625a83-5921-4004-8831-6a14ed003385"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:23:31.566821 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566695    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-workload-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:31.566821 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566728    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-workload-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:31.566994 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.566843    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5e625a83-5921-4004-8831-6a14ed003385" (UID: "5e625a83-5921-4004-8831-6a14ed003385"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:31.568495 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.568459    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e625a83-5921-4004-8831-6a14ed003385-istio-token" (OuterVolumeSpecName: "istio-token") pod "5e625a83-5921-4004-8831-6a14ed003385" (UID: "5e625a83-5921-4004-8831-6a14ed003385"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:23:31.568586 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.568495    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5e625a83-5921-4004-8831-6a14ed003385" (UID: "5e625a83-5921-4004-8831-6a14ed003385"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:31.568747 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.568725    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e625a83-5921-4004-8831-6a14ed003385-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5e625a83-5921-4004-8831-6a14ed003385" (UID: "5e625a83-5921-4004-8831-6a14ed003385"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:23:31.568795 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.568726    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e625a83-5921-4004-8831-6a14ed003385-kube-api-access-gph7h" (OuterVolumeSpecName: "kube-api-access-gph7h") pod "5e625a83-5921-4004-8831-6a14ed003385" (UID: "5e625a83-5921-4004-8831-6a14ed003385"). InnerVolumeSpecName "kube-api-access-gph7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:23:31.667850 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.667816    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-istio-data\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:31.667850 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.667845    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e625a83-5921-4004-8831-6a14ed003385-istio-podinfo\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:31.668072 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.667858    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gph7h\" (UniqueName: \"kubernetes.io/projected/5e625a83-5921-4004-8831-6a14ed003385-kube-api-access-gph7h\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:31.668072 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.667872    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e625a83-5921-4004-8831-6a14ed003385-istiod-ca-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:31.668072 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.667884    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-credential-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:31.668072 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.667894    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e625a83-5921-4004-8831-6a14ed003385-istio-envoy\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:31.668072 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.667904    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e625a83-5921-4004-8831-6a14ed003385-istio-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:31.808471 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.808440    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"]
Aug 05 17:23:31.812292 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.812265    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-5e257e-openshift-default-6449fb5458-69xhm"]
Aug 05 17:23:31.952533 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:31.952503    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e625a83-5921-4004-8831-6a14ed003385" path="/var/lib/kubelet/pods/5e625a83-5921-4004-8831-6a14ed003385/volumes"
Aug 05 17:23:49.222038 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:49.222003    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"]
Aug 05 17:23:49.222545 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:49.222304    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh" podUID="92007659-eec7-47a8-97b9-779289dbc107" containerName="istio-proxy" containerID="cri-o://904dc945d2a160cea963c6625b9da9afa46fea599ccc558e30dfce7b365b0f8f" gracePeriod=30
Aug 05 17:23:50.138856 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.138818    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"]
Aug 05 17:23:50.139239 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.139225    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb89e537-ca5a-4a78-a4ce-c8b02f73138b" containerName="revoke-keys"
Aug 05 17:23:50.139298 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.139240    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb89e537-ca5a-4a78-a4ce-c8b02f73138b" containerName="revoke-keys"
Aug 05 17:23:50.139298 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.139260    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e625a83-5921-4004-8831-6a14ed003385" containerName="istio-proxy"
Aug 05 17:23:50.139298 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.139266    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e625a83-5921-4004-8831-6a14ed003385" containerName="istio-proxy"
Aug 05 17:23:50.139403 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.139325    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e625a83-5921-4004-8831-6a14ed003385" containerName="istio-proxy"
Aug 05 17:23:50.139403 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.139333    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb89e537-ca5a-4a78-a4ce-c8b02f73138b" containerName="revoke-keys"
Aug 05 17:23:50.139403 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.139340    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e625a83-5921-4004-8831-6a14ed003385" containerName="istio-proxy"
Aug 05 17:23:50.143823 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.143805    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.146868 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.146844    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-a1e09f-openshift-default-dockercfg-hcl4g\""
Aug 05 17:23:50.164760 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.164736    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"]
Aug 05 17:23:50.232575 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.232533    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f268f3c9-3af3-4933-a0db-be2255944286-istio-podinfo\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.233081 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.232643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f268f3c9-3af3-4933-a0db-be2255944286-istio-token\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.233081 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.232691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f268f3c9-3af3-4933-a0db-be2255944286-istiod-ca-cert\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.233081 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.232732    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-istio-data\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.233081 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.232766    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-credential-socket\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.233081 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.232805    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-istio-envoy\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.233081 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.232833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-workload-socket\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.233081 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.232857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvlkm\" (UniqueName: \"kubernetes.io/projected/f268f3c9-3af3-4933-a0db-be2255944286-kube-api-access-lvlkm\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.233081 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.232950    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-workload-certs\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.333697 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.333663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-istio-data\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.333697 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.333708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-credential-socket\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.333977 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.333866    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-istio-envoy\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.333977 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.333932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-workload-socket\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.333977 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.333958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvlkm\" (UniqueName: \"kubernetes.io/projected/f268f3c9-3af3-4933-a0db-be2255944286-kube-api-access-lvlkm\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.334168 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.334133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-credential-socket\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.334230 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.334177    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-istio-data\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.334298 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.334284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-workload-socket\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.334517 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.334492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-workload-certs\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.334672 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.334553    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f268f3c9-3af3-4933-a0db-be2255944286-istio-podinfo\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.334672 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.334599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f268f3c9-3af3-4933-a0db-be2255944286-istio-token\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.334672 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.334637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f268f3c9-3af3-4933-a0db-be2255944286-istiod-ca-cert\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.334856 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.334812    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-workload-certs\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.335380 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.335357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f268f3c9-3af3-4933-a0db-be2255944286-istiod-ca-cert\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.336294 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.336263    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-istio-envoy\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.337192 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.337173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f268f3c9-3af3-4933-a0db-be2255944286-istio-podinfo\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.343175 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.343149    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvlkm\" (UniqueName: \"kubernetes.io/projected/f268f3c9-3af3-4933-a0db-be2255944286-kube-api-access-lvlkm\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.343460 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.343441    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f268f3c9-3af3-4933-a0db-be2255944286-istio-token\") pod \"e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") " pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.454432 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.454349    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:50.610266 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.610241    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"]
Aug 05 17:23:50.611743 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:23:50.611713    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf268f3c9_3af3_4933_a0db_be2255944286.slice/crio-a43083ef52581f736555eac5ac6e6d517814e7860463f3b4d3f28c6fbfdb1005 WatchSource:0}: Error finding container a43083ef52581f736555eac5ac6e6d517814e7860463f3b4d3f28c6fbfdb1005: Status 404 returned error can't find the container with id a43083ef52581f736555eac5ac6e6d517814e7860463f3b4d3f28c6fbfdb1005
Aug 05 17:23:50.614347 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.614317    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:23:50.614423 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.614379    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:23:50.614423 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:50.614407    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:23:51.346745 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:51.346713    2565 patch_prober.go:28] interesting pod/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 17:23:51.347124 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:51.346768    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh" podUID="92007659-eec7-47a8-97b9-779289dbc107" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 17:23:51.586383 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:51.586348    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j" event={"ID":"f268f3c9-3af3-4933-a0db-be2255944286","Type":"ContainerStarted","Data":"6f61c6303912503b1c390322ab6b5147bb17a6c6283d1c55092722ea47c07100"}
Aug 05 17:23:51.586552 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:51.586400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j" event={"ID":"f268f3c9-3af3-4933-a0db-be2255944286","Type":"ContainerStarted","Data":"a43083ef52581f736555eac5ac6e6d517814e7860463f3b4d3f28c6fbfdb1005"}
Aug 05 17:23:51.612708 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:51.612605    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j" podStartSLOduration=1.612587725 podStartE2EDuration="1.612587725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:23:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:51.61004825 +0000 UTC m=+2704.192119907" watchObservedRunningTime="2026-08-05 17:23:51.612587725 +0000 UTC m=+2704.194659381"
Aug 05 17:23:52.455464 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:52.455430    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:52.460586 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:52.460562    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:52.591358 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:52.591330    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:52.592277 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:52.592259    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:23:54.477185 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.477155    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:23:54.572596 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.572563    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92007659-eec7-47a8-97b9-779289dbc107-istio-token\") pod \"92007659-eec7-47a8-97b9-779289dbc107\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") "
Aug 05 17:23:54.572791 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.572608    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4fqk\" (UniqueName: \"kubernetes.io/projected/92007659-eec7-47a8-97b9-779289dbc107-kube-api-access-x4fqk\") pod \"92007659-eec7-47a8-97b9-779289dbc107\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") "
Aug 05 17:23:54.572791 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.572631    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92007659-eec7-47a8-97b9-779289dbc107-istio-podinfo\") pod \"92007659-eec7-47a8-97b9-779289dbc107\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") "
Aug 05 17:23:54.572791 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.572772    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-istio-data\") pod \"92007659-eec7-47a8-97b9-779289dbc107\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") "
Aug 05 17:23:54.572960 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.572826    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92007659-eec7-47a8-97b9-779289dbc107-istiod-ca-cert\") pod \"92007659-eec7-47a8-97b9-779289dbc107\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") "
Aug 05 17:23:54.572960 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.572854    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-workload-certs\") pod \"92007659-eec7-47a8-97b9-779289dbc107\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") "
Aug 05 17:23:54.572960 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.572883    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-istio-envoy\") pod \"92007659-eec7-47a8-97b9-779289dbc107\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") "
Aug 05 17:23:54.572960 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.572912    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-workload-socket\") pod \"92007659-eec7-47a8-97b9-779289dbc107\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") "
Aug 05 17:23:54.572960 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.572939    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-credential-socket\") pod \"92007659-eec7-47a8-97b9-779289dbc107\" (UID: \"92007659-eec7-47a8-97b9-779289dbc107\") "
Aug 05 17:23:54.573285 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.573143    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-istio-data" (OuterVolumeSpecName: "istio-data") pod "92007659-eec7-47a8-97b9-779289dbc107" (UID: "92007659-eec7-47a8-97b9-779289dbc107"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:54.573285 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.573167    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "92007659-eec7-47a8-97b9-779289dbc107" (UID: "92007659-eec7-47a8-97b9-779289dbc107"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:54.573409 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.573379    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "92007659-eec7-47a8-97b9-779289dbc107" (UID: "92007659-eec7-47a8-97b9-779289dbc107"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:54.573409 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.573388    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-istio-data\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:54.573409 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.573396    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "92007659-eec7-47a8-97b9-779289dbc107" (UID: "92007659-eec7-47a8-97b9-779289dbc107"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:54.573577 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.573412    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-workload-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:54.573577 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.573421    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92007659-eec7-47a8-97b9-779289dbc107-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "92007659-eec7-47a8-97b9-779289dbc107" (UID: "92007659-eec7-47a8-97b9-779289dbc107"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:23:54.575046 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.575014    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "92007659-eec7-47a8-97b9-779289dbc107" (UID: "92007659-eec7-47a8-97b9-779289dbc107"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:23:54.575202 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.575172    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92007659-eec7-47a8-97b9-779289dbc107-istio-token" (OuterVolumeSpecName: "istio-token") pod "92007659-eec7-47a8-97b9-779289dbc107" (UID: "92007659-eec7-47a8-97b9-779289dbc107"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:23:54.575281 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.575252    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92007659-eec7-47a8-97b9-779289dbc107-kube-api-access-x4fqk" (OuterVolumeSpecName: "kube-api-access-x4fqk") pod "92007659-eec7-47a8-97b9-779289dbc107" (UID: "92007659-eec7-47a8-97b9-779289dbc107"). InnerVolumeSpecName "kube-api-access-x4fqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:23:54.575281 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.575261    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92007659-eec7-47a8-97b9-779289dbc107-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "92007659-eec7-47a8-97b9-779289dbc107" (UID: "92007659-eec7-47a8-97b9-779289dbc107"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:23:54.603788 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.603760    2565 generic.go:356] "Generic (PLEG): container finished" podID="92007659-eec7-47a8-97b9-779289dbc107" containerID="904dc945d2a160cea963c6625b9da9afa46fea599ccc558e30dfce7b365b0f8f" exitCode=0
Aug 05 17:23:54.603934 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.603823    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"
Aug 05 17:23:54.603934 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.603843    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh" event={"ID":"92007659-eec7-47a8-97b9-779289dbc107","Type":"ContainerDied","Data":"904dc945d2a160cea963c6625b9da9afa46fea599ccc558e30dfce7b365b0f8f"}
Aug 05 17:23:54.603934 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.603900    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh" event={"ID":"92007659-eec7-47a8-97b9-779289dbc107","Type":"ContainerDied","Data":"d472352bea8d30c878db8ad9097328081273b882d2b77384fd5c013ab20acc42"}
Aug 05 17:23:54.603934 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.603924    2565 scope.go:117] "RemoveContainer" containerID="904dc945d2a160cea963c6625b9da9afa46fea599ccc558e30dfce7b365b0f8f"
Aug 05 17:23:54.613659 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.613639    2565 scope.go:117] "RemoveContainer" containerID="cb821a794b20e2df690fada3294743b6d15cba39501413b870314b00bc2b3b94"
Aug 05 17:23:54.621697 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.621674    2565 scope.go:117] "RemoveContainer" containerID="904dc945d2a160cea963c6625b9da9afa46fea599ccc558e30dfce7b365b0f8f"
Aug 05 17:23:54.621956 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:23:54.621936    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"904dc945d2a160cea963c6625b9da9afa46fea599ccc558e30dfce7b365b0f8f\": container with ID starting with 904dc945d2a160cea963c6625b9da9afa46fea599ccc558e30dfce7b365b0f8f not found: ID does not exist" containerID="904dc945d2a160cea963c6625b9da9afa46fea599ccc558e30dfce7b365b0f8f"
Aug 05 17:23:54.622036 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.621969    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"904dc945d2a160cea963c6625b9da9afa46fea599ccc558e30dfce7b365b0f8f"} err="failed to get container status \"904dc945d2a160cea963c6625b9da9afa46fea599ccc558e30dfce7b365b0f8f\": rpc error: code = NotFound desc = could not find container \"904dc945d2a160cea963c6625b9da9afa46fea599ccc558e30dfce7b365b0f8f\": container with ID starting with 904dc945d2a160cea963c6625b9da9afa46fea599ccc558e30dfce7b365b0f8f not found: ID does not exist"
Aug 05 17:23:54.622036 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.621992    2565 scope.go:117] "RemoveContainer" containerID="cb821a794b20e2df690fada3294743b6d15cba39501413b870314b00bc2b3b94"
Aug 05 17:23:54.622281 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:23:54.622263    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb821a794b20e2df690fada3294743b6d15cba39501413b870314b00bc2b3b94\": container with ID starting with cb821a794b20e2df690fada3294743b6d15cba39501413b870314b00bc2b3b94 not found: ID does not exist" containerID="cb821a794b20e2df690fada3294743b6d15cba39501413b870314b00bc2b3b94"
Aug 05 17:23:54.622354 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.622285    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb821a794b20e2df690fada3294743b6d15cba39501413b870314b00bc2b3b94"} err="failed to get container status \"cb821a794b20e2df690fada3294743b6d15cba39501413b870314b00bc2b3b94\": rpc error: code = NotFound desc = could not find container \"cb821a794b20e2df690fada3294743b6d15cba39501413b870314b00bc2b3b94\": container with ID starting with cb821a794b20e2df690fada3294743b6d15cba39501413b870314b00bc2b3b94 not found: ID does not exist"
Aug 05 17:23:54.633292 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.633269    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"]
Aug 05 17:23:54.635340 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.635322    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-2db124-openshift-default-758c49c87b-62pqh"]
Aug 05 17:23:54.673979 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.673944    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-workload-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:54.673979 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.673973    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-credential-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:54.674208 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.673989    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92007659-eec7-47a8-97b9-779289dbc107-istio-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:54.674208 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.674003    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4fqk\" (UniqueName: \"kubernetes.io/projected/92007659-eec7-47a8-97b9-779289dbc107-kube-api-access-x4fqk\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:54.674208 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.674017    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92007659-eec7-47a8-97b9-779289dbc107-istio-podinfo\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:54.674208 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.674028    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92007659-eec7-47a8-97b9-779289dbc107-istiod-ca-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:54.674208 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:54.674039    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92007659-eec7-47a8-97b9-779289dbc107-istio-envoy\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:23:55.952643 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:23:55.952609    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92007659-eec7-47a8-97b9-779289dbc107" path="/var/lib/kubelet/pods/92007659-eec7-47a8-97b9-779289dbc107/volumes"
Aug 05 17:24:07.593421 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:07.593338    2565 patch_prober.go:28] interesting pod/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Aug 05 17:24:07.593421 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:07.593408    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j" podUID="f268f3c9-3af3-4933-a0db-be2255944286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Aug 05 17:24:07.691278 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:07.691249    2565 generic.go:356] "Generic (PLEG): container finished" podID="f268f3c9-3af3-4933-a0db-be2255944286" containerID="6f61c6303912503b1c390322ab6b5147bb17a6c6283d1c55092722ea47c07100" exitCode=0
Aug 05 17:24:07.691443 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:07.691325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j" event={"ID":"f268f3c9-3af3-4933-a0db-be2255944286","Type":"ContainerDied","Data":"6f61c6303912503b1c390322ab6b5147bb17a6c6283d1c55092722ea47c07100"}
Aug 05 17:24:07.691742 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:07.691728    2565 scope.go:117] "RemoveContainer" containerID="6f61c6303912503b1c390322ab6b5147bb17a6c6283d1c55092722ea47c07100"
Aug 05 17:24:07.692755 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:07.692728    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:24:07.692804 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:07.692797    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:24:07.692846 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:07.692828    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:24:08.699017 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:08.698986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j" event={"ID":"f268f3c9-3af3-4933-a0db-be2255944286","Type":"ContainerStarted","Data":"76cb940b32c9f8bcbfac3e176d764ae27eb90c01b6094f4f19073c4198919503"}
Aug 05 17:24:09.457168 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:09.457121    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:24:09.457418 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:09.457392    2565 patch_prober.go:28] interesting pod/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Aug 05 17:24:09.457473 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:09.457446    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j" podUID="f268f3c9-3af3-4933-a0db-be2255944286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Aug 05 17:24:10.455485 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:10.455439    2565 patch_prober.go:28] interesting pod/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Aug 05 17:24:10.455990 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:10.455522    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j" podUID="f268f3c9-3af3-4933-a0db-be2255944286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Aug 05 17:24:11.455856 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:11.455809    2565 patch_prober.go:28] interesting pod/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Aug 05 17:24:11.456405 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:11.455883    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j" podUID="f268f3c9-3af3-4933-a0db-be2255944286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Aug 05 17:24:12.455882 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:12.455833    2565 patch_prober.go:28] interesting pod/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Aug 05 17:24:12.456399 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:12.455916    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j" podUID="f268f3c9-3af3-4933-a0db-be2255944286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Aug 05 17:24:13.455170 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:13.455121    2565 patch_prober.go:28] interesting pod/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Aug 05 17:24:13.455390 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:13.455196    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j" podUID="f268f3c9-3af3-4933-a0db-be2255944286" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Aug 05 17:24:14.459732 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:14.459702    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:24:14.460145 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:14.460073    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:24:14.460717 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:14.460694    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:24:24.309423 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.309384    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"]
Aug 05 17:24:24.309822 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.309763    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e625a83-5921-4004-8831-6a14ed003385" containerName="istio-proxy"
Aug 05 17:24:24.309822 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.309776    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e625a83-5921-4004-8831-6a14ed003385" containerName="istio-proxy"
Aug 05 17:24:24.309822 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.309788    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92007659-eec7-47a8-97b9-779289dbc107" containerName="istio-proxy"
Aug 05 17:24:24.309822 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.309797    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="92007659-eec7-47a8-97b9-779289dbc107" containerName="istio-proxy"
Aug 05 17:24:24.309822 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.309819    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92007659-eec7-47a8-97b9-779289dbc107" containerName="istio-proxy"
Aug 05 17:24:24.309822 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.309825    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="92007659-eec7-47a8-97b9-779289dbc107" containerName="istio-proxy"
Aug 05 17:24:24.310035 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.309883    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="92007659-eec7-47a8-97b9-779289dbc107" containerName="istio-proxy"
Aug 05 17:24:24.310035 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.309891    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="92007659-eec7-47a8-97b9-779289dbc107" containerName="istio-proxy"
Aug 05 17:24:24.313489 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.313473    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.316225 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.316206    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-a81ee3-openshift-default-dockercfg-hqnn5\""
Aug 05 17:24:24.321729 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.321075    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"]
Aug 05 17:24:24.345342 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.345310    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2014bb1a-4547-4455-afc8-5acd99344db4-istiod-ca-cert\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.345342 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.345346    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-istio-data\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.345553 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.345365    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-workload-certs\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.345553 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.345390    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-credential-socket\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.345553 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.345453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-istio-envoy\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.345553 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.345470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-workload-socket\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.345553 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.345492    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2014bb1a-4547-4455-afc8-5acd99344db4-istio-podinfo\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.345553 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.345509    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mk2v\" (UniqueName: \"kubernetes.io/projected/2014bb1a-4547-4455-afc8-5acd99344db4-kube-api-access-5mk2v\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.345766 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.345634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2014bb1a-4547-4455-afc8-5acd99344db4-istio-token\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.446517 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.446479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2014bb1a-4547-4455-afc8-5acd99344db4-istio-token\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.446705 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.446532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2014bb1a-4547-4455-afc8-5acd99344db4-istiod-ca-cert\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.446705 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.446556    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-istio-data\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.446705 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.446575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-workload-certs\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.446705 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.446604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-credential-socket\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.446705 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.446650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-istio-envoy\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.446705 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.446678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-workload-socket\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.447045 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.446712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2014bb1a-4547-4455-afc8-5acd99344db4-istio-podinfo\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.447045 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.446737    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mk2v\" (UniqueName: \"kubernetes.io/projected/2014bb1a-4547-4455-afc8-5acd99344db4-kube-api-access-5mk2v\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.447045 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.447023    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-credential-socket\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.447229 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.447203    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-istio-data\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.447287 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.447276    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-workload-certs\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.447342 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.447250    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-workload-socket\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.447621 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.447598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2014bb1a-4547-4455-afc8-5acd99344db4-istiod-ca-cert\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.449041 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.449015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-istio-envoy\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.449443 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.449425    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2014bb1a-4547-4455-afc8-5acd99344db4-istio-podinfo\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.456272 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.456249    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2014bb1a-4547-4455-afc8-5acd99344db4-istio-token\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.456587 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.456562    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mk2v\" (UniqueName: \"kubernetes.io/projected/2014bb1a-4547-4455-afc8-5acd99344db4-kube-api-access-5mk2v\") pod \"e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") " pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.626207 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.626114    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:24.773046 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.773021    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"]
Aug 05 17:24:24.774713 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:24:24.774670    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2014bb1a_4547_4455_afc8_5acd99344db4.slice/crio-3dedee807766f428ee4548ad2e2208beab99ce2487123c2cf3f93a43b53976d4 WatchSource:0}: Error finding container 3dedee807766f428ee4548ad2e2208beab99ce2487123c2cf3f93a43b53976d4: Status 404 returned error can't find the container with id 3dedee807766f428ee4548ad2e2208beab99ce2487123c2cf3f93a43b53976d4
Aug 05 17:24:24.777020 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.776982    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:24:24.777161 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.777062    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:24:24.777161 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.777132    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:24:24.784550 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:24.784524    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx" event={"ID":"2014bb1a-4547-4455-afc8-5acd99344db4","Type":"ContainerStarted","Data":"3dedee807766f428ee4548ad2e2208beab99ce2487123c2cf3f93a43b53976d4"}
Aug 05 17:24:25.791462 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:25.791427    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx" event={"ID":"2014bb1a-4547-4455-afc8-5acd99344db4","Type":"ContainerStarted","Data":"fb328e519d2592aa4e1160b13b9915f8d69580d5445e482e453def0b0b759300"}
Aug 05 17:24:25.816792 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:25.816736    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx" podStartSLOduration=1.816719949 podStartE2EDuration="1.816719949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:25.815025577 +0000 UTC m=+2738.397097258" watchObservedRunningTime="2026-08-05 17:24:25.816719949 +0000 UTC m=+2738.398791604"
Aug 05 17:24:26.626778 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:26.626743    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:26.632394 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:26.632364    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:26.797832 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:26.797800    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:26.798729 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:26.798712    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:41.799546 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:41.799514    2565 patch_prober.go:28] interesting pod/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Aug 05 17:24:41.799957 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:41.799575    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx" podUID="2014bb1a-4547-4455-afc8-5acd99344db4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Aug 05 17:24:41.899797 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:41.899766    2565 generic.go:356] "Generic (PLEG): container finished" podID="2014bb1a-4547-4455-afc8-5acd99344db4" containerID="fb328e519d2592aa4e1160b13b9915f8d69580d5445e482e453def0b0b759300" exitCode=0
Aug 05 17:24:41.899974 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:41.899845    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx" event={"ID":"2014bb1a-4547-4455-afc8-5acd99344db4","Type":"ContainerDied","Data":"fb328e519d2592aa4e1160b13b9915f8d69580d5445e482e453def0b0b759300"}
Aug 05 17:24:41.900336 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:41.900322    2565 scope.go:117] "RemoveContainer" containerID="fb328e519d2592aa4e1160b13b9915f8d69580d5445e482e453def0b0b759300"
Aug 05 17:24:41.901325 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:41.901298    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:24:41.901391 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:41.901363    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:24:41.901429 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:41.901403    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:24:42.906764 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:42.906731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx" event={"ID":"2014bb1a-4547-4455-afc8-5acd99344db4","Type":"ContainerStarted","Data":"60893c138594cfe86c5f01bd11991dcc2aa6912ebd0980ee5f4823db11f2eaea"}
Aug 05 17:24:43.627173 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:43.627134    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:43.627371 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:43.627346    2565 patch_prober.go:28] interesting pod/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Aug 05 17:24:43.627436 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:43.627415    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx" podUID="2014bb1a-4547-4455-afc8-5acd99344db4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Aug 05 17:24:44.627414 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:44.627377    2565 patch_prober.go:28] interesting pod/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Aug 05 17:24:44.627849 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:44.627448    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx" podUID="2014bb1a-4547-4455-afc8-5acd99344db4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Aug 05 17:24:45.627494 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:45.627449    2565 patch_prober.go:28] interesting pod/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Aug 05 17:24:45.627982 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:45.627504    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx" podUID="2014bb1a-4547-4455-afc8-5acd99344db4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Aug 05 17:24:46.626676 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:46.626634    2565 patch_prober.go:28] interesting pod/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Aug 05 17:24:46.626866 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:46.626693    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx" podUID="2014bb1a-4547-4455-afc8-5acd99344db4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Aug 05 17:24:47.627152 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:47.627116    2565 patch_prober.go:28] interesting pod/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Aug 05 17:24:47.627561 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:47.627176    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx" podUID="2014bb1a-4547-4455-afc8-5acd99344db4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Aug 05 17:24:48.631273 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:48.631240    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:48.631740 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:48.631680    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:24:48.632254 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:24:48.632233    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:29:48.434665 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:29:48.434632    2565 scope.go:117] "RemoveContainer" containerID="42b31e013e85b03ffa5ca44acddf328e77c4d1b742c1aea1ddf225d4e082df5e"
Aug 05 17:30:00.144850 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:00.144814    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a1e09f-29765850-cvxcw"]
Aug 05 17:30:00.148300 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:00.148280    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a1e09f-29765850-cvxcw"
Aug 05 17:30:00.152280 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:00.152260    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cldbs\""
Aug 05 17:30:00.157491 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:00.157474    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a1e09f-29765850-cvxcw"
Aug 05 17:30:00.182798 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:00.182730    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a1e09f-29765850-cvxcw"]
Aug 05 17:30:00.508057 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:00.508027    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a1e09f-29765850-cvxcw"]
Aug 05 17:30:00.508879 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:30:00.508856    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3cc85cb_af7d_4bec_865e_0c1ece6b0427.slice/crio-d1cd0f1e351d633fff76b078fed8464979b9cd135497e45f11db9af48948c2aa WatchSource:0}: Error finding container d1cd0f1e351d633fff76b078fed8464979b9cd135497e45f11db9af48948c2aa: Status 404 returned error can't find the container with id d1cd0f1e351d633fff76b078fed8464979b9cd135497e45f11db9af48948c2aa
Aug 05 17:30:00.611426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:00.611396    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a1e09f-29765850-cvxcw" event={"ID":"a3cc85cb-af7d-4bec-865e-0c1ece6b0427","Type":"ContainerStarted","Data":"d1cd0f1e351d633fff76b078fed8464979b9cd135497e45f11db9af48948c2aa"}
Aug 05 17:30:01.617554 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:01.617522    2565 generic.go:356] "Generic (PLEG): container finished" podID="a3cc85cb-af7d-4bec-865e-0c1ece6b0427" containerID="1b101070eef462cc20888f7123e5b6c4e0952cd556638293db9aee4bd6571444" exitCode=0
Aug 05 17:30:01.617928 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:01.617603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a1e09f-29765850-cvxcw" event={"ID":"a3cc85cb-af7d-4bec-865e-0c1ece6b0427","Type":"ContainerDied","Data":"1b101070eef462cc20888f7123e5b6c4e0952cd556638293db9aee4bd6571444"}
Aug 05 17:30:02.757085 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:02.757059    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a1e09f-29765850-cvxcw"
Aug 05 17:30:03.628743 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:03.628708    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a1e09f-29765850-cvxcw" event={"ID":"a3cc85cb-af7d-4bec-865e-0c1ece6b0427","Type":"ContainerDied","Data":"d1cd0f1e351d633fff76b078fed8464979b9cd135497e45f11db9af48948c2aa"}
Aug 05 17:30:03.628946 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:03.628764    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1cd0f1e351d633fff76b078fed8464979b9cd135497e45f11db9af48948c2aa"
Aug 05 17:30:03.628946 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:03.628718    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a1e09f-29765850-cvxcw"
Aug 05 17:30:54.299365 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.299331    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"]
Aug 05 17:30:54.299940 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.299914    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3cc85cb-af7d-4bec-865e-0c1ece6b0427" containerName="cleanup"
Aug 05 17:30:54.299994 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.299953    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3cc85cb-af7d-4bec-865e-0c1ece6b0427" containerName="cleanup"
Aug 05 17:30:54.300073 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.300062    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3cc85cb-af7d-4bec-865e-0c1ece6b0427" containerName="cleanup"
Aug 05 17:30:54.303862 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.303833    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.307366 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.307344    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a81ee3\"/\"kube-root-ca.crt\""
Aug 05 17:30:54.308443 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.308424    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a81ee3\"/\"default-dockercfg-46qzr\""
Aug 05 17:30:54.308559 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.308482    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a81ee3\"/\"openshift-service-ca.crt\""
Aug 05 17:30:54.308559 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.308482    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a81ee3\"/\"sub-test-model-a81ee3-kserve-self-signed-certs\""
Aug 05 17:30:54.315028 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.315008    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"]
Aug 05 17:30:54.421974 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.421933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-tls-certs\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.421974 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.421978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2hmn\" (UniqueName: \"kubernetes.io/projected/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-kube-api-access-q2hmn\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.422265 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.422039    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-dshm\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.422265 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.422180    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-model-cache\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.422265 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.422211    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-tmp-dir\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.422265 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.422251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-home\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.523302 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.523269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-home\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.523473 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.523327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-tls-certs\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.523473 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.523437    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2hmn\" (UniqueName: \"kubernetes.io/projected/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-kube-api-access-q2hmn\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.523559 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.523486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-dshm\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.523559 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.523540    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-model-cache\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.523664 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.523560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-tmp-dir\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.523719 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.523653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-home\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.523857 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.523836    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-tmp-dir\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.523927 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.523855    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-model-cache\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.525698 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.525672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-dshm\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.525835 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.525820    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-tls-certs\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.532891 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.532865    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2hmn\" (UniqueName: \"kubernetes.io/projected/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-kube-api-access-q2hmn\") pod \"sub-test-model-a81ee3-kserve-645bd89865-m95fk\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") " pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.615021 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.614947    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:30:54.747430 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.747403    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"]
Aug 05 17:30:54.753812 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:30:54.751243    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf9df5a3_2c12_4cfd_980f_1b055cb68afd.slice/crio-37c6849e6a1f96ca5fd363adb337a67c4d5bdff2519f52c7e4e22592afdc2aa8 WatchSource:0}: Error finding container 37c6849e6a1f96ca5fd363adb337a67c4d5bdff2519f52c7e4e22592afdc2aa8: Status 404 returned error can't find the container with id 37c6849e6a1f96ca5fd363adb337a67c4d5bdff2519f52c7e4e22592afdc2aa8
Aug 05 17:30:54.916156 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.916046    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk" event={"ID":"cf9df5a3-2c12-4cfd-980f-1b055cb68afd","Type":"ContainerStarted","Data":"dc8119cca009b2829ebdd7c418915e81dd6ed0f6aee6a038aa909185ceadd834"}
Aug 05 17:30:54.916156 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.916089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk" event={"ID":"cf9df5a3-2c12-4cfd-980f-1b055cb68afd","Type":"ContainerStarted","Data":"37c6849e6a1f96ca5fd363adb337a67c4d5bdff2519f52c7e4e22592afdc2aa8"}
Aug 05 17:30:54.941846 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:30:54.941800    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk" podStartSLOduration=0.941780152 podStartE2EDuration="941.780152ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:30:54.939621285 +0000 UTC m=+3127.521692942" watchObservedRunningTime="2026-08-05 17:30:54.941780152 +0000 UTC m=+3127.523851809"
Aug 05 17:31:04.615517 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:31:04.615483    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:31:04.616089 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:31:04.615531    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:31:04.627924 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:31:04.627900    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:31:04.981940 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:31:04.981853    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:32:14.484506 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:14.484472    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"]
Aug 05 17:32:29.503139 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.503078    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk" podUID="cf9df5a3-2c12-4cfd-980f-1b055cb68afd" containerName="main" containerID="cri-o://dc8119cca009b2829ebdd7c418915e81dd6ed0f6aee6a038aa909185ceadd834" gracePeriod=45
Aug 05 17:32:29.760628 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.760564    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:32:29.869324 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.869289    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-tls-certs\") pod \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") "
Aug 05 17:32:29.869497 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.869342    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-dshm\") pod \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") "
Aug 05 17:32:29.869497 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.869370    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-tmp-dir\") pod \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") "
Aug 05 17:32:29.869497 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.869419    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-model-cache\") pod \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") "
Aug 05 17:32:29.869497 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.869456    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-home\") pod \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") "
Aug 05 17:32:29.869730 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.869505    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2hmn\" (UniqueName: \"kubernetes.io/projected/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-kube-api-access-q2hmn\") pod \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\" (UID: \"cf9df5a3-2c12-4cfd-980f-1b055cb68afd\") "
Aug 05 17:32:29.869730 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.869679    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-model-cache" (OuterVolumeSpecName: "model-cache") pod "cf9df5a3-2c12-4cfd-980f-1b055cb68afd" (UID: "cf9df5a3-2c12-4cfd-980f-1b055cb68afd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:32:29.869824 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.869708    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cf9df5a3-2c12-4cfd-980f-1b055cb68afd" (UID: "cf9df5a3-2c12-4cfd-980f-1b055cb68afd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:32:29.869824 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.869779    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-home" (OuterVolumeSpecName: "home") pod "cf9df5a3-2c12-4cfd-980f-1b055cb68afd" (UID: "cf9df5a3-2c12-4cfd-980f-1b055cb68afd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:32:29.869824 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.869802    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-model-cache\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:32:29.871628 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.871599    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cf9df5a3-2c12-4cfd-980f-1b055cb68afd" (UID: "cf9df5a3-2c12-4cfd-980f-1b055cb68afd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:32:29.871743 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.871650    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-dshm" (OuterVolumeSpecName: "dshm") pod "cf9df5a3-2c12-4cfd-980f-1b055cb68afd" (UID: "cf9df5a3-2c12-4cfd-980f-1b055cb68afd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:32:29.871743 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.871649    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-kube-api-access-q2hmn" (OuterVolumeSpecName: "kube-api-access-q2hmn") pod "cf9df5a3-2c12-4cfd-980f-1b055cb68afd" (UID: "cf9df5a3-2c12-4cfd-980f-1b055cb68afd"). InnerVolumeSpecName "kube-api-access-q2hmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:32:29.971217 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.971190    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-home\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:32:29.971217 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.971216    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2hmn\" (UniqueName: \"kubernetes.io/projected/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-kube-api-access-q2hmn\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:32:29.971390 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.971231    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-tls-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:32:29.971390 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.971244    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-dshm\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:32:29.971390 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:29.971256    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf9df5a3-2c12-4cfd-980f-1b055cb68afd-tmp-dir\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:32:30.435177 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:30.435142    2565 generic.go:356] "Generic (PLEG): container finished" podID="cf9df5a3-2c12-4cfd-980f-1b055cb68afd" containerID="dc8119cca009b2829ebdd7c418915e81dd6ed0f6aee6a038aa909185ceadd834" exitCode=0
Aug 05 17:32:30.435347 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:30.435195    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"
Aug 05 17:32:30.435347 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:30.435213    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk" event={"ID":"cf9df5a3-2c12-4cfd-980f-1b055cb68afd","Type":"ContainerDied","Data":"dc8119cca009b2829ebdd7c418915e81dd6ed0f6aee6a038aa909185ceadd834"}
Aug 05 17:32:30.435347 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:30.435251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk" event={"ID":"cf9df5a3-2c12-4cfd-980f-1b055cb68afd","Type":"ContainerDied","Data":"37c6849e6a1f96ca5fd363adb337a67c4d5bdff2519f52c7e4e22592afdc2aa8"}
Aug 05 17:32:30.435347 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:30.435273    2565 scope.go:117] "RemoveContainer" containerID="dc8119cca009b2829ebdd7c418915e81dd6ed0f6aee6a038aa909185ceadd834"
Aug 05 17:32:30.445345 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:30.445327    2565 scope.go:117] "RemoveContainer" containerID="dc8119cca009b2829ebdd7c418915e81dd6ed0f6aee6a038aa909185ceadd834"
Aug 05 17:32:30.445605 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:32:30.445581    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc8119cca009b2829ebdd7c418915e81dd6ed0f6aee6a038aa909185ceadd834\": container with ID starting with dc8119cca009b2829ebdd7c418915e81dd6ed0f6aee6a038aa909185ceadd834 not found: ID does not exist" containerID="dc8119cca009b2829ebdd7c418915e81dd6ed0f6aee6a038aa909185ceadd834"
Aug 05 17:32:30.445677 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:30.445610    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc8119cca009b2829ebdd7c418915e81dd6ed0f6aee6a038aa909185ceadd834"} err="failed to get container status \"dc8119cca009b2829ebdd7c418915e81dd6ed0f6aee6a038aa909185ceadd834\": rpc error: code = NotFound desc = could not find container \"dc8119cca009b2829ebdd7c418915e81dd6ed0f6aee6a038aa909185ceadd834\": container with ID starting with dc8119cca009b2829ebdd7c418915e81dd6ed0f6aee6a038aa909185ceadd834 not found: ID does not exist"
Aug 05 17:32:30.454793 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:30.454767    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"]
Aug 05 17:32:30.458701 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:30.458680    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/sub-test-model-a81ee3-kserve-645bd89865-m95fk"]
Aug 05 17:32:31.953670 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:31.953635    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf9df5a3-2c12-4cfd-980f-1b055cb68afd" path="/var/lib/kubelet/pods/cf9df5a3-2c12-4cfd-980f-1b055cb68afd/volumes"
Aug 05 17:32:51.427540 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.427505    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"]
Aug 05 17:32:51.428052 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.427874    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf9df5a3-2c12-4cfd-980f-1b055cb68afd" containerName="main"
Aug 05 17:32:51.428052 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.427886    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf9df5a3-2c12-4cfd-980f-1b055cb68afd" containerName="main"
Aug 05 17:32:51.428052 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.427958    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf9df5a3-2c12-4cfd-980f-1b055cb68afd" containerName="main"
Aug 05 17:32:51.431878 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.431858    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.437446 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.437420    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a81ee3\"/\"openshift-service-ca.crt\""
Aug 05 17:32:51.437825 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.437804    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a81ee3\"/\"default-dockercfg-46qzr\""
Aug 05 17:32:51.438629 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.438495    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a81ee3\"/\"rate-test-model-a81ee3-kserve-self-signed-certs\""
Aug 05 17:32:51.438629 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.438527    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a81ee3\"/\"kube-root-ca.crt\""
Aug 05 17:32:51.444617 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.444587    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"]
Aug 05 17:32:51.445803 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.445779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24bb5924-66bf-47b2-952d-fd0e1e900f7d-tls-certs\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.445916 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.445837    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-home\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.445916 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.445864    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-tmp-dir\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.446045 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.445961    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-dshm\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.446045 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.446001    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-model-cache\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.446251 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.446055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf7tk\" (UniqueName: \"kubernetes.io/projected/24bb5924-66bf-47b2-952d-fd0e1e900f7d-kube-api-access-zf7tk\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.546781 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.546749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-home\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.546781 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.546784    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-tmp-dir\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.547007 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.546909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-dshm\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.547007 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.546943    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-model-cache\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.547007 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.546996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf7tk\" (UniqueName: \"kubernetes.io/projected/24bb5924-66bf-47b2-952d-fd0e1e900f7d-kube-api-access-zf7tk\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.547223 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.547118    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-home\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.547223 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.547154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24bb5924-66bf-47b2-952d-fd0e1e900f7d-tls-certs\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.547223 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.547181    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-tmp-dir\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.547374 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.547352    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-model-cache\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.549514 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.549482    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-dshm\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.549679 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.549657    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24bb5924-66bf-47b2-952d-fd0e1e900f7d-tls-certs\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.557559 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.557535    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf7tk\" (UniqueName: \"kubernetes.io/projected/24bb5924-66bf-47b2-952d-fd0e1e900f7d-kube-api-access-zf7tk\") pod \"rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") " pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.741411 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.741326    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:32:51.880541 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:51.880513    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"]
Aug 05 17:32:51.881952 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:32:51.881924    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24bb5924_66bf_47b2_952d_fd0e1e900f7d.slice/crio-b12f4945115c5572e5090497ddb993ce5fb8c756a4c5384f8a9849b6d55b0cdd WatchSource:0}: Error finding container b12f4945115c5572e5090497ddb993ce5fb8c756a4c5384f8a9849b6d55b0cdd: Status 404 returned error can't find the container with id b12f4945115c5572e5090497ddb993ce5fb8c756a4c5384f8a9849b6d55b0cdd
Aug 05 17:32:52.561714 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:52.561679    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl" event={"ID":"24bb5924-66bf-47b2-952d-fd0e1e900f7d","Type":"ContainerStarted","Data":"d7a1e73026395e4fa37e47ccfa3773e644e992951a4c2921a88d33dde0d0b524"}
Aug 05 17:32:52.562083 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:52.561727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl" event={"ID":"24bb5924-66bf-47b2-952d-fd0e1e900f7d","Type":"ContainerStarted","Data":"b12f4945115c5572e5090497ddb993ce5fb8c756a4c5384f8a9849b6d55b0cdd"}
Aug 05 17:32:52.586839 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:32:52.586785    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl" podStartSLOduration=1.586770321 podStartE2EDuration="1.586770321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:32:52.585066712 +0000 UTC m=+3245.167138369" watchObservedRunningTime="2026-08-05 17:32:52.586770321 +0000 UTC m=+3245.168842035"
Aug 05 17:33:01.742437 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:33:01.742393    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:33:01.742843 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:33:01.742452    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:33:01.755250 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:33:01.755228    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:33:02.630999 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:33:02.630967    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:34:02.186413 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:02.186383    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"]
Aug 05 17:34:17.204924 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.204843    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl" podUID="24bb5924-66bf-47b2-952d-fd0e1e900f7d" containerName="main" containerID="cri-o://d7a1e73026395e4fa37e47ccfa3773e644e992951a4c2921a88d33dde0d0b524" gracePeriod=45
Aug 05 17:34:17.449508 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.449484    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:34:17.543974 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.543882    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-home\") pod \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") "
Aug 05 17:34:17.543974 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.543949    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-model-cache\") pod \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") "
Aug 05 17:34:17.544245 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.543980    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24bb5924-66bf-47b2-952d-fd0e1e900f7d-tls-certs\") pod \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") "
Aug 05 17:34:17.544245 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.544010    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-tmp-dir\") pod \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") "
Aug 05 17:34:17.544245 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.544049    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-dshm\") pod \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") "
Aug 05 17:34:17.544245 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.544138    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zf7tk\" (UniqueName: \"kubernetes.io/projected/24bb5924-66bf-47b2-952d-fd0e1e900f7d-kube-api-access-zf7tk\") pod \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\" (UID: \"24bb5924-66bf-47b2-952d-fd0e1e900f7d\") "
Aug 05 17:34:17.544245 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.544213    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-home" (OuterVolumeSpecName: "home") pod "24bb5924-66bf-47b2-952d-fd0e1e900f7d" (UID: "24bb5924-66bf-47b2-952d-fd0e1e900f7d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:34:17.544245 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.544233    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-model-cache" (OuterVolumeSpecName: "model-cache") pod "24bb5924-66bf-47b2-952d-fd0e1e900f7d" (UID: "24bb5924-66bf-47b2-952d-fd0e1e900f7d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:34:17.544533 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.544306    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "24bb5924-66bf-47b2-952d-fd0e1e900f7d" (UID: "24bb5924-66bf-47b2-952d-fd0e1e900f7d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:34:17.544533 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.544436    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-tmp-dir\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:34:17.544533 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.544456    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-home\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:34:17.544533 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.544471    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-model-cache\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:34:17.546165 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.546143    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-dshm" (OuterVolumeSpecName: "dshm") pod "24bb5924-66bf-47b2-952d-fd0e1e900f7d" (UID: "24bb5924-66bf-47b2-952d-fd0e1e900f7d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:34:17.546264 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.546165    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24bb5924-66bf-47b2-952d-fd0e1e900f7d-kube-api-access-zf7tk" (OuterVolumeSpecName: "kube-api-access-zf7tk") pod "24bb5924-66bf-47b2-952d-fd0e1e900f7d" (UID: "24bb5924-66bf-47b2-952d-fd0e1e900f7d"). InnerVolumeSpecName "kube-api-access-zf7tk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:34:17.546264 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.546214    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24bb5924-66bf-47b2-952d-fd0e1e900f7d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "24bb5924-66bf-47b2-952d-fd0e1e900f7d" (UID: "24bb5924-66bf-47b2-952d-fd0e1e900f7d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:34:17.645176 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.645148    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24bb5924-66bf-47b2-952d-fd0e1e900f7d-dshm\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:34:17.645176 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.645170    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf7tk\" (UniqueName: \"kubernetes.io/projected/24bb5924-66bf-47b2-952d-fd0e1e900f7d-kube-api-access-zf7tk\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:34:17.645176 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:17.645180    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24bb5924-66bf-47b2-952d-fd0e1e900f7d-tls-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:34:18.025191 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:18.025158    2565 generic.go:356] "Generic (PLEG): container finished" podID="24bb5924-66bf-47b2-952d-fd0e1e900f7d" containerID="d7a1e73026395e4fa37e47ccfa3773e644e992951a4c2921a88d33dde0d0b524" exitCode=0
Aug 05 17:34:18.025368 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:18.025200    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"
Aug 05 17:34:18.025368 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:18.025240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl" event={"ID":"24bb5924-66bf-47b2-952d-fd0e1e900f7d","Type":"ContainerDied","Data":"d7a1e73026395e4fa37e47ccfa3773e644e992951a4c2921a88d33dde0d0b524"}
Aug 05 17:34:18.025368 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:18.025280    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl" event={"ID":"24bb5924-66bf-47b2-952d-fd0e1e900f7d","Type":"ContainerDied","Data":"b12f4945115c5572e5090497ddb993ce5fb8c756a4c5384f8a9849b6d55b0cdd"}
Aug 05 17:34:18.025368 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:18.025301    2565 scope.go:117] "RemoveContainer" containerID="d7a1e73026395e4fa37e47ccfa3773e644e992951a4c2921a88d33dde0d0b524"
Aug 05 17:34:18.034221 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:18.034197    2565 scope.go:117] "RemoveContainer" containerID="d7a1e73026395e4fa37e47ccfa3773e644e992951a4c2921a88d33dde0d0b524"
Aug 05 17:34:18.034479 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:34:18.034459    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7a1e73026395e4fa37e47ccfa3773e644e992951a4c2921a88d33dde0d0b524\": container with ID starting with d7a1e73026395e4fa37e47ccfa3773e644e992951a4c2921a88d33dde0d0b524 not found: ID does not exist" containerID="d7a1e73026395e4fa37e47ccfa3773e644e992951a4c2921a88d33dde0d0b524"
Aug 05 17:34:18.034543 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:18.034488    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7a1e73026395e4fa37e47ccfa3773e644e992951a4c2921a88d33dde0d0b524"} err="failed to get container status \"d7a1e73026395e4fa37e47ccfa3773e644e992951a4c2921a88d33dde0d0b524\": rpc error: code = NotFound desc = could not find container \"d7a1e73026395e4fa37e47ccfa3773e644e992951a4c2921a88d33dde0d0b524\": container with ID starting with d7a1e73026395e4fa37e47ccfa3773e644e992951a4c2921a88d33dde0d0b524 not found: ID does not exist"
Aug 05 17:34:18.042732 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:18.042708    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"]
Aug 05 17:34:18.046627 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:18.046607    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a81ee3/rate-test-model-a81ee3-kserve-6d7987fb7-nm9nl"]
Aug 05 17:34:19.952949 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:19.952915    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24bb5924-66bf-47b2-952d-fd0e1e900f7d" path="/var/lib/kubelet/pods/24bb5924-66bf-47b2-952d-fd0e1e900f7d/volumes"
Aug 05 17:34:22.345531 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.345493    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"]
Aug 05 17:34:22.346108 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.346072    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24bb5924-66bf-47b2-952d-fd0e1e900f7d" containerName="main"
Aug 05 17:34:22.346205 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.346114    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="24bb5924-66bf-47b2-952d-fd0e1e900f7d" containerName="main"
Aug 05 17:34:22.346269 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.346223    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="24bb5924-66bf-47b2-952d-fd0e1e900f7d" containerName="main"
Aug 05 17:34:22.351153 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.351134    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.353605 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.353585    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-09e18b-openshift-default-dockercfg-4vpj6\""
Aug 05 17:34:22.363042 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.363011    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"]
Aug 05 17:34:22.376566 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.376543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c73d51b6-562e-4f16-a276-285a98773c4f-istio-token\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.376694 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.376584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c73d51b6-562e-4f16-a276-285a98773c4f-istio-podinfo\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.376694 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.376606    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-istio-data\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.376694 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.376660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-credential-socket\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.376694 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.376686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c73d51b6-562e-4f16-a276-285a98773c4f-istiod-ca-cert\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.376906 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.376786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-workload-socket\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.376906 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.376825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c275r\" (UniqueName: \"kubernetes.io/projected/c73d51b6-562e-4f16-a276-285a98773c4f-kube-api-access-c275r\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.376906 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.376891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-workload-certs\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.377018 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.376942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-istio-envoy\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.477859 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.477826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c73d51b6-562e-4f16-a276-285a98773c4f-istio-token\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.478199 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.477873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c73d51b6-562e-4f16-a276-285a98773c4f-istio-podinfo\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.478199 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.477996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-istio-data\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.478199 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.478042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-credential-socket\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.478199 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.478070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c73d51b6-562e-4f16-a276-285a98773c4f-istiod-ca-cert\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.478199 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.478129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-workload-socket\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.478199 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.478158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c275r\" (UniqueName: \"kubernetes.io/projected/c73d51b6-562e-4f16-a276-285a98773c4f-kube-api-access-c275r\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.478552 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.478256    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-workload-certs\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.478552 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.478333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-istio-envoy\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.478552 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.478409    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-istio-data\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.478552 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.478507    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-credential-socket\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.478788 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.478569    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-workload-socket\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.478788 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.478732    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-workload-certs\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.478788 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.478752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c73d51b6-562e-4f16-a276-285a98773c4f-istiod-ca-cert\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.480326 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.480306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-istio-envoy\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.480427 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.480412    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c73d51b6-562e-4f16-a276-285a98773c4f-istio-podinfo\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.486797 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.486775    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c73d51b6-562e-4f16-a276-285a98773c4f-istio-token\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.487072 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.487051    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c275r\" (UniqueName: \"kubernetes.io/projected/c73d51b6-562e-4f16-a276-285a98773c4f-kube-api-access-c275r\") pod \"e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") " pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.662993 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.662907    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:22.804917 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.804891    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"]
Aug 05 17:34:22.807087 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:34:22.807063    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc73d51b6_562e_4f16_a276_285a98773c4f.slice/crio-03ca6b309b3a701a69312eb90f2a1df3adfa0fffe855b23a7c0f382f11c528ba WatchSource:0}: Error finding container 03ca6b309b3a701a69312eb90f2a1df3adfa0fffe855b23a7c0f382f11c528ba: Status 404 returned error can't find the container with id 03ca6b309b3a701a69312eb90f2a1df3adfa0fffe855b23a7c0f382f11c528ba
Aug 05 17:34:22.809213 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.809184    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:34:22.809288 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.809247    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:34:22.809288 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:22.809279    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:34:23.060909 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:23.060876    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt" event={"ID":"c73d51b6-562e-4f16-a276-285a98773c4f","Type":"ContainerStarted","Data":"1c38cf76066d503f159604bf39d6e2c59b9669e0f608c1bda94aac60fccf6f76"}
Aug 05 17:34:23.061111 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:23.060930    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt" event={"ID":"c73d51b6-562e-4f16-a276-285a98773c4f","Type":"ContainerStarted","Data":"03ca6b309b3a701a69312eb90f2a1df3adfa0fffe855b23a7c0f382f11c528ba"}
Aug 05 17:34:23.086367 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:23.086312    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt" podStartSLOduration=1.08629486 podStartE2EDuration="1.08629486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:34:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:23.083225643 +0000 UTC m=+3335.665297291" watchObservedRunningTime="2026-08-05 17:34:23.08629486 +0000 UTC m=+3335.668366516"
Aug 05 17:34:23.663639 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:23.663602    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:23.668796 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:23.668769    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:24.066516 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:24.066482    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:24.067526 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:24.067502    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:27.134114 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:27.133776    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"]
Aug 05 17:34:27.138115 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:27.138072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"
Aug 05 17:34:27.140739 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:27.140719    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-09e18b-dockercfg-xgtlf\""
Aug 05 17:34:27.140872 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:27.140752    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-09e18b\""
Aug 05 17:34:27.151295 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:27.151270    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"]
Aug 05 17:34:27.226856 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:27.226816    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4e04fc3-7513-401d-8d81-366a7164a217-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw\" (UID: \"d4e04fc3-7513-401d-8d81-366a7164a217\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"
Aug 05 17:34:27.227210 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:27.227176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsrw4\" (UniqueName: \"kubernetes.io/projected/d4e04fc3-7513-401d-8d81-366a7164a217-kube-api-access-dsrw4\") pod \"payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw\" (UID: \"d4e04fc3-7513-401d-8d81-366a7164a217\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"
Aug 05 17:34:27.328285 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:27.328248    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4e04fc3-7513-401d-8d81-366a7164a217-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw\" (UID: \"d4e04fc3-7513-401d-8d81-366a7164a217\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"
Aug 05 17:34:27.328455 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:27.328312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsrw4\" (UniqueName: \"kubernetes.io/projected/d4e04fc3-7513-401d-8d81-366a7164a217-kube-api-access-dsrw4\") pod \"payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw\" (UID: \"d4e04fc3-7513-401d-8d81-366a7164a217\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"
Aug 05 17:34:27.328975 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:27.328956    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4e04fc3-7513-401d-8d81-366a7164a217-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw\" (UID: \"d4e04fc3-7513-401d-8d81-366a7164a217\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"
Aug 05 17:34:27.340643 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:27.340612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsrw4\" (UniqueName: \"kubernetes.io/projected/d4e04fc3-7513-401d-8d81-366a7164a217-kube-api-access-dsrw4\") pod \"payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw\" (UID: \"d4e04fc3-7513-401d-8d81-366a7164a217\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"
Aug 05 17:34:27.451262 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:27.451162    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"
Aug 05 17:34:27.799783 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:27.799758    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"]
Aug 05 17:34:27.802087 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:34:27.802062    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e04fc3_7513_401d_8d81_366a7164a217.slice/crio-2f4c905ff1e3493410208993212bfa65e77ff0a1615df813198966869d946c7d WatchSource:0}: Error finding container 2f4c905ff1e3493410208993212bfa65e77ff0a1615df813198966869d946c7d: Status 404 returned error can't find the container with id 2f4c905ff1e3493410208993212bfa65e77ff0a1615df813198966869d946c7d
Aug 05 17:34:28.089358 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:28.089278    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw" event={"ID":"d4e04fc3-7513-401d-8d81-366a7164a217","Type":"ContainerStarted","Data":"59b518ec0cdd66c7db5055177ae512754e356adc969e5c8d866a07f733c8b891"}
Aug 05 17:34:28.089358 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:28.089332    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw" event={"ID":"d4e04fc3-7513-401d-8d81-366a7164a217","Type":"ContainerStarted","Data":"2f4c905ff1e3493410208993212bfa65e77ff0a1615df813198966869d946c7d"}
Aug 05 17:34:28.089622 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:28.089362    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"
Aug 05 17:34:28.110646 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:28.110598    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw" podStartSLOduration=1.110583835 podStartE2EDuration="1.110583835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:34:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:28.109060219 +0000 UTC m=+3340.691131874" watchObservedRunningTime="2026-08-05 17:34:28.110583835 +0000 UTC m=+3340.692655491"
Aug 05 17:34:39.096576 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:39.096544    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"
Aug 05 17:34:39.546613 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:39.545793    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": read tcp 10.132.0.2:45832->10.132.0.86:15021: read: connection reset by peer" start-of-body=
Aug 05 17:34:39.546613 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:39.545882    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt" podUID="c73d51b6-562e-4f16-a276-285a98773c4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": read tcp 10.132.0.2:45832->10.132.0.86:15021: read: connection reset by peer"
Aug 05 17:34:40.158241 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:40.158207    2565 generic.go:356] "Generic (PLEG): container finished" podID="c73d51b6-562e-4f16-a276-285a98773c4f" containerID="1c38cf76066d503f159604bf39d6e2c59b9669e0f608c1bda94aac60fccf6f76" exitCode=0
Aug 05 17:34:40.158670 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:40.158272    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt" event={"ID":"c73d51b6-562e-4f16-a276-285a98773c4f","Type":"ContainerDied","Data":"1c38cf76066d503f159604bf39d6e2c59b9669e0f608c1bda94aac60fccf6f76"}
Aug 05 17:34:40.158670 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:40.158592    2565 scope.go:117] "RemoveContainer" containerID="1c38cf76066d503f159604bf39d6e2c59b9669e0f608c1bda94aac60fccf6f76"
Aug 05 17:34:40.159617 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:40.159587    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:34:40.159696 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:40.159653    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:34:40.159696 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:40.159685    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:34:41.166068 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:41.166039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt" event={"ID":"c73d51b6-562e-4f16-a276-285a98773c4f","Type":"ContainerStarted","Data":"bf218944420f334b61635e53177d2d2adad5768920f823d462b4ffc3133084f8"}
Aug 05 17:34:41.663796 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:41.663761    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:41.664033 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:41.664009    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Aug 05 17:34:41.664157 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:41.664131    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt" podUID="c73d51b6-562e-4f16-a276-285a98773c4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Aug 05 17:34:42.663423 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:42.663386    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Aug 05 17:34:42.663810 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:42.663438    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt" podUID="c73d51b6-562e-4f16-a276-285a98773c4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Aug 05 17:34:43.663766 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:43.663733    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Aug 05 17:34:43.664180 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:43.663787    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt" podUID="c73d51b6-562e-4f16-a276-285a98773c4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Aug 05 17:34:44.663640 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:44.663607    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Aug 05 17:34:44.663830 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:44.663660    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt" podUID="c73d51b6-562e-4f16-a276-285a98773c4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Aug 05 17:34:45.663278 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:45.663238    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Aug 05 17:34:45.663467 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:45.663290    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt" podUID="c73d51b6-562e-4f16-a276-285a98773c4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Aug 05 17:34:46.667485 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:46.667452    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:46.667943 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:46.667934    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:34:46.668599 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:34:46.668580    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:35:00.617567 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.617533    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"]
Aug 05 17:35:00.622305 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.622289    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"
Aug 05 17:35:00.625439 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.625415    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-40374d\""
Aug 05 17:35:00.625593 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.625578    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-40374d-dockercfg-8b44f\""
Aug 05 17:35:00.636053 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.636032    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"]
Aug 05 17:35:00.714886 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.714856    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"]
Aug 05 17:35:00.718356 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.718338    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"
Aug 05 17:35:00.734607 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.734586    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"]
Aug 05 17:35:00.754362 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.754328    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nvkk\" (UniqueName: \"kubernetes.io/projected/14c1a8a8-907c-445d-bc20-b480d4d0949d-kube-api-access-4nvkk\") pod \"payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv\" (UID: \"14c1a8a8-907c-445d-bc20-b480d4d0949d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"
Aug 05 17:35:00.754533 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.754402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14c1a8a8-907c-445d-bc20-b480d4d0949d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv\" (UID: \"14c1a8a8-907c-445d-bc20-b480d4d0949d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"
Aug 05 17:35:00.855199 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.855159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn8wc\" (UniqueName: \"kubernetes.io/projected/95307342-5be5-4f76-9879-18286ffce17c-kube-api-access-cn8wc\") pod \"payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl\" (UID: \"95307342-5be5-4f76-9879-18286ffce17c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"
Aug 05 17:35:00.855386 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.855285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nvkk\" (UniqueName: \"kubernetes.io/projected/14c1a8a8-907c-445d-bc20-b480d4d0949d-kube-api-access-4nvkk\") pod \"payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv\" (UID: \"14c1a8a8-907c-445d-bc20-b480d4d0949d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"
Aug 05 17:35:00.855386 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.855309    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95307342-5be5-4f76-9879-18286ffce17c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl\" (UID: \"95307342-5be5-4f76-9879-18286ffce17c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"
Aug 05 17:35:00.855386 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.855361    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14c1a8a8-907c-445d-bc20-b480d4d0949d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv\" (UID: \"14c1a8a8-907c-445d-bc20-b480d4d0949d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"
Aug 05 17:35:00.856328 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.856296    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14c1a8a8-907c-445d-bc20-b480d4d0949d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv\" (UID: \"14c1a8a8-907c-445d-bc20-b480d4d0949d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"
Aug 05 17:35:00.866688 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.866666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nvkk\" (UniqueName: \"kubernetes.io/projected/14c1a8a8-907c-445d-bc20-b480d4d0949d-kube-api-access-4nvkk\") pod \"payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv\" (UID: \"14c1a8a8-907c-445d-bc20-b480d4d0949d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"
Aug 05 17:35:00.932033 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.931952    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"
Aug 05 17:35:00.956286 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.956251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn8wc\" (UniqueName: \"kubernetes.io/projected/95307342-5be5-4f76-9879-18286ffce17c-kube-api-access-cn8wc\") pod \"payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl\" (UID: \"95307342-5be5-4f76-9879-18286ffce17c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"
Aug 05 17:35:00.956451 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.956385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95307342-5be5-4f76-9879-18286ffce17c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl\" (UID: \"95307342-5be5-4f76-9879-18286ffce17c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"
Aug 05 17:35:00.957169 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.957147    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95307342-5be5-4f76-9879-18286ffce17c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl\" (UID: \"95307342-5be5-4f76-9879-18286ffce17c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"
Aug 05 17:35:00.967212 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:00.967189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn8wc\" (UniqueName: \"kubernetes.io/projected/95307342-5be5-4f76-9879-18286ffce17c-kube-api-access-cn8wc\") pod \"payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl\" (UID: \"95307342-5be5-4f76-9879-18286ffce17c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"
Aug 05 17:35:01.029147 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:01.029120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"
Aug 05 17:35:01.076574 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:01.076547    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"]
Aug 05 17:35:01.079469 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:35:01.079429    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c1a8a8_907c_445d_bc20_b480d4d0949d.slice/crio-f711389ef28e23c0721c42d68c0d7845118b25d9eb4c2eef11b65abe92369622 WatchSource:0}: Error finding container f711389ef28e23c0721c42d68c0d7845118b25d9eb4c2eef11b65abe92369622: Status 404 returned error can't find the container with id f711389ef28e23c0721c42d68c0d7845118b25d9eb4c2eef11b65abe92369622
Aug 05 17:35:01.192402 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:01.192374    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"]
Aug 05 17:35:01.194287 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:35:01.194258    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95307342_5be5_4f76_9879_18286ffce17c.slice/crio-3e6f9fc23fdb85cb6f67dd1f79976f973b2a297c8dce395abf435ab3950321a5 WatchSource:0}: Error finding container 3e6f9fc23fdb85cb6f67dd1f79976f973b2a297c8dce395abf435ab3950321a5: Status 404 returned error can't find the container with id 3e6f9fc23fdb85cb6f67dd1f79976f973b2a297c8dce395abf435ab3950321a5
Aug 05 17:35:01.275864 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:01.275831    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl" event={"ID":"95307342-5be5-4f76-9879-18286ffce17c","Type":"ContainerStarted","Data":"5397fae253e4125ff73e597bed7e07979a8672bc4c5e976c30e7e0fd13b00600"}
Aug 05 17:35:01.276061 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:01.275897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl" event={"ID":"95307342-5be5-4f76-9879-18286ffce17c","Type":"ContainerStarted","Data":"3e6f9fc23fdb85cb6f67dd1f79976f973b2a297c8dce395abf435ab3950321a5"}
Aug 05 17:35:01.276061 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:01.275926    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"
Aug 05 17:35:01.277564 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:01.277536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv" event={"ID":"14c1a8a8-907c-445d-bc20-b480d4d0949d","Type":"ContainerStarted","Data":"d9f9016f26876c95bfb549c1fc0405c763923ceaf290e256e7e25c0fa734e6ff"}
Aug 05 17:35:01.277696 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:01.277584    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv" event={"ID":"14c1a8a8-907c-445d-bc20-b480d4d0949d","Type":"ContainerStarted","Data":"f711389ef28e23c0721c42d68c0d7845118b25d9eb4c2eef11b65abe92369622"}
Aug 05 17:35:01.277696 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:01.277613    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"
Aug 05 17:35:01.296870 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:01.296820    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl" podStartSLOduration=1.296800585 podStartE2EDuration="1.296800585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:35:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:35:01.295025241 +0000 UTC m=+3373.877096896" watchObservedRunningTime="2026-08-05 17:35:01.296800585 +0000 UTC m=+3373.878872241"
Aug 05 17:35:01.316151 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:01.316080    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv" podStartSLOduration=1.316065837 podStartE2EDuration="1.316065837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:35:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:35:01.314149594 +0000 UTC m=+3373.896221251" watchObservedRunningTime="2026-08-05 17:35:01.316065837 +0000 UTC m=+3373.898137550"
Aug 05 17:35:12.285721 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:12.285689    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"
Aug 05 17:35:12.286144 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:12.285872    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"
Aug 05 17:35:30.373917 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:30.373885    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q5jnc_129fa8c6-36f6-4e83-8e1d-194d567e0215/payload-processing/0.log"
Aug 05 17:35:30.493071 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:35:30.493044    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl_95307342-5be5-4f76-9879-18286ffce17c/payload-processing/0.log"
Aug 05 17:36:20.422688 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:20.422660    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q5jnc_129fa8c6-36f6-4e83-8e1d-194d567e0215/payload-processing/0.log"
Aug 05 17:36:20.537863 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:20.537837    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl_95307342-5be5-4f76-9879-18286ffce17c/payload-processing/0.log"
Aug 05 17:36:21.107525 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.107485    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"]
Aug 05 17:36:21.112841 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.112817    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.115446 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.115430    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-9d56f4-openshift-default-dockercfg-hv79v\""
Aug 05 17:36:21.122193 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.121795    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"]
Aug 05 17:36:21.163077 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.163045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-workload-socket\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.163252 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.163085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7000ea51-8641-4063-8695-bc9efa6f2dc4-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.163252 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.163134    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-envoy\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.163252 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.163188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-podinfo\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.163252 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.163219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-workload-certs\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.163252 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.163252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-credential-socket\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.163427 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.163337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-data\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.163427 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.163360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-token\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.163427 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.163409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4flk\" (UniqueName: \"kubernetes.io/projected/7000ea51-8641-4063-8695-bc9efa6f2dc4-kube-api-access-x4flk\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.264923 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.264886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-workload-socket\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.265152 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.264933    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7000ea51-8641-4063-8695-bc9efa6f2dc4-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.265152 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.264974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-envoy\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.265152 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.264996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-podinfo\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.265152 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.265023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-workload-certs\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.265152 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.265068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-credential-socket\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.265455 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.265170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-data\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.265455 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.265194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-token\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.265455 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.265264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4flk\" (UniqueName: \"kubernetes.io/projected/7000ea51-8641-4063-8695-bc9efa6f2dc4-kube-api-access-x4flk\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.265455 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.265317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-workload-socket\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.265455 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.265440    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-workload-certs\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.265691 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.265565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-credential-socket\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.265691 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.265654    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-data\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.265829 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.265812    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7000ea51-8641-4063-8695-bc9efa6f2dc4-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.267366 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.267341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-envoy\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.267483 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.267468    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-podinfo\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.274213 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.274191    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4flk\" (UniqueName: \"kubernetes.io/projected/7000ea51-8641-4063-8695-bc9efa6f2dc4-kube-api-access-x4flk\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.274394 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.274373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-token\") pod \"e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") " pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.427282 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.427198    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:21.571339 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.571311    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"]
Aug 05 17:36:21.573199 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:36:21.573169    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7000ea51_8641_4063_8695_bc9efa6f2dc4.slice/crio-b693bd02d9142fe40ae1e7707aff807a8057a79033a4d61e2c99e3b5cde77dde WatchSource:0}: Error finding container b693bd02d9142fe40ae1e7707aff807a8057a79033a4d61e2c99e3b5cde77dde: Status 404 returned error can't find the container with id b693bd02d9142fe40ae1e7707aff807a8057a79033a4d61e2c99e3b5cde77dde
Aug 05 17:36:21.575278 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.575249    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:36:21.575354 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.575313    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:36:21.575354 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.575340    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:36:21.727484 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.727398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5" event={"ID":"7000ea51-8641-4063-8695-bc9efa6f2dc4","Type":"ContainerStarted","Data":"56de63a9a81b12fa917cdd832315ae97ca5c154bd208ac9cb933f2bb4b95b814"}
Aug 05 17:36:21.727484 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.727455    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5" event={"ID":"7000ea51-8641-4063-8695-bc9efa6f2dc4","Type":"ContainerStarted","Data":"b693bd02d9142fe40ae1e7707aff807a8057a79033a4d61e2c99e3b5cde77dde"}
Aug 05 17:36:21.749626 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:21.749573    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5" podStartSLOduration=0.749557259 podStartE2EDuration="749.557259ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:36:21.74666716 +0000 UTC m=+3454.328738818" watchObservedRunningTime="2026-08-05 17:36:21.749557259 +0000 UTC m=+3454.331628914"
Aug 05 17:36:22.428178 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:22.428144    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:22.432904 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:22.432878    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:22.733358 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:22.733275    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:22.734304 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:22.734282    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:38.741867 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:38.740880    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Aug 05 17:36:38.741867 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:38.740956    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5" podUID="7000ea51-8641-4063-8695-bc9efa6f2dc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Aug 05 17:36:38.828985 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:38.828953    2565 generic.go:356] "Generic (PLEG): container finished" podID="7000ea51-8641-4063-8695-bc9efa6f2dc4" containerID="56de63a9a81b12fa917cdd832315ae97ca5c154bd208ac9cb933f2bb4b95b814" exitCode=0
Aug 05 17:36:38.829151 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:38.829031    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5" event={"ID":"7000ea51-8641-4063-8695-bc9efa6f2dc4","Type":"ContainerDied","Data":"56de63a9a81b12fa917cdd832315ae97ca5c154bd208ac9cb933f2bb4b95b814"}
Aug 05 17:36:38.829545 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:38.829528    2565 scope.go:117] "RemoveContainer" containerID="56de63a9a81b12fa917cdd832315ae97ca5c154bd208ac9cb933f2bb4b95b814"
Aug 05 17:36:38.830571 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:38.830541    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:36:38.830622 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:38.830610    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:36:38.830662 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:38.830646    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 17:36:39.839552 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:39.839504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5" event={"ID":"7000ea51-8641-4063-8695-bc9efa6f2dc4","Type":"ContainerStarted","Data":"2e2ad45339556d0e1ec604694eacf8cd6fb443974981b29b8d1eebaa940ade6f"}
Aug 05 17:36:40.427772 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:40.427741    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:40.427950 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:40.427884    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Aug 05 17:36:40.427950 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:40.427931    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5" podUID="7000ea51-8641-4063-8695-bc9efa6f2dc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Aug 05 17:36:41.428314 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:41.428279    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Aug 05 17:36:41.428740 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:41.428344    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5" podUID="7000ea51-8641-4063-8695-bc9efa6f2dc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Aug 05 17:36:42.428124 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:42.428066    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Aug 05 17:36:42.428338 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:42.428153    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5" podUID="7000ea51-8641-4063-8695-bc9efa6f2dc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Aug 05 17:36:43.428363 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:43.428330    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Aug 05 17:36:43.428853 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:43.428388    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5" podUID="7000ea51-8641-4063-8695-bc9efa6f2dc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Aug 05 17:36:44.428490 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:44.428455    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Aug 05 17:36:44.428899 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:44.428511    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5" podUID="7000ea51-8641-4063-8695-bc9efa6f2dc4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Aug 05 17:36:45.431379 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:45.431348    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:45.431762 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:45.431710    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:36:45.432291 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:36:45.432273    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:37:02.277170 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:02.277137    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"]
Aug 05 17:37:02.277744 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:02.277344    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5" podUID="7000ea51-8641-4063-8695-bc9efa6f2dc4" containerName="istio-proxy" containerID="cri-o://2e2ad45339556d0e1ec604694eacf8cd6fb443974981b29b8d1eebaa940ade6f" gracePeriod=30
Aug 05 17:37:07.534002 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.533978    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:37:07.626955 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.626916    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-workload-certs\") pod \"7000ea51-8641-4063-8695-bc9efa6f2dc4\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") "
Aug 05 17:37:07.627181 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.626981    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7000ea51-8641-4063-8695-bc9efa6f2dc4-istiod-ca-cert\") pod \"7000ea51-8641-4063-8695-bc9efa6f2dc4\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") "
Aug 05 17:37:07.627181 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627021    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4flk\" (UniqueName: \"kubernetes.io/projected/7000ea51-8641-4063-8695-bc9efa6f2dc4-kube-api-access-x4flk\") pod \"7000ea51-8641-4063-8695-bc9efa6f2dc4\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") "
Aug 05 17:37:07.627181 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627064    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-podinfo\") pod \"7000ea51-8641-4063-8695-bc9efa6f2dc4\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") "
Aug 05 17:37:07.627373 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627181    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-credential-socket\") pod \"7000ea51-8641-4063-8695-bc9efa6f2dc4\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") "
Aug 05 17:37:07.627373 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627244    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7000ea51-8641-4063-8695-bc9efa6f2dc4" (UID: "7000ea51-8641-4063-8695-bc9efa6f2dc4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:37:07.627373 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627251    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-workload-socket\") pod \"7000ea51-8641-4063-8695-bc9efa6f2dc4\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") "
Aug 05 17:37:07.627373 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627350    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-data\") pod \"7000ea51-8641-4063-8695-bc9efa6f2dc4\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") "
Aug 05 17:37:07.627593 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627379    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-envoy\") pod \"7000ea51-8641-4063-8695-bc9efa6f2dc4\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") "
Aug 05 17:37:07.627593 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627429    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-token\") pod \"7000ea51-8641-4063-8695-bc9efa6f2dc4\" (UID: \"7000ea51-8641-4063-8695-bc9efa6f2dc4\") "
Aug 05 17:37:07.627593 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627454    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7000ea51-8641-4063-8695-bc9efa6f2dc4" (UID: "7000ea51-8641-4063-8695-bc9efa6f2dc4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:37:07.627593 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627506    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7000ea51-8641-4063-8695-bc9efa6f2dc4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7000ea51-8641-4063-8695-bc9efa6f2dc4" (UID: "7000ea51-8641-4063-8695-bc9efa6f2dc4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:37:07.627797 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627596    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-data" (OuterVolumeSpecName: "istio-data") pod "7000ea51-8641-4063-8695-bc9efa6f2dc4" (UID: "7000ea51-8641-4063-8695-bc9efa6f2dc4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:37:07.627858 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627804    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-workload-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:37:07.627858 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627823    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7000ea51-8641-4063-8695-bc9efa6f2dc4-istiod-ca-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:37:07.627858 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627835    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-workload-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:37:07.627858 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627850    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-data\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:37:07.628069 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.627906    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7000ea51-8641-4063-8695-bc9efa6f2dc4" (UID: "7000ea51-8641-4063-8695-bc9efa6f2dc4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:37:07.629414 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.629386    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7000ea51-8641-4063-8695-bc9efa6f2dc4" (UID: "7000ea51-8641-4063-8695-bc9efa6f2dc4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:37:07.629528 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.629431    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7000ea51-8641-4063-8695-bc9efa6f2dc4" (UID: "7000ea51-8641-4063-8695-bc9efa6f2dc4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:37:07.629528 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.629456    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7000ea51-8641-4063-8695-bc9efa6f2dc4-kube-api-access-x4flk" (OuterVolumeSpecName: "kube-api-access-x4flk") pod "7000ea51-8641-4063-8695-bc9efa6f2dc4" (UID: "7000ea51-8641-4063-8695-bc9efa6f2dc4"). InnerVolumeSpecName "kube-api-access-x4flk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:37:07.629654 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.629529    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-token" (OuterVolumeSpecName: "istio-token") pod "7000ea51-8641-4063-8695-bc9efa6f2dc4" (UID: "7000ea51-8641-4063-8695-bc9efa6f2dc4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:37:07.729156 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.729124    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4flk\" (UniqueName: \"kubernetes.io/projected/7000ea51-8641-4063-8695-bc9efa6f2dc4-kube-api-access-x4flk\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:37:07.729156 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.729151    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-podinfo\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:37:07.729156 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.729161    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-credential-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:37:07.729387 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.729170    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-envoy\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:37:07.729387 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:07.729180    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7000ea51-8641-4063-8695-bc9efa6f2dc4-istio-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:37:08.004619 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:08.004580    2565 generic.go:356] "Generic (PLEG): container finished" podID="7000ea51-8641-4063-8695-bc9efa6f2dc4" containerID="2e2ad45339556d0e1ec604694eacf8cd6fb443974981b29b8d1eebaa940ade6f" exitCode=0
Aug 05 17:37:08.004763 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:08.004647    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"
Aug 05 17:37:08.004763 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:08.004667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5" event={"ID":"7000ea51-8641-4063-8695-bc9efa6f2dc4","Type":"ContainerDied","Data":"2e2ad45339556d0e1ec604694eacf8cd6fb443974981b29b8d1eebaa940ade6f"}
Aug 05 17:37:08.004763 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:08.004715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5" event={"ID":"7000ea51-8641-4063-8695-bc9efa6f2dc4","Type":"ContainerDied","Data":"b693bd02d9142fe40ae1e7707aff807a8057a79033a4d61e2c99e3b5cde77dde"}
Aug 05 17:37:08.004763 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:08.004737    2565 scope.go:117] "RemoveContainer" containerID="2e2ad45339556d0e1ec604694eacf8cd6fb443974981b29b8d1eebaa940ade6f"
Aug 05 17:37:08.014952 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:08.014933    2565 scope.go:117] "RemoveContainer" containerID="56de63a9a81b12fa917cdd832315ae97ca5c154bd208ac9cb933f2bb4b95b814"
Aug 05 17:37:08.023792 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:08.023774    2565 scope.go:117] "RemoveContainer" containerID="2e2ad45339556d0e1ec604694eacf8cd6fb443974981b29b8d1eebaa940ade6f"
Aug 05 17:37:08.024064 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:37:08.024041    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e2ad45339556d0e1ec604694eacf8cd6fb443974981b29b8d1eebaa940ade6f\": container with ID starting with 2e2ad45339556d0e1ec604694eacf8cd6fb443974981b29b8d1eebaa940ade6f not found: ID does not exist" containerID="2e2ad45339556d0e1ec604694eacf8cd6fb443974981b29b8d1eebaa940ade6f"
Aug 05 17:37:08.024148 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:08.024071    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e2ad45339556d0e1ec604694eacf8cd6fb443974981b29b8d1eebaa940ade6f"} err="failed to get container status \"2e2ad45339556d0e1ec604694eacf8cd6fb443974981b29b8d1eebaa940ade6f\": rpc error: code = NotFound desc = could not find container \"2e2ad45339556d0e1ec604694eacf8cd6fb443974981b29b8d1eebaa940ade6f\": container with ID starting with 2e2ad45339556d0e1ec604694eacf8cd6fb443974981b29b8d1eebaa940ade6f not found: ID does not exist"
Aug 05 17:37:08.024148 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:08.024088    2565 scope.go:117] "RemoveContainer" containerID="56de63a9a81b12fa917cdd832315ae97ca5c154bd208ac9cb933f2bb4b95b814"
Aug 05 17:37:08.024357 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:37:08.024340    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56de63a9a81b12fa917cdd832315ae97ca5c154bd208ac9cb933f2bb4b95b814\": container with ID starting with 56de63a9a81b12fa917cdd832315ae97ca5c154bd208ac9cb933f2bb4b95b814 not found: ID does not exist" containerID="56de63a9a81b12fa917cdd832315ae97ca5c154bd208ac9cb933f2bb4b95b814"
Aug 05 17:37:08.024418 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:08.024363    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56de63a9a81b12fa917cdd832315ae97ca5c154bd208ac9cb933f2bb4b95b814"} err="failed to get container status \"56de63a9a81b12fa917cdd832315ae97ca5c154bd208ac9cb933f2bb4b95b814\": rpc error: code = NotFound desc = could not find container \"56de63a9a81b12fa917cdd832315ae97ca5c154bd208ac9cb933f2bb4b95b814\": container with ID starting with 56de63a9a81b12fa917cdd832315ae97ca5c154bd208ac9cb933f2bb4b95b814 not found: ID does not exist"
Aug 05 17:37:08.025497 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:08.025476    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"]
Aug 05 17:37:08.031548 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:08.031528    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9d56f4-openshift-default-67c8766668-n28j5"]
Aug 05 17:37:09.953654 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:09.953620    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7000ea51-8641-4063-8695-bc9efa6f2dc4" path="/var/lib/kubelet/pods/7000ea51-8641-4063-8695-bc9efa6f2dc4/volumes"
Aug 05 17:37:15.937672 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:15.936610    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"]
Aug 05 17:37:15.938462 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:15.938429    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw" podUID="d4e04fc3-7513-401d-8d81-366a7164a217" containerName="payload-pre-processing" containerID="cri-o://59b518ec0cdd66c7db5055177ae512754e356adc969e5c8d866a07f733c8b891" gracePeriod=30
Aug 05 17:37:16.210030 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:16.210006    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"
Aug 05 17:37:16.308675 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:16.308640    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsrw4\" (UniqueName: \"kubernetes.io/projected/d4e04fc3-7513-401d-8d81-366a7164a217-kube-api-access-dsrw4\") pod \"d4e04fc3-7513-401d-8d81-366a7164a217\" (UID: \"d4e04fc3-7513-401d-8d81-366a7164a217\") "
Aug 05 17:37:16.308850 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:16.308822    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4e04fc3-7513-401d-8d81-366a7164a217-plugins-config-volume\") pod \"d4e04fc3-7513-401d-8d81-366a7164a217\" (UID: \"d4e04fc3-7513-401d-8d81-366a7164a217\") "
Aug 05 17:37:16.309182 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:16.309157    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4e04fc3-7513-401d-8d81-366a7164a217-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d4e04fc3-7513-401d-8d81-366a7164a217" (UID: "d4e04fc3-7513-401d-8d81-366a7164a217"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:37:16.310708 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:16.310684    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4e04fc3-7513-401d-8d81-366a7164a217-kube-api-access-dsrw4" (OuterVolumeSpecName: "kube-api-access-dsrw4") pod "d4e04fc3-7513-401d-8d81-366a7164a217" (UID: "d4e04fc3-7513-401d-8d81-366a7164a217"). InnerVolumeSpecName "kube-api-access-dsrw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:37:16.409544 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:16.409507    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsrw4\" (UniqueName: \"kubernetes.io/projected/d4e04fc3-7513-401d-8d81-366a7164a217-kube-api-access-dsrw4\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:37:16.409544 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:16.409539    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4e04fc3-7513-401d-8d81-366a7164a217-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:37:17.055879 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:17.055844    2565 generic.go:356] "Generic (PLEG): container finished" podID="d4e04fc3-7513-401d-8d81-366a7164a217" containerID="59b518ec0cdd66c7db5055177ae512754e356adc969e5c8d866a07f733c8b891" exitCode=0
Aug 05 17:37:17.056333 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:17.055901    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"
Aug 05 17:37:17.056333 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:17.055925    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw" event={"ID":"d4e04fc3-7513-401d-8d81-366a7164a217","Type":"ContainerDied","Data":"59b518ec0cdd66c7db5055177ae512754e356adc969e5c8d866a07f733c8b891"}
Aug 05 17:37:17.056333 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:17.055974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw" event={"ID":"d4e04fc3-7513-401d-8d81-366a7164a217","Type":"ContainerDied","Data":"2f4c905ff1e3493410208993212bfa65e77ff0a1615df813198966869d946c7d"}
Aug 05 17:37:17.056333 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:17.055996    2565 scope.go:117] "RemoveContainer" containerID="59b518ec0cdd66c7db5055177ae512754e356adc969e5c8d866a07f733c8b891"
Aug 05 17:37:17.065327 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:17.065311    2565 scope.go:117] "RemoveContainer" containerID="59b518ec0cdd66c7db5055177ae512754e356adc969e5c8d866a07f733c8b891"
Aug 05 17:37:17.065590 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:37:17.065570    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59b518ec0cdd66c7db5055177ae512754e356adc969e5c8d866a07f733c8b891\": container with ID starting with 59b518ec0cdd66c7db5055177ae512754e356adc969e5c8d866a07f733c8b891 not found: ID does not exist" containerID="59b518ec0cdd66c7db5055177ae512754e356adc969e5c8d866a07f733c8b891"
Aug 05 17:37:17.065653 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:17.065597    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59b518ec0cdd66c7db5055177ae512754e356adc969e5c8d866a07f733c8b891"} err="failed to get container status \"59b518ec0cdd66c7db5055177ae512754e356adc969e5c8d866a07f733c8b891\": rpc error: code = NotFound desc = could not find container \"59b518ec0cdd66c7db5055177ae512754e356adc969e5c8d866a07f733c8b891\": container with ID starting with 59b518ec0cdd66c7db5055177ae512754e356adc969e5c8d866a07f733c8b891 not found: ID does not exist"
Aug 05 17:37:17.108365 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:17.108340    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"]
Aug 05 17:37:17.136758 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:17.136735    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-09e18b-7986dbdd4d-gggxw"]
Aug 05 17:37:17.952905 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:37:17.952872    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4e04fc3-7513-401d-8d81-366a7164a217" path="/var/lib/kubelet/pods/d4e04fc3-7513-401d-8d81-366a7164a217/volumes"
Aug 05 17:38:11.124154 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:11.124082    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"]
Aug 05 17:38:11.124662 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:11.124386    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt" podUID="c73d51b6-562e-4f16-a276-285a98773c4f" containerName="istio-proxy" containerID="cri-o://bf218944420f334b61635e53177d2d2adad5768920f823d462b4ffc3133084f8" gracePeriod=30
Aug 05 17:38:16.366787 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.366755    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:38:16.370812 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.370791    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-workload-certs\") pod \"c73d51b6-562e-4f16-a276-285a98773c4f\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") "
Aug 05 17:38:16.370933 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.370817    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-istio-envoy\") pod \"c73d51b6-562e-4f16-a276-285a98773c4f\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") "
Aug 05 17:38:16.370933 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.370834    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-istio-data\") pod \"c73d51b6-562e-4f16-a276-285a98773c4f\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") "
Aug 05 17:38:16.370933 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.370864    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c275r\" (UniqueName: \"kubernetes.io/projected/c73d51b6-562e-4f16-a276-285a98773c4f-kube-api-access-c275r\") pod \"c73d51b6-562e-4f16-a276-285a98773c4f\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") "
Aug 05 17:38:16.370933 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.370911    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c73d51b6-562e-4f16-a276-285a98773c4f-istio-token\") pod \"c73d51b6-562e-4f16-a276-285a98773c4f\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") "
Aug 05 17:38:16.371175 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.370940    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c73d51b6-562e-4f16-a276-285a98773c4f-istio-podinfo\") pod \"c73d51b6-562e-4f16-a276-285a98773c4f\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") "
Aug 05 17:38:16.371175 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.370963    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-credential-socket\") pod \"c73d51b6-562e-4f16-a276-285a98773c4f\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") "
Aug 05 17:38:16.371175 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.371020    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-workload-socket\") pod \"c73d51b6-562e-4f16-a276-285a98773c4f\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") "
Aug 05 17:38:16.371175 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.371079    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c73d51b6-562e-4f16-a276-285a98773c4f-istiod-ca-cert\") pod \"c73d51b6-562e-4f16-a276-285a98773c4f\" (UID: \"c73d51b6-562e-4f16-a276-285a98773c4f\") "
Aug 05 17:38:16.371175 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.371078    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c73d51b6-562e-4f16-a276-285a98773c4f" (UID: "c73d51b6-562e-4f16-a276-285a98773c4f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:16.371175 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.371154    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c73d51b6-562e-4f16-a276-285a98773c4f" (UID: "c73d51b6-562e-4f16-a276-285a98773c4f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:16.371499 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.371311    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c73d51b6-562e-4f16-a276-285a98773c4f" (UID: "c73d51b6-562e-4f16-a276-285a98773c4f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:16.371499 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.371387    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c73d51b6-562e-4f16-a276-285a98773c4f" (UID: "c73d51b6-562e-4f16-a276-285a98773c4f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:16.371499 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.371422    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-credential-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:16.371499 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.371441    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-workload-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:16.371499 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.371455    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-istio-data\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:16.371754 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.371616    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c73d51b6-562e-4f16-a276-285a98773c4f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c73d51b6-562e-4f16-a276-285a98773c4f" (UID: "c73d51b6-562e-4f16-a276-285a98773c4f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:38:16.373168 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.373072    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c73d51b6-562e-4f16-a276-285a98773c4f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c73d51b6-562e-4f16-a276-285a98773c4f" (UID: "c73d51b6-562e-4f16-a276-285a98773c4f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:16.373256 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.373170    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c73d51b6-562e-4f16-a276-285a98773c4f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c73d51b6-562e-4f16-a276-285a98773c4f" (UID: "c73d51b6-562e-4f16-a276-285a98773c4f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:38:16.373369 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.373349    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c73d51b6-562e-4f16-a276-285a98773c4f" (UID: "c73d51b6-562e-4f16-a276-285a98773c4f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:16.373428 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.373364    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c73d51b6-562e-4f16-a276-285a98773c4f-kube-api-access-c275r" (OuterVolumeSpecName: "kube-api-access-c275r") pod "c73d51b6-562e-4f16-a276-285a98773c4f" (UID: "c73d51b6-562e-4f16-a276-285a98773c4f"). InnerVolumeSpecName "kube-api-access-c275r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:16.392062 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.391988    2565 generic.go:356] "Generic (PLEG): container finished" podID="c73d51b6-562e-4f16-a276-285a98773c4f" containerID="bf218944420f334b61635e53177d2d2adad5768920f823d462b4ffc3133084f8" exitCode=0
Aug 05 17:38:16.392062 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.392049    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"
Aug 05 17:38:16.392267 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.392075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt" event={"ID":"c73d51b6-562e-4f16-a276-285a98773c4f","Type":"ContainerDied","Data":"bf218944420f334b61635e53177d2d2adad5768920f823d462b4ffc3133084f8"}
Aug 05 17:38:16.392267 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.392182    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt" event={"ID":"c73d51b6-562e-4f16-a276-285a98773c4f","Type":"ContainerDied","Data":"03ca6b309b3a701a69312eb90f2a1df3adfa0fffe855b23a7c0f382f11c528ba"}
Aug 05 17:38:16.392267 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.392214    2565 scope.go:117] "RemoveContainer" containerID="bf218944420f334b61635e53177d2d2adad5768920f823d462b4ffc3133084f8"
Aug 05 17:38:16.403013 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.402986    2565 scope.go:117] "RemoveContainer" containerID="1c38cf76066d503f159604bf39d6e2c59b9669e0f608c1bda94aac60fccf6f76"
Aug 05 17:38:16.412398 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.412374    2565 scope.go:117] "RemoveContainer" containerID="bf218944420f334b61635e53177d2d2adad5768920f823d462b4ffc3133084f8"
Aug 05 17:38:16.412705 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:38:16.412684    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf218944420f334b61635e53177d2d2adad5768920f823d462b4ffc3133084f8\": container with ID starting with bf218944420f334b61635e53177d2d2adad5768920f823d462b4ffc3133084f8 not found: ID does not exist" containerID="bf218944420f334b61635e53177d2d2adad5768920f823d462b4ffc3133084f8"
Aug 05 17:38:16.412803 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.412715    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf218944420f334b61635e53177d2d2adad5768920f823d462b4ffc3133084f8"} err="failed to get container status \"bf218944420f334b61635e53177d2d2adad5768920f823d462b4ffc3133084f8\": rpc error: code = NotFound desc = could not find container \"bf218944420f334b61635e53177d2d2adad5768920f823d462b4ffc3133084f8\": container with ID starting with bf218944420f334b61635e53177d2d2adad5768920f823d462b4ffc3133084f8 not found: ID does not exist"
Aug 05 17:38:16.412803 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.412740    2565 scope.go:117] "RemoveContainer" containerID="1c38cf76066d503f159604bf39d6e2c59b9669e0f608c1bda94aac60fccf6f76"
Aug 05 17:38:16.413021 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:38:16.412995    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c38cf76066d503f159604bf39d6e2c59b9669e0f608c1bda94aac60fccf6f76\": container with ID starting with 1c38cf76066d503f159604bf39d6e2c59b9669e0f608c1bda94aac60fccf6f76 not found: ID does not exist" containerID="1c38cf76066d503f159604bf39d6e2c59b9669e0f608c1bda94aac60fccf6f76"
Aug 05 17:38:16.413137 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.413025    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c38cf76066d503f159604bf39d6e2c59b9669e0f608c1bda94aac60fccf6f76"} err="failed to get container status \"1c38cf76066d503f159604bf39d6e2c59b9669e0f608c1bda94aac60fccf6f76\": rpc error: code = NotFound desc = could not find container \"1c38cf76066d503f159604bf39d6e2c59b9669e0f608c1bda94aac60fccf6f76\": container with ID starting with 1c38cf76066d503f159604bf39d6e2c59b9669e0f608c1bda94aac60fccf6f76 not found: ID does not exist"
Aug 05 17:38:16.417391 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.417374    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"]
Aug 05 17:38:16.421265 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.421246    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-09e18b-openshift-default-74c6478696-7pndt"]
Aug 05 17:38:16.472650 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.472622    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-workload-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:16.472650 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.472646    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c73d51b6-562e-4f16-a276-285a98773c4f-istiod-ca-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:16.472797 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.472660    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c73d51b6-562e-4f16-a276-285a98773c4f-istio-envoy\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:16.472797 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.472672    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c275r\" (UniqueName: \"kubernetes.io/projected/c73d51b6-562e-4f16-a276-285a98773c4f-kube-api-access-c275r\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:16.472797 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.472684    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c73d51b6-562e-4f16-a276-285a98773c4f-istio-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:16.472797 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:16.472696    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c73d51b6-562e-4f16-a276-285a98773c4f-istio-podinfo\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:17.952946 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:17.952910    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c73d51b6-562e-4f16-a276-285a98773c4f" path="/var/lib/kubelet/pods/c73d51b6-562e-4f16-a276-285a98773c4f/volumes"
Aug 05 17:38:22.128926 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.128882    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"]
Aug 05 17:38:22.129521 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.129137    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl" podUID="95307342-5be5-4f76-9879-18286ffce17c" containerName="payload-processing" containerID="cri-o://5397fae253e4125ff73e597bed7e07979a8672bc4c5e976c30e7e0fd13b00600" gracePeriod=30
Aug 05 17:38:22.138811 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.138782    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"]
Aug 05 17:38:22.139293 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.139264    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv" podUID="14c1a8a8-907c-445d-bc20-b480d4d0949d" containerName="payload-pre-processing" containerID="cri-o://d9f9016f26876c95bfb549c1fc0405c763923ceaf290e256e7e25c0fa734e6ff" gracePeriod=30
Aug 05 17:38:22.284190 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.284148    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv" podUID="14c1a8a8-907c-445d-bc20-b480d4d0949d" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.88:9004: connect: connection refused"
Aug 05 17:38:22.284341 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.284148    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl" podUID="95307342-5be5-4f76-9879-18286ffce17c" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.89:9004: connect: connection refused"
Aug 05 17:38:22.416511 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.416489    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"
Aug 05 17:38:22.429554 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.429522    2565 generic.go:356] "Generic (PLEG): container finished" podID="14c1a8a8-907c-445d-bc20-b480d4d0949d" containerID="d9f9016f26876c95bfb549c1fc0405c763923ceaf290e256e7e25c0fa734e6ff" exitCode=0
Aug 05 17:38:22.429681 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.429589    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv" event={"ID":"14c1a8a8-907c-445d-bc20-b480d4d0949d","Type":"ContainerDied","Data":"d9f9016f26876c95bfb549c1fc0405c763923ceaf290e256e7e25c0fa734e6ff"}
Aug 05 17:38:22.431067 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.431042    2565 generic.go:356] "Generic (PLEG): container finished" podID="95307342-5be5-4f76-9879-18286ffce17c" containerID="5397fae253e4125ff73e597bed7e07979a8672bc4c5e976c30e7e0fd13b00600" exitCode=0
Aug 05 17:38:22.431214 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.431084    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"
Aug 05 17:38:22.431214 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.431116    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl" event={"ID":"95307342-5be5-4f76-9879-18286ffce17c","Type":"ContainerDied","Data":"5397fae253e4125ff73e597bed7e07979a8672bc4c5e976c30e7e0fd13b00600"}
Aug 05 17:38:22.431214 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.431165    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl" event={"ID":"95307342-5be5-4f76-9879-18286ffce17c","Type":"ContainerDied","Data":"3e6f9fc23fdb85cb6f67dd1f79976f973b2a297c8dce395abf435ab3950321a5"}
Aug 05 17:38:22.431214 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.431195    2565 scope.go:117] "RemoveContainer" containerID="5397fae253e4125ff73e597bed7e07979a8672bc4c5e976c30e7e0fd13b00600"
Aug 05 17:38:22.443720 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.443128    2565 scope.go:117] "RemoveContainer" containerID="5397fae253e4125ff73e597bed7e07979a8672bc4c5e976c30e7e0fd13b00600"
Aug 05 17:38:22.443805 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:38:22.443742    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5397fae253e4125ff73e597bed7e07979a8672bc4c5e976c30e7e0fd13b00600\": container with ID starting with 5397fae253e4125ff73e597bed7e07979a8672bc4c5e976c30e7e0fd13b00600 not found: ID does not exist" containerID="5397fae253e4125ff73e597bed7e07979a8672bc4c5e976c30e7e0fd13b00600"
Aug 05 17:38:22.443805 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.443779    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5397fae253e4125ff73e597bed7e07979a8672bc4c5e976c30e7e0fd13b00600"} err="failed to get container status \"5397fae253e4125ff73e597bed7e07979a8672bc4c5e976c30e7e0fd13b00600\": rpc error: code = NotFound desc = could not find container \"5397fae253e4125ff73e597bed7e07979a8672bc4c5e976c30e7e0fd13b00600\": container with ID starting with 5397fae253e4125ff73e597bed7e07979a8672bc4c5e976c30e7e0fd13b00600 not found: ID does not exist"
Aug 05 17:38:22.476673 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.476655    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"
Aug 05 17:38:22.527574 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.527547    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14c1a8a8-907c-445d-bc20-b480d4d0949d-plugins-config-volume\") pod \"14c1a8a8-907c-445d-bc20-b480d4d0949d\" (UID: \"14c1a8a8-907c-445d-bc20-b480d4d0949d\") "
Aug 05 17:38:22.527731 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.527580    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95307342-5be5-4f76-9879-18286ffce17c-plugins-config-volume\") pod \"95307342-5be5-4f76-9879-18286ffce17c\" (UID: \"95307342-5be5-4f76-9879-18286ffce17c\") "
Aug 05 17:38:22.527731 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.527662    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cn8wc\" (UniqueName: \"kubernetes.io/projected/95307342-5be5-4f76-9879-18286ffce17c-kube-api-access-cn8wc\") pod \"95307342-5be5-4f76-9879-18286ffce17c\" (UID: \"95307342-5be5-4f76-9879-18286ffce17c\") "
Aug 05 17:38:22.527826 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.527745    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nvkk\" (UniqueName: \"kubernetes.io/projected/14c1a8a8-907c-445d-bc20-b480d4d0949d-kube-api-access-4nvkk\") pod \"14c1a8a8-907c-445d-bc20-b480d4d0949d\" (UID: \"14c1a8a8-907c-445d-bc20-b480d4d0949d\") "
Aug 05 17:38:22.527984 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.527960    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14c1a8a8-907c-445d-bc20-b480d4d0949d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "14c1a8a8-907c-445d-bc20-b480d4d0949d" (UID: "14c1a8a8-907c-445d-bc20-b480d4d0949d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:38:22.528062 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.527982    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95307342-5be5-4f76-9879-18286ffce17c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "95307342-5be5-4f76-9879-18286ffce17c" (UID: "95307342-5be5-4f76-9879-18286ffce17c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:38:22.528062 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.528038    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14c1a8a8-907c-445d-bc20-b480d4d0949d-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:22.528062 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.528056    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95307342-5be5-4f76-9879-18286ffce17c-plugins-config-volume\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:22.529781 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.529758    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14c1a8a8-907c-445d-bc20-b480d4d0949d-kube-api-access-4nvkk" (OuterVolumeSpecName: "kube-api-access-4nvkk") pod "14c1a8a8-907c-445d-bc20-b480d4d0949d" (UID: "14c1a8a8-907c-445d-bc20-b480d4d0949d"). InnerVolumeSpecName "kube-api-access-4nvkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:22.529856 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.529796    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95307342-5be5-4f76-9879-18286ffce17c-kube-api-access-cn8wc" (OuterVolumeSpecName: "kube-api-access-cn8wc") pod "95307342-5be5-4f76-9879-18286ffce17c" (UID: "95307342-5be5-4f76-9879-18286ffce17c"). InnerVolumeSpecName "kube-api-access-cn8wc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:22.628644 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.628605    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nvkk\" (UniqueName: \"kubernetes.io/projected/14c1a8a8-907c-445d-bc20-b480d4d0949d-kube-api-access-4nvkk\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:22.628644 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.628640    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn8wc\" (UniqueName: \"kubernetes.io/projected/95307342-5be5-4f76-9879-18286ffce17c-kube-api-access-cn8wc\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:22.754106 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.754070    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"]
Aug 05 17:38:22.760258 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:22.760234    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-40374d-648d8fbdc6-vcnjl"]
Aug 05 17:38:23.438165 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:23.438136    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"
Aug 05 17:38:23.438592 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:23.438136    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv" event={"ID":"14c1a8a8-907c-445d-bc20-b480d4d0949d","Type":"ContainerDied","Data":"f711389ef28e23c0721c42d68c0d7845118b25d9eb4c2eef11b65abe92369622"}
Aug 05 17:38:23.438592 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:23.438268    2565 scope.go:117] "RemoveContainer" containerID="d9f9016f26876c95bfb549c1fc0405c763923ceaf290e256e7e25c0fa734e6ff"
Aug 05 17:38:23.467691 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:23.467664    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"]
Aug 05 17:38:23.478019 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:23.477991    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-40374d-544ddf57d4-vmlnv"]
Aug 05 17:38:23.952920 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:23.952890    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14c1a8a8-907c-445d-bc20-b480d4d0949d" path="/var/lib/kubelet/pods/14c1a8a8-907c-445d-bc20-b480d4d0949d/volumes"
Aug 05 17:38:23.953274 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:23.953261    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95307342-5be5-4f76-9879-18286ffce17c" path="/var/lib/kubelet/pods/95307342-5be5-4f76-9879-18286ffce17c/volumes"
Aug 05 17:38:40.216002 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:40.215918    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a1e09f-29765850-cvxcw"]
Aug 05 17:38:40.220780 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:40.220752    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a1e09f-29765850-cvxcw"]
Aug 05 17:38:41.955619 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:41.955581    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3cc85cb-af7d-4bec-865e-0c1ece6b0427" path="/var/lib/kubelet/pods/a3cc85cb-af7d-4bec-865e-0c1ece6b0427/volumes"
Aug 05 17:38:47.375615 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:47.375581    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"]
Aug 05 17:38:47.375998 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:47.375773    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j" podUID="f268f3c9-3af3-4933-a0db-be2255944286" containerName="istio-proxy" containerID="cri-o://76cb940b32c9f8bcbfac3e176d764ae27eb90c01b6094f4f19073c4198919503" gracePeriod=30
Aug 05 17:38:48.540359 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:48.540327    2565 scope.go:117] "RemoveContainer" containerID="1b101070eef462cc20888f7123e5b6c4e0952cd556638293db9aee4bd6571444"
Aug 05 17:38:52.605731 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.605703    2565 generic.go:356] "Generic (PLEG): container finished" podID="f268f3c9-3af3-4933-a0db-be2255944286" containerID="76cb940b32c9f8bcbfac3e176d764ae27eb90c01b6094f4f19073c4198919503" exitCode=0
Aug 05 17:38:52.606057 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.605773    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j" event={"ID":"f268f3c9-3af3-4933-a0db-be2255944286","Type":"ContainerDied","Data":"76cb940b32c9f8bcbfac3e176d764ae27eb90c01b6094f4f19073c4198919503"}
Aug 05 17:38:52.606057 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.605836    2565 scope.go:117] "RemoveContainer" containerID="6f61c6303912503b1c390322ab6b5147bb17a6c6283d1c55092722ea47c07100"
Aug 05 17:38:52.622947 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:38:52.622927    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f61c6303912503b1c390322ab6b5147bb17a6c6283d1c55092722ea47c07100\": container with ID starting with 6f61c6303912503b1c390322ab6b5147bb17a6c6283d1c55092722ea47c07100 not found: ID does not exist" containerID="6f61c6303912503b1c390322ab6b5147bb17a6c6283d1c55092722ea47c07100"
Aug 05 17:38:52.626460 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.626443    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:38:52.805361 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.805332    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-istio-envoy\") pod \"f268f3c9-3af3-4933-a0db-be2255944286\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") "
Aug 05 17:38:52.805546 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.805372    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f268f3c9-3af3-4933-a0db-be2255944286-istio-token\") pod \"f268f3c9-3af3-4933-a0db-be2255944286\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") "
Aug 05 17:38:52.805546 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.805390    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-istio-data\") pod \"f268f3c9-3af3-4933-a0db-be2255944286\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") "
Aug 05 17:38:52.805546 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.805435    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-credential-socket\") pod \"f268f3c9-3af3-4933-a0db-be2255944286\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") "
Aug 05 17:38:52.805546 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.805464    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f268f3c9-3af3-4933-a0db-be2255944286-istio-podinfo\") pod \"f268f3c9-3af3-4933-a0db-be2255944286\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") "
Aug 05 17:38:52.805546 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.805490    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-workload-certs\") pod \"f268f3c9-3af3-4933-a0db-be2255944286\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") "
Aug 05 17:38:52.805546 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.805529    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f268f3c9-3af3-4933-a0db-be2255944286-istiod-ca-cert\") pod \"f268f3c9-3af3-4933-a0db-be2255944286\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") "
Aug 05 17:38:52.805890 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.805639    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-workload-socket\") pod \"f268f3c9-3af3-4933-a0db-be2255944286\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") "
Aug 05 17:38:52.805890 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.805670    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvlkm\" (UniqueName: \"kubernetes.io/projected/f268f3c9-3af3-4933-a0db-be2255944286-kube-api-access-lvlkm\") pod \"f268f3c9-3af3-4933-a0db-be2255944286\" (UID: \"f268f3c9-3af3-4933-a0db-be2255944286\") "
Aug 05 17:38:52.805890 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.805770    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f268f3c9-3af3-4933-a0db-be2255944286" (UID: "f268f3c9-3af3-4933-a0db-be2255944286"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:52.805890 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.805781    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-istio-data" (OuterVolumeSpecName: "istio-data") pod "f268f3c9-3af3-4933-a0db-be2255944286" (UID: "f268f3c9-3af3-4933-a0db-be2255944286"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:52.806138 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.805960    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f268f3c9-3af3-4933-a0db-be2255944286" (UID: "f268f3c9-3af3-4933-a0db-be2255944286"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:52.806138 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.805972    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f268f3c9-3af3-4933-a0db-be2255944286-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f268f3c9-3af3-4933-a0db-be2255944286" (UID: "f268f3c9-3af3-4933-a0db-be2255944286"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:38:52.806138 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.805976    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-istio-data\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:52.806138 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.806010    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-credential-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:52.806138 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.806088    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f268f3c9-3af3-4933-a0db-be2255944286" (UID: "f268f3c9-3af3-4933-a0db-be2255944286"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:52.807688 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.807661    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f268f3c9-3af3-4933-a0db-be2255944286-istio-token" (OuterVolumeSpecName: "istio-token") pod "f268f3c9-3af3-4933-a0db-be2255944286" (UID: "f268f3c9-3af3-4933-a0db-be2255944286"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:52.807688 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.807678    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f268f3c9-3af3-4933-a0db-be2255944286-kube-api-access-lvlkm" (OuterVolumeSpecName: "kube-api-access-lvlkm") pod "f268f3c9-3af3-4933-a0db-be2255944286" (UID: "f268f3c9-3af3-4933-a0db-be2255944286"). InnerVolumeSpecName "kube-api-access-lvlkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:52.807903 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.807879    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f268f3c9-3af3-4933-a0db-be2255944286" (UID: "f268f3c9-3af3-4933-a0db-be2255944286"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:52.808004 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.807932    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f268f3c9-3af3-4933-a0db-be2255944286-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f268f3c9-3af3-4933-a0db-be2255944286" (UID: "f268f3c9-3af3-4933-a0db-be2255944286"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:38:52.907508 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.907479    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-istio-envoy\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:52.907508 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.907504    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f268f3c9-3af3-4933-a0db-be2255944286-istio-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:52.907508 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.907512    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f268f3c9-3af3-4933-a0db-be2255944286-istio-podinfo\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:52.907782 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.907522    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-workload-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:52.907782 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.907531    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f268f3c9-3af3-4933-a0db-be2255944286-istiod-ca-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:52.907782 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.907538    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f268f3c9-3af3-4933-a0db-be2255944286-workload-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:52.907782 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:52.907547    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvlkm\" (UniqueName: \"kubernetes.io/projected/f268f3c9-3af3-4933-a0db-be2255944286-kube-api-access-lvlkm\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:38:53.615497 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:53.615454    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j" event={"ID":"f268f3c9-3af3-4933-a0db-be2255944286","Type":"ContainerDied","Data":"a43083ef52581f736555eac5ac6e6d517814e7860463f3b4d3f28c6fbfdb1005"}
Aug 05 17:38:53.615497 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:53.615489    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"
Aug 05 17:38:53.615969 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:53.615529    2565 scope.go:117] "RemoveContainer" containerID="76cb940b32c9f8bcbfac3e176d764ae27eb90c01b6094f4f19073c4198919503"
Aug 05 17:38:53.637838 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:53.637811    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"]
Aug 05 17:38:53.642116 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:53.642061    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-a1e09f-openshift-default-55f8867b-cw84j"]
Aug 05 17:38:53.953226 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:38:53.953152    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f268f3c9-3af3-4933-a0db-be2255944286" path="/var/lib/kubelet/pods/f268f3c9-3af3-4933-a0db-be2255944286/volumes"
Aug 05 17:39:05.994011 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:05.993977    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"]
Aug 05 17:39:05.994455 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:05.994244    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx" podUID="2014bb1a-4547-4455-afc8-5acd99344db4" containerName="istio-proxy" containerID="cri-o://60893c138594cfe86c5f01bd11991dcc2aa6912ebd0980ee5f4823db11f2eaea" gracePeriod=30
Aug 05 17:39:11.262527 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.262470    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:39:11.366982 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.366944    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-credential-socket\") pod \"2014bb1a-4547-4455-afc8-5acd99344db4\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") "
Aug 05 17:39:11.367202 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367013    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-workload-socket\") pod \"2014bb1a-4547-4455-afc8-5acd99344db4\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") "
Aug 05 17:39:11.367202 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367056    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2014bb1a-4547-4455-afc8-5acd99344db4-istio-token\") pod \"2014bb1a-4547-4455-afc8-5acd99344db4\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") "
Aug 05 17:39:11.367202 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367089    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2014bb1a-4547-4455-afc8-5acd99344db4-istio-podinfo\") pod \"2014bb1a-4547-4455-afc8-5acd99344db4\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") "
Aug 05 17:39:11.367202 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367142    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mk2v\" (UniqueName: \"kubernetes.io/projected/2014bb1a-4547-4455-afc8-5acd99344db4-kube-api-access-5mk2v\") pod \"2014bb1a-4547-4455-afc8-5acd99344db4\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") "
Aug 05 17:39:11.367202 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367170    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-istio-envoy\") pod \"2014bb1a-4547-4455-afc8-5acd99344db4\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") "
Aug 05 17:39:11.367488 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367204    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-istio-data\") pod \"2014bb1a-4547-4455-afc8-5acd99344db4\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") "
Aug 05 17:39:11.367488 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367245    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2014bb1a-4547-4455-afc8-5acd99344db4-istiod-ca-cert\") pod \"2014bb1a-4547-4455-afc8-5acd99344db4\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") "
Aug 05 17:39:11.367488 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367282    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2014bb1a-4547-4455-afc8-5acd99344db4" (UID: "2014bb1a-4547-4455-afc8-5acd99344db4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:39:11.367488 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367296    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-workload-certs\") pod \"2014bb1a-4547-4455-afc8-5acd99344db4\" (UID: \"2014bb1a-4547-4455-afc8-5acd99344db4\") "
Aug 05 17:39:11.367488 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367342    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2014bb1a-4547-4455-afc8-5acd99344db4" (UID: "2014bb1a-4547-4455-afc8-5acd99344db4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:39:11.367737 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367508    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-istio-data" (OuterVolumeSpecName: "istio-data") pod "2014bb1a-4547-4455-afc8-5acd99344db4" (UID: "2014bb1a-4547-4455-afc8-5acd99344db4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:39:11.367737 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367528    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2014bb1a-4547-4455-afc8-5acd99344db4" (UID: "2014bb1a-4547-4455-afc8-5acd99344db4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:39:11.367737 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367709    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-istio-data\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:39:11.367737 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367728    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-workload-certs\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:39:11.367921 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367741    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-credential-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:39:11.367921 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367753    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-workload-socket\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:39:11.367921 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.367873    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2014bb1a-4547-4455-afc8-5acd99344db4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2014bb1a-4547-4455-afc8-5acd99344db4" (UID: "2014bb1a-4547-4455-afc8-5acd99344db4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:39:11.369419 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.369385    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2014bb1a-4547-4455-afc8-5acd99344db4-kube-api-access-5mk2v" (OuterVolumeSpecName: "kube-api-access-5mk2v") pod "2014bb1a-4547-4455-afc8-5acd99344db4" (UID: "2014bb1a-4547-4455-afc8-5acd99344db4"). InnerVolumeSpecName "kube-api-access-5mk2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:39:11.369542 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.369428    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2014bb1a-4547-4455-afc8-5acd99344db4-istio-token" (OuterVolumeSpecName: "istio-token") pod "2014bb1a-4547-4455-afc8-5acd99344db4" (UID: "2014bb1a-4547-4455-afc8-5acd99344db4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:39:11.369591 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.369558    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2014bb1a-4547-4455-afc8-5acd99344db4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2014bb1a-4547-4455-afc8-5acd99344db4" (UID: "2014bb1a-4547-4455-afc8-5acd99344db4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 17:39:11.369695 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.369677    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2014bb1a-4547-4455-afc8-5acd99344db4" (UID: "2014bb1a-4547-4455-afc8-5acd99344db4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:39:11.468646 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.468608    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2014bb1a-4547-4455-afc8-5acd99344db4-istio-podinfo\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:39:11.468646 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.468642    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mk2v\" (UniqueName: \"kubernetes.io/projected/2014bb1a-4547-4455-afc8-5acd99344db4-kube-api-access-5mk2v\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:39:11.468646 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.468652    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2014bb1a-4547-4455-afc8-5acd99344db4-istio-envoy\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:39:11.468888 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.468661    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2014bb1a-4547-4455-afc8-5acd99344db4-istiod-ca-cert\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:39:11.468888 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.468669    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2014bb1a-4547-4455-afc8-5acd99344db4-istio-token\") on node \"ip-10-0-138-233.ec2.internal\" DevicePath \"\""
Aug 05 17:39:11.710886 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.710848    2565 generic.go:356] "Generic (PLEG): container finished" podID="2014bb1a-4547-4455-afc8-5acd99344db4" containerID="60893c138594cfe86c5f01bd11991dcc2aa6912ebd0980ee5f4823db11f2eaea" exitCode=0
Aug 05 17:39:11.711088 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.710903    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"
Aug 05 17:39:11.711088 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.710902    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx" event={"ID":"2014bb1a-4547-4455-afc8-5acd99344db4","Type":"ContainerDied","Data":"60893c138594cfe86c5f01bd11991dcc2aa6912ebd0980ee5f4823db11f2eaea"}
Aug 05 17:39:11.711088 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.711045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx" event={"ID":"2014bb1a-4547-4455-afc8-5acd99344db4","Type":"ContainerDied","Data":"3dedee807766f428ee4548ad2e2208beab99ce2487123c2cf3f93a43b53976d4"}
Aug 05 17:39:11.711088 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.711083    2565 scope.go:117] "RemoveContainer" containerID="60893c138594cfe86c5f01bd11991dcc2aa6912ebd0980ee5f4823db11f2eaea"
Aug 05 17:39:11.720135 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.720120    2565 scope.go:117] "RemoveContainer" containerID="fb328e519d2592aa4e1160b13b9915f8d69580d5445e482e453def0b0b759300"
Aug 05 17:39:11.727867 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.727847    2565 scope.go:117] "RemoveContainer" containerID="60893c138594cfe86c5f01bd11991dcc2aa6912ebd0980ee5f4823db11f2eaea"
Aug 05 17:39:11.728150 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:39:11.728130    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60893c138594cfe86c5f01bd11991dcc2aa6912ebd0980ee5f4823db11f2eaea\": container with ID starting with 60893c138594cfe86c5f01bd11991dcc2aa6912ebd0980ee5f4823db11f2eaea not found: ID does not exist" containerID="60893c138594cfe86c5f01bd11991dcc2aa6912ebd0980ee5f4823db11f2eaea"
Aug 05 17:39:11.728206 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.728159    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60893c138594cfe86c5f01bd11991dcc2aa6912ebd0980ee5f4823db11f2eaea"} err="failed to get container status \"60893c138594cfe86c5f01bd11991dcc2aa6912ebd0980ee5f4823db11f2eaea\": rpc error: code = NotFound desc = could not find container \"60893c138594cfe86c5f01bd11991dcc2aa6912ebd0980ee5f4823db11f2eaea\": container with ID starting with 60893c138594cfe86c5f01bd11991dcc2aa6912ebd0980ee5f4823db11f2eaea not found: ID does not exist"
Aug 05 17:39:11.728206 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.728176    2565 scope.go:117] "RemoveContainer" containerID="fb328e519d2592aa4e1160b13b9915f8d69580d5445e482e453def0b0b759300"
Aug 05 17:39:11.728390 ip-10-0-138-233 kubenswrapper[2565]: E0805 17:39:11.728372    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb328e519d2592aa4e1160b13b9915f8d69580d5445e482e453def0b0b759300\": container with ID starting with fb328e519d2592aa4e1160b13b9915f8d69580d5445e482e453def0b0b759300 not found: ID does not exist" containerID="fb328e519d2592aa4e1160b13b9915f8d69580d5445e482e453def0b0b759300"
Aug 05 17:39:11.728446 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.728399    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb328e519d2592aa4e1160b13b9915f8d69580d5445e482e453def0b0b759300"} err="failed to get container status \"fb328e519d2592aa4e1160b13b9915f8d69580d5445e482e453def0b0b759300\": rpc error: code = NotFound desc = could not find container \"fb328e519d2592aa4e1160b13b9915f8d69580d5445e482e453def0b0b759300\": container with ID starting with fb328e519d2592aa4e1160b13b9915f8d69580d5445e482e453def0b0b759300 not found: ID does not exist"
Aug 05 17:39:11.732396 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.732374    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"]
Aug 05 17:39:11.737061 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.737038    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-a81ee3-openshift-default-5cd6cf6568-vklnx"]
Aug 05 17:39:11.828842 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.828817    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wtcf8_c3f769e6-47f6-4ef5-bd99-1f1e109d9560/manager/0.log"
Aug 05 17:39:11.942906 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.942873    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-pfffz_3b0e3360-4f3f-4448-8912-1935834449a2/manager/0.log"
Aug 05 17:39:11.952513 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:11.952490    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2014bb1a-4547-4455-afc8-5acd99344db4" path="/var/lib/kubelet/pods/2014bb1a-4547-4455-afc8-5acd99344db4/volumes"
Aug 05 17:39:12.054493 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:12.054468    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f7778ff75-27k4r_26cfd6af-ac2d-4419-9cb7-e4edbf6cf016/manager/0.log"
Aug 05 17:39:12.170773 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:12.170752    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6n7pc_760b8ac3-fc68-4b63-aed9-5d659186013a/server/0.log"
Aug 05 17:39:12.294990 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:12.294963    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hwwbv_aca483ee-433c-4c86-847c-8f7795f0b77e/manager/0.log"
Aug 05 17:39:12.430581 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:12.430508    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b469b89cc-bw6xd_46ae273b-7295-437f-aa9e-8ce7c2267d12/manager/0.log"
Aug 05 17:39:12.439898 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:12.439877    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b469b89cc-bw6xd_46ae273b-7295-437f-aa9e-8ce7c2267d12/copy-manifests/0.log"
Aug 05 17:39:13.117372 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:13.117336    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29765820-pwxgn_f9cdc316-13cd-45c7-885f-6ee856e88ec4/cleanup/0.log"
Aug 05 17:39:13.240891 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:13.240867    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29765835-shgrn_a2324861-6a4a-499b-bb71-183dedc3fcb8/cleanup/0.log"
Aug 05 17:39:13.462285 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:13.462201    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-r76nh_e8fe28ce-e7f6-4839-9898-7c0e2286f8be/postgres/0.log"
Aug 05 17:39:14.326165 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:14.326118    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-zndpx_b1c517e7-78c8-414d-aa70-0e75c6445b21/manager/0.log"
Aug 05 17:39:14.445315 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:14.445284    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-bwsr4_63f7f563-275c-4c42-890b-31e5fc3ed06b/manager/0.log"
Aug 05 17:39:14.667782 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:14.667706    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-cjvvc_4d8cd1e8-8354-49b0-98d6-1b77f8e15530/manager/0.log"
Aug 05 17:39:15.222359 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:15.222329    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62_63cf83c5-a91f-4968-9544-a41ce0330473/istio-proxy/0.log"
Aug 05 17:39:15.574823 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:15.574793    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-558bb69c48-tw9pv_93a27b55-38da-4d1c-b91c-4b9bd5cefec9/kube-auth-proxy/0.log"
Aug 05 17:39:15.697383 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:15.697355    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vmm6m_b74ce519-2869-4fb6-8a25-546889825c39/istio-proxy/1.log"
Aug 05 17:39:15.829475 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:15.829395    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-qhbfm_9a6e6249-af7f-4a70-bcdd-dee55a78aee3/payload-pre-processing/0.log"
Aug 05 17:39:15.945646 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:15.945615    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q5jnc_129fa8c6-36f6-4e83-8e1d-194d567e0215/payload-processing/0.log"
Aug 05 17:39:16.419274 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:16.419241    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-gv7z6_cd63414e-d06d-454a-86ee-cd1548b47fee/main/0.log"
Aug 05 17:39:16.640574 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:16.640552    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7jdtr_1aa51ae6-f5a7-4558-9c73-8ccebc744a4b/main/0.log"
Aug 05 17:39:16.872262 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:16.872233    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dpqhq_f703efcd-61a1-46a1-ba6d-2f08fa07e547/main/0.log"
Aug 05 17:39:22.658569 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658536    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w2hzf/must-gather-2d864"]
Aug 05 17:39:22.658958 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658889    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f268f3c9-3af3-4933-a0db-be2255944286" containerName="istio-proxy"
Aug 05 17:39:22.658958 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658900    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f268f3c9-3af3-4933-a0db-be2255944286" containerName="istio-proxy"
Aug 05 17:39:22.658958 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658911    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c73d51b6-562e-4f16-a276-285a98773c4f" containerName="istio-proxy"
Aug 05 17:39:22.658958 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658917    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c73d51b6-562e-4f16-a276-285a98773c4f" containerName="istio-proxy"
Aug 05 17:39:22.658958 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658926    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c73d51b6-562e-4f16-a276-285a98773c4f" containerName="istio-proxy"
Aug 05 17:39:22.658958 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658932    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c73d51b6-562e-4f16-a276-285a98773c4f" containerName="istio-proxy"
Aug 05 17:39:22.658958 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658940    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2014bb1a-4547-4455-afc8-5acd99344db4" containerName="istio-proxy"
Aug 05 17:39:22.658958 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658945    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2014bb1a-4547-4455-afc8-5acd99344db4" containerName="istio-proxy"
Aug 05 17:39:22.658958 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658953    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2014bb1a-4547-4455-afc8-5acd99344db4" containerName="istio-proxy"
Aug 05 17:39:22.658958 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658958    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2014bb1a-4547-4455-afc8-5acd99344db4" containerName="istio-proxy"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658965    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14c1a8a8-907c-445d-bc20-b480d4d0949d" containerName="payload-pre-processing"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658970    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="14c1a8a8-907c-445d-bc20-b480d4d0949d" containerName="payload-pre-processing"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658980    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95307342-5be5-4f76-9879-18286ffce17c" containerName="payload-processing"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658985    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="95307342-5be5-4f76-9879-18286ffce17c" containerName="payload-processing"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658993    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7000ea51-8641-4063-8695-bc9efa6f2dc4" containerName="istio-proxy"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.658999    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7000ea51-8641-4063-8695-bc9efa6f2dc4" containerName="istio-proxy"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659005    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4e04fc3-7513-401d-8d81-366a7164a217" containerName="payload-pre-processing"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659010    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4e04fc3-7513-401d-8d81-366a7164a217" containerName="payload-pre-processing"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659015    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7000ea51-8641-4063-8695-bc9efa6f2dc4" containerName="istio-proxy"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659020    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7000ea51-8641-4063-8695-bc9efa6f2dc4" containerName="istio-proxy"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659067    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2014bb1a-4547-4455-afc8-5acd99344db4" containerName="istio-proxy"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659074    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c73d51b6-562e-4f16-a276-285a98773c4f" containerName="istio-proxy"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659082    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="95307342-5be5-4f76-9879-18286ffce17c" containerName="payload-processing"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659088    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f268f3c9-3af3-4933-a0db-be2255944286" containerName="istio-proxy"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659106    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2014bb1a-4547-4455-afc8-5acd99344db4" containerName="istio-proxy"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659112    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7000ea51-8641-4063-8695-bc9efa6f2dc4" containerName="istio-proxy"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659117    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7000ea51-8641-4063-8695-bc9efa6f2dc4" containerName="istio-proxy"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659126    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4e04fc3-7513-401d-8d81-366a7164a217" containerName="payload-pre-processing"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659134    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="14c1a8a8-907c-445d-bc20-b480d4d0949d" containerName="payload-pre-processing"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659199    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f268f3c9-3af3-4933-a0db-be2255944286" containerName="istio-proxy"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659204    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f268f3c9-3af3-4933-a0db-be2255944286" containerName="istio-proxy"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659264    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f268f3c9-3af3-4933-a0db-be2255944286" containerName="istio-proxy"
Aug 05 17:39:22.659321 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.659273    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c73d51b6-562e-4f16-a276-285a98773c4f" containerName="istio-proxy"
Aug 05 17:39:22.663806 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.663789    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2hzf/must-gather-2d864"
Aug 05 17:39:22.674431 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.674413    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w2hzf\"/\"default-dockercfg-hjlhd\""
Aug 05 17:39:22.675417 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.675389    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w2hzf\"/\"openshift-service-ca.crt\""
Aug 05 17:39:22.675675 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.675662    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w2hzf\"/\"kube-root-ca.crt\""
Aug 05 17:39:22.690801 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.690781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2hzf/must-gather-2d864"]
Aug 05 17:39:22.764034 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.764004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65q42\" (UniqueName: \"kubernetes.io/projected/33e75950-70d1-4091-ab41-70212fd51d5a-kube-api-access-65q42\") pod \"must-gather-2d864\" (UID: \"33e75950-70d1-4091-ab41-70212fd51d5a\") " pod="openshift-must-gather-w2hzf/must-gather-2d864"
Aug 05 17:39:22.764229 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.764078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/33e75950-70d1-4091-ab41-70212fd51d5a-must-gather-output\") pod \"must-gather-2d864\" (UID: \"33e75950-70d1-4091-ab41-70212fd51d5a\") " pod="openshift-must-gather-w2hzf/must-gather-2d864"
Aug 05 17:39:22.864932 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.864896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65q42\" (UniqueName: \"kubernetes.io/projected/33e75950-70d1-4091-ab41-70212fd51d5a-kube-api-access-65q42\") pod \"must-gather-2d864\" (UID: \"33e75950-70d1-4091-ab41-70212fd51d5a\") " pod="openshift-must-gather-w2hzf/must-gather-2d864"
Aug 05 17:39:22.865121 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.864962    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/33e75950-70d1-4091-ab41-70212fd51d5a-must-gather-output\") pod \"must-gather-2d864\" (UID: \"33e75950-70d1-4091-ab41-70212fd51d5a\") " pod="openshift-must-gather-w2hzf/must-gather-2d864"
Aug 05 17:39:22.865255 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.865235    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/33e75950-70d1-4091-ab41-70212fd51d5a-must-gather-output\") pod \"must-gather-2d864\" (UID: \"33e75950-70d1-4091-ab41-70212fd51d5a\") " pod="openshift-must-gather-w2hzf/must-gather-2d864"
Aug 05 17:39:22.878020 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.877999    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65q42\" (UniqueName: \"kubernetes.io/projected/33e75950-70d1-4091-ab41-70212fd51d5a-kube-api-access-65q42\") pod \"must-gather-2d864\" (UID: \"33e75950-70d1-4091-ab41-70212fd51d5a\") " pod="openshift-must-gather-w2hzf/must-gather-2d864"
Aug 05 17:39:22.972622 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:22.972589    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2hzf/must-gather-2d864"
Aug 05 17:39:23.121447 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:23.121418    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2hzf/must-gather-2d864"]
Aug 05 17:39:23.122653 ip-10-0-138-233 kubenswrapper[2565]: W0805 17:39:23.122628    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33e75950_70d1_4091_ab41_70212fd51d5a.slice/crio-ca74b66d662e4a5ee44a2a20ca746f24c215623a229af6dcee5d0a1b32127d89 WatchSource:0}: Error finding container ca74b66d662e4a5ee44a2a20ca746f24c215623a229af6dcee5d0a1b32127d89: Status 404 returned error can't find the container with id ca74b66d662e4a5ee44a2a20ca746f24c215623a229af6dcee5d0a1b32127d89
Aug 05 17:39:23.124523 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:23.124507    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:39:23.774292 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:23.774258    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2hzf/must-gather-2d864" event={"ID":"33e75950-70d1-4091-ab41-70212fd51d5a","Type":"ContainerStarted","Data":"ca74b66d662e4a5ee44a2a20ca746f24c215623a229af6dcee5d0a1b32127d89"}
Aug 05 17:39:24.781415 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:24.781376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2hzf/must-gather-2d864" event={"ID":"33e75950-70d1-4091-ab41-70212fd51d5a","Type":"ContainerStarted","Data":"878b6a558d79f64e6dff14c4e3f1e52274220876e12ece4e978dd28032fbf0e8"}
Aug 05 17:39:24.781790 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:24.781428    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2hzf/must-gather-2d864" event={"ID":"33e75950-70d1-4091-ab41-70212fd51d5a","Type":"ContainerStarted","Data":"29770c301097fa9bcc45418e23bc439b65437e91a49795665a326aa951a19d5f"}
Aug 05 17:39:24.802646 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:24.802551    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w2hzf/must-gather-2d864" podStartSLOduration=2.057607433 podStartE2EDuration="2.802528387s" totalImagesPullingTime="744.920954ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:39:24.799897191 +0000 UTC m=+3637.381968848" watchObservedRunningTime="2026-08-05 17:39:24.802528387 +0000 UTC m=+3637.384600045"
Aug 05 17:39:25.585753 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:25.585720    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qjpz2_c78cfde8-7c7b-4364-863a-116fe6296403/global-pull-secret-syncer/0.log"
Aug 05 17:39:25.686467 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:25.686427    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xgbcz_382b20e8-1d7c-4476-826b-f9abf1316d84/konnectivity-agent/0.log"
Aug 05 17:39:25.805356 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:25.805321    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-233.ec2.internal_2195b22536e7a63f1b330fe10277dc4d/haproxy/0.log"
Aug 05 17:39:31.132404 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:31.132375    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-zndpx_b1c517e7-78c8-414d-aa70-0e75c6445b21/manager/0.log"
Aug 05 17:39:31.176182 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:31.176138    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-bwsr4_63f7f563-275c-4c42-890b-31e5fc3ed06b/manager/0.log"
Aug 05 17:39:31.333778 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:31.333739    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-cjvvc_4d8cd1e8-8354-49b0-98d6-1b77f8e15530/manager/0.log"
Aug 05 17:39:34.258419 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:34.258388    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-msmpd_d3c76437-61db-4e9b-adee-dc9f1fabd66c/node-exporter/0.log"
Aug 05 17:39:34.289194 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:34.289164    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-msmpd_d3c76437-61db-4e9b-adee-dc9f1fabd66c/kube-rbac-proxy/0.log"
Aug 05 17:39:34.326378 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:34.326349    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-msmpd_d3c76437-61db-4e9b-adee-dc9f1fabd66c/init-textfile/0.log"
Aug 05 17:39:35.184766 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.184730    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"]
Aug 05 17:39:35.190938 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.190909    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.205599 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.205564    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"]
Aug 05 17:39:35.292485 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.292440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4716c4d7-304c-48a7-9772-2e2d0e2fbc82-lib-modules\") pod \"perf-node-gather-daemonset-9j6wg\" (UID: \"4716c4d7-304c-48a7-9772-2e2d0e2fbc82\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.292485 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.292484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4716c4d7-304c-48a7-9772-2e2d0e2fbc82-podres\") pod \"perf-node-gather-daemonset-9j6wg\" (UID: \"4716c4d7-304c-48a7-9772-2e2d0e2fbc82\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.293055 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.292578    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4716c4d7-304c-48a7-9772-2e2d0e2fbc82-proc\") pod \"perf-node-gather-daemonset-9j6wg\" (UID: \"4716c4d7-304c-48a7-9772-2e2d0e2fbc82\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.293055 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.292601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4716c4d7-304c-48a7-9772-2e2d0e2fbc82-sys\") pod \"perf-node-gather-daemonset-9j6wg\" (UID: \"4716c4d7-304c-48a7-9772-2e2d0e2fbc82\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.293055 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.292633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt4fm\" (UniqueName: \"kubernetes.io/projected/4716c4d7-304c-48a7-9772-2e2d0e2fbc82-kube-api-access-jt4fm\") pod \"perf-node-gather-daemonset-9j6wg\" (UID: \"4716c4d7-304c-48a7-9772-2e2d0e2fbc82\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.393426 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.393371    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4716c4d7-304c-48a7-9772-2e2d0e2fbc82-lib-modules\") pod \"perf-node-gather-daemonset-9j6wg\" (UID: \"4716c4d7-304c-48a7-9772-2e2d0e2fbc82\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.393622 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.393435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4716c4d7-304c-48a7-9772-2e2d0e2fbc82-podres\") pod \"perf-node-gather-daemonset-9j6wg\" (UID: \"4716c4d7-304c-48a7-9772-2e2d0e2fbc82\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.393622 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.393496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4716c4d7-304c-48a7-9772-2e2d0e2fbc82-proc\") pod \"perf-node-gather-daemonset-9j6wg\" (UID: \"4716c4d7-304c-48a7-9772-2e2d0e2fbc82\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.393622 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.393523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4716c4d7-304c-48a7-9772-2e2d0e2fbc82-sys\") pod \"perf-node-gather-daemonset-9j6wg\" (UID: \"4716c4d7-304c-48a7-9772-2e2d0e2fbc82\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.393622 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.393552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt4fm\" (UniqueName: \"kubernetes.io/projected/4716c4d7-304c-48a7-9772-2e2d0e2fbc82-kube-api-access-jt4fm\") pod \"perf-node-gather-daemonset-9j6wg\" (UID: \"4716c4d7-304c-48a7-9772-2e2d0e2fbc82\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.394015 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.393992    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4716c4d7-304c-48a7-9772-2e2d0e2fbc82-podres\") pod \"perf-node-gather-daemonset-9j6wg\" (UID: \"4716c4d7-304c-48a7-9772-2e2d0e2fbc82\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.394199 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.394041    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4716c4d7-304c-48a7-9772-2e2d0e2fbc82-proc\") pod \"perf-node-gather-daemonset-9j6wg\" (UID: \"4716c4d7-304c-48a7-9772-2e2d0e2fbc82\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.394312 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.394085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4716c4d7-304c-48a7-9772-2e2d0e2fbc82-sys\") pod \"perf-node-gather-daemonset-9j6wg\" (UID: \"4716c4d7-304c-48a7-9772-2e2d0e2fbc82\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.394410 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.394202    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4716c4d7-304c-48a7-9772-2e2d0e2fbc82-lib-modules\") pod \"perf-node-gather-daemonset-9j6wg\" (UID: \"4716c4d7-304c-48a7-9772-2e2d0e2fbc82\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.410686 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.410650    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt4fm\" (UniqueName: \"kubernetes.io/projected/4716c4d7-304c-48a7-9772-2e2d0e2fbc82-kube-api-access-jt4fm\") pod \"perf-node-gather-daemonset-9j6wg\" (UID: \"4716c4d7-304c-48a7-9772-2e2d0e2fbc82\") " pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.505896 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.505816    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.689204 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.689158    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"]
Aug 05 17:39:35.867371 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.867328    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg" event={"ID":"4716c4d7-304c-48a7-9772-2e2d0e2fbc82","Type":"ContainerStarted","Data":"97005dd409389f8c00af65b76f2d63c922ab947e83560bc9d6d275e649507dc8"}
Aug 05 17:39:35.867577 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.867396    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg" event={"ID":"4716c4d7-304c-48a7-9772-2e2d0e2fbc82","Type":"ContainerStarted","Data":"e764141b0aeeae63bb79992ac585fb6420ae4f940266e7009ffa396b9c3fa6b1"}
Aug 05 17:39:35.867577 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.867427    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:35.887347 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:35.887275    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg" podStartSLOduration=0.887251166 podStartE2EDuration="887.251166ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:39:35.885994855 +0000 UTC m=+3648.468066512" watchObservedRunningTime="2026-08-05 17:39:35.887251166 +0000 UTC m=+3648.469322825"
Aug 05 17:39:40.399462 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:40.399428    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9hvbp_36075180-a7b5-4331-9929-41bf8e64d43d/dns/0.log"
Aug 05 17:39:40.449186 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:40.449155    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9hvbp_36075180-a7b5-4331-9929-41bf8e64d43d/kube-rbac-proxy/0.log"
Aug 05 17:39:40.585127 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:40.585068    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8m5sn_7bf8e77a-297f-4c1e-b328-5a3f67b1933d/dns-node-resolver/0.log"
Aug 05 17:39:41.623262 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:41.623229    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-njsvq_039cfccd-9099-4601-ad17-e55a36a84c17/node-ca/0.log"
Aug 05 17:39:41.885406 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:41.885329    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w2hzf/perf-node-gather-daemonset-9j6wg"
Aug 05 17:39:42.634111 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:42.634059    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62_63cf83c5-a91f-4968-9544-a41ce0330473/istio-proxy/0.log"
Aug 05 17:39:43.085457 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:43.085432    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-558bb69c48-tw9pv_93a27b55-38da-4d1c-b91c-4b9bd5cefec9/kube-auth-proxy/0.log"
Aug 05 17:39:43.119254 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:43.119217    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vmm6m_b74ce519-2869-4fb6-8a25-546889825c39/istio-proxy/0.log"
Aug 05 17:39:43.125978 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:43.125953    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vmm6m_b74ce519-2869-4fb6-8a25-546889825c39/istio-proxy/1.log"
Aug 05 17:39:43.167068 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:43.167029    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-qhbfm_9a6e6249-af7f-4a70-bcdd-dee55a78aee3/payload-pre-processing/0.log"
Aug 05 17:39:43.206357 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:43.206312    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q5jnc_129fa8c6-36f6-4e83-8e1d-194d567e0215/payload-processing/0.log"
Aug 05 17:39:44.333805 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:44.333775    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nrnbc_eb0d7c3a-680a-4e31-b6bf-1e80f231487b/serve-healthcheck-canary/0.log"
Aug 05 17:39:45.109002 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:45.108955    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6ckt_b63a3f07-540b-4b01-ad28-79c751b1db81/kube-rbac-proxy/0.log"
Aug 05 17:39:45.132318 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:45.132244    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6ckt_b63a3f07-540b-4b01-ad28-79c751b1db81/exporter/0.log"
Aug 05 17:39:45.156472 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:45.156442    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6ckt_b63a3f07-540b-4b01-ad28-79c751b1db81/extractor/0.log"
Aug 05 17:39:46.016261 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:46.016230    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62_63cf83c5-a91f-4968-9544-a41ce0330473/istio-proxy/0.log"
Aug 05 17:39:46.392704 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:46.392676    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-558bb69c48-tw9pv_93a27b55-38da-4d1c-b91c-4b9bd5cefec9/kube-auth-proxy/0.log"
Aug 05 17:39:46.414343 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:46.414309    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vmm6m_b74ce519-2869-4fb6-8a25-546889825c39/istio-proxy/0.log"
Aug 05 17:39:46.422285 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:46.422260    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vmm6m_b74ce519-2869-4fb6-8a25-546889825c39/istio-proxy/1.log"
Aug 05 17:39:46.447504 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:46.447466    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-qhbfm_9a6e6249-af7f-4a70-bcdd-dee55a78aee3/payload-pre-processing/0.log"
Aug 05 17:39:46.478023 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:46.477992    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q5jnc_129fa8c6-36f6-4e83-8e1d-194d567e0215/payload-processing/0.log"
Aug 05 17:39:47.543716 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:47.543658    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wtcf8_c3f769e6-47f6-4ef5-bd99-1f1e109d9560/manager/0.log"
Aug 05 17:39:47.866613 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:47.866579    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-pfffz_3b0e3360-4f3f-4448-8912-1935834449a2/manager/0.log"
Aug 05 17:39:47.876690 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:47.876655    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5gg62_63cf83c5-a91f-4968-9544-a41ce0330473/istio-proxy/0.log"
Aug 05 17:39:48.076026 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:48.075892    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f7778ff75-27k4r_26cfd6af-ac2d-4419-9cb7-e4edbf6cf016/manager/0.log"
Aug 05 17:39:48.103377 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:48.103353    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6n7pc_760b8ac3-fc68-4b63-aed9-5d659186013a/server/0.log"
Aug 05 17:39:48.202164 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:48.202069    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hwwbv_aca483ee-433c-4c86-847c-8f7795f0b77e/manager/0.log"
Aug 05 17:39:48.259383 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:48.259354    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b469b89cc-bw6xd_46ae273b-7295-437f-aa9e-8ce7c2267d12/manager/0.log"
Aug 05 17:39:48.270923 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:48.270893    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-558bb69c48-tw9pv_93a27b55-38da-4d1c-b91c-4b9bd5cefec9/kube-auth-proxy/0.log"
Aug 05 17:39:48.282451 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:48.282426    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b469b89cc-bw6xd_46ae273b-7295-437f-aa9e-8ce7c2267d12/copy-manifests/0.log"
Aug 05 17:39:48.290883 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:48.290852    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vmm6m_b74ce519-2869-4fb6-8a25-546889825c39/istio-proxy/0.log"
Aug 05 17:39:48.302383 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:48.302341    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vmm6m_b74ce519-2869-4fb6-8a25-546889825c39/istio-proxy/1.log"
Aug 05 17:39:48.331229 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:48.331194    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-qhbfm_9a6e6249-af7f-4a70-bcdd-dee55a78aee3/payload-pre-processing/0.log"
Aug 05 17:39:48.361749 ip-10-0-138-233 kubenswrapper[2565]: I0805 17:39:48.361701    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-q5jnc_129fa8c6-36f6-4e83-8e1d-194d567e0215/payload-processing/0.log"