Sep 10 17:11:54.469379 ip-10-0-140-192 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 17:11:54.853598 ip-10-0-140-192 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 17:11:54.853598 ip-10-0-140-192 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 17:11:54.853598 ip-10-0-140-192 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 17:11:54.853598 ip-10-0-140-192 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 17:11:54.853598 ip-10-0-140-192 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 17:11:54.855912 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.855815    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 17:11:54.861659 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861627    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 17:11:54.861659 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861652    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 17:11:54.861659 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861658    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 17:11:54.861659 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861662    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 17:11:54.861659 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861666    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861671    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861675    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861679    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861683    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861687    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861694    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861700    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861704    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861707    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861712    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861715    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861720    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861723    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861736    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861741    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861745    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861749    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861754    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861758    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 17:11:54.861996 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861761    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861765    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861769    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861773    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861777    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861781    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861785    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861789    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861793    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861796    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861800    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861804    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861807    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861811    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861817    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861821    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861825    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861830    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861834    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861838    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 17:11:54.862837 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861842    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861847    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861851    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861856    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861860    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861864    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861881    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861889    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861894    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861899    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861903    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861907    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861911    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861915    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861920    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861924    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861928    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861932    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861936    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 17:11:54.863703 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861941    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861945    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861949    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861953    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861957    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861961    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861967    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861972    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861976    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861981    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861985    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861989    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861994    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.861998    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862001    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862005    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862010    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862014    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862019    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862025    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 17:11:54.864605 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862039    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862045    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862065    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862070    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862074    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862079    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862083    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862087    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862092    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862096    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862101    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862105    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862109    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862114    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862118    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.862121    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863409    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863420    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863425    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 17:11:54.865489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863434    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863441    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863446    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863452    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863457    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863462    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863466    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863470    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863475    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863479    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863483    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863487    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863491    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863495    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863502    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863506    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863510    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863514    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863519    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863523    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 17:11:54.866317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863527    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863531    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863535    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863539    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863544    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863548    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863553    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863557    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863561    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863565    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863569    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863573    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863578    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863583    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863587    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863591    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863595    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863599    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863606    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863612    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 17:11:54.867075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863616    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863622    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863626    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863631    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863635    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863639    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863643    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863650    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863654    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863658    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863662    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863666    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863670    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863675    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863679    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863683    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863687    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863691    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863696    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863699    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 17:11:54.867660 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863704    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863709    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863713    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863717    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863721    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863726    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863730    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863735    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863739    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863746    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863750    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863754    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863758    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863764    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863770    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863774    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863778    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863783    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863787    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863791    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 17:11:54.868213 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863796    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863801    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863805    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863809    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863813    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863817    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863822    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863826    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863830    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863835    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863839    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863843    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863848    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863852    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863855    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.863860    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864604    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864616    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864621    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 17:11:54.868800 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864625    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864630    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864634    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864639    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864643    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864648    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864652    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864657    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864661    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864666    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864671    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864675    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864679    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864686    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864690    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864694    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864698    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864702    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864707    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 17:11:54.869428 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864711    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864715    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864719    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864723    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864728    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864732    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864737    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864741    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864745    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864750    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864755    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864759    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864764    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864768    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864772    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864777    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864782    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864789    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864794    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864799    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 17:11:54.869894 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864804    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864809    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864813    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864817    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864821    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864825    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864830    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864836    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864842    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864846    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864850    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864854    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864858    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864863    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864867    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864871    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864876    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864881    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864885    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864889    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 17:11:54.870506 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864893    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864898    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864903    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864908    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864912    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864916    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864920    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864925    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864929    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864933    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864937    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864941    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864945    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864950    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864954    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864958    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864962    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864966    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864971    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864975    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 17:11:54.871010 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864984    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864989    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864993    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.864998    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.865002    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.865006    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.865010    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.865017    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.865023    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.865027    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.865032    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.865038    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.865044    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.865068    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.865074    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.865079    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.865083    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865191    2576 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865249    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865264    2576 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 17:11:54.871548 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865272    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865279    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865284    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865291    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865299    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865304    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865309    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865314    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865320    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865325    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865329    2576 flags.go:64] FLAG: --cgroup-root=""
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865338    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865343    2576 flags.go:64] FLAG: --client-ca-file=""
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865348    2576 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865353    2576 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865359    2576 flags.go:64] FLAG: --cluster-domain=""
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865364    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865369    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865374    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865381    2576 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865388    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865392    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865397    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 17:11:54.872101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865402    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865407    2576 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865413    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865417    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865422    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865427    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865435    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865440    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865444    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865449    2576 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865454    2576 flags.go:64] FLAG: --enable-server="true"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865459    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865467    2576 flags.go:64] FLAG: --event-burst="100"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865472    2576 flags.go:64] FLAG: --event-qps="50"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865476    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865482    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865486    2576 flags.go:64] FLAG: --eviction-hard=""
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865492    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865497    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865501    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865507    2576 flags.go:64] FLAG: --eviction-soft=""
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865512    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865517    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865523    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865528    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 17:11:54.872664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865533    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865538    2576 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865543    2576 flags.go:64] FLAG: --feature-gates=""
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865554    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865558    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865564    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865569    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865574    2576 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865579    2576 flags.go:64] FLAG: --help="false"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865584    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-140-192.ec2.internal"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865590    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865594    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865599    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865604    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865610    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865615    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865619    2576 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865624    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865628    2576 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865633    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865638    2576 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865643    2576 flags.go:64] FLAG: --kube-reserved=""
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865648    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865653    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 17:11:54.873385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865658    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865662    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865667    2576 flags.go:64] FLAG: --lock-file=""
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865672    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865677    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865681    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865690    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865697    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865702    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865707    2576 flags.go:64] FLAG: --logging-format="text"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865711    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865718    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865723    2576 flags.go:64] FLAG: --manifest-url=""
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865728    2576 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865735    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865740    2576 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865746    2576 flags.go:64] FLAG: --max-pods="110"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865751    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865756    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865760    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865765    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865770    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865775    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865780    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865793    2576 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 17:11:54.873986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865798    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865803    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865808    2576 flags.go:64] FLAG: --pod-cidr=""
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865812    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865822    2576 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865827    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865832    2576 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865836    2576 flags.go:64] FLAG: --port="10250"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865841    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865846    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-042bdc087959c41bc"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865852    2576 flags.go:64] FLAG: --qos-reserved=""
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865858    2576 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865862    2576 flags.go:64] FLAG: --register-node="true"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865867    2576 flags.go:64] FLAG: --register-with-taints=""
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865873    2576 flags.go:64] FLAG: --registry-burst="10"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865879    2576 flags.go:64] FLAG: --registry-qps="5"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865883    2576 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865888    2576 flags.go:64] FLAG: --reserved-memory=""
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865894    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865902    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865907    2576 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865912    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865917    2576 flags.go:64] FLAG: --runonce="false"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865922    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865926    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 17:11:54.874631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865931    2576 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865937    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865942    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865946    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865951    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865956    2576 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865961    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865966    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865970    2576 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865975    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865981    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865985    2576 flags.go:64] FLAG: --system-cgroups=""
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865990    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.865999    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.866004    2576 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.866008    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.866015    2576 flags.go:64] FLAG: --tls-min-version=""
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.866020    2576 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.866025    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.866030    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.866035    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.866039    2576 flags.go:64] FLAG: --v="2"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.866046    2576 flags.go:64] FLAG: --version="false"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.866070    2576 flags.go:64] FLAG: --vmodule=""
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.866076    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 17:11:54.875273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.866081    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866288    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866296    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866300    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866305    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866310    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866314    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866318    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866322    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866326    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866330    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866334    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866338    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866342    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866346    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866351    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866356    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866360    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866364    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866369    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 17:11:54.875927 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866373    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866377    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866383    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866389    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866393    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866398    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866402    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866406    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866410    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866414    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866418    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866424    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866428    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866434    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866438    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866442    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866446    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866450    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866455    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 17:11:54.876455 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866459    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866463    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866468    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866472    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866481    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866485    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866489    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866496    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866501    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866507    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866512    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866518    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866526    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866532    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866537    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866542    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866546    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866553    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 17:11:54.876924 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866557    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866561    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866565    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866569    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866573    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866578    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866582    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866587    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866593    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866597    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866601    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866605    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866609    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866614    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866618    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866622    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866626    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866630    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866635    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866638    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 17:11:54.877437 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866643    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866647    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866651    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866655    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866659    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866663    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866667    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866671    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866676    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866680    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866684    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866690    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866694    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866698    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866702    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866706    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866711    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866715    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866719    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866723    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 17:11:54.877931 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866737    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 17:11:54.878451 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866742    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 17:11:54.878451 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.866746    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 17:11:54.878451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.867328    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 17:11:54.878451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.875126    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 17:11:54.878451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.875144    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 17:11:54.878451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.875833    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 17:11:54.878451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.875844    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 17:11:54.878451 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875915    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 17:11:54.878451 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875921    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 17:11:54.878451 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875924    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 17:11:54.878451 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875928    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 17:11:54.878451 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875931    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 17:11:54.878451 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875934    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 17:11:54.878451 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875937    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 17:11:54.878451 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875940    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875943    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875945    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875948    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875951    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875954    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875956    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875961    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875965    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875968    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875972    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875974    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875978    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875981    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875983    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875987    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875990    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875994    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.875997    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876000    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 17:11:54.878834 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876003    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876006    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876010    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876013    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876016    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876019    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876022    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876025    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876028    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876031    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876033    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876036    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876039    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876041    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876044    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876047    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876063    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876066    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876069    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876072    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 17:11:54.879382 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876074    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876077    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876081    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876084    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876088    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876090    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876093    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876104    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876108    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876111    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876121    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876124    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876127    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876130    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876133    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876136    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876138    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876141    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876144    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 17:11:54.879883 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876147    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876149    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876152    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876155    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876158    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876160    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876163    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876166    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876168    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876171    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876174    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876177    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876180    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876183    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876185    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876188    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876191    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876194    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876196    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876199    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 17:11:54.880370 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876202    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 17:11:54.880856 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876204    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 17:11:54.880856 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876207    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 17:11:54.880856 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876209    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 17:11:54.880856 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876213    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 17:11:54.880856 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876216    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 17:11:54.880856 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876218    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 17:11:54.880856 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876221    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 17:11:54.880856 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876224    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 17:11:54.880856 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876228    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 17:11:54.880856 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876232    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 17:11:54.880856 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876235    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 17:11:54.880856 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876238    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 17:11:54.880856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.876243    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 17:11:54.880856 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876363    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 17:11:54.880856 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876369    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876373    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876376    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876380    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876383    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876386    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876388    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876391    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876394    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876396    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876399    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876402    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876404    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876407    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876410    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876413    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876415    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876418    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876420    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 17:11:54.881249 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876423    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876426    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876428    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876436    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876439    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876442    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876444    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876447    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876450    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876453    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876455    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876458    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876461    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876464    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876466    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876469    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876472    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876474    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876477    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876479    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 17:11:54.881709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876482    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876485    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876487    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876490    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876492    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876495    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876497    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876500    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876503    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876505    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876508    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876510    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876513    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876515    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876518    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876520    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876526    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876529    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876531    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876534    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 17:11:54.882220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876537    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876539    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876542    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876544    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876547    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876549    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876552    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876554    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876557    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876559    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876562    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876564    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876567    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876569    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876572    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876574    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876577    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876579    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876582    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876585    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876587    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 17:11:54.882713 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876590    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876593    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876595    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876598    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876600    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876603    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876605    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876609    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876614    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876617    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876620    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876623    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876626    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876628    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876632    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876636    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876639    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 17:11:54.883317 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:54.876642    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 17:11:54.883739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.876646    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 17:11:54.883739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.876772    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 17:11:54.883739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.878777    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 17:11:54.883739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.879820    2576 server.go:1019] "Starting client certificate rotation"
Sep 10 17:11:54.883739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.879920    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 17:11:54.883739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.879961    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 17:11:54.883739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.882467    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 17:11:54.885327 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.885310    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 17:11:54.900201 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.900156    2576 log.go:25] "Validated CRI v1 runtime API"
Sep 10 17:11:54.903313 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.903295    2576 log.go:25] "Validated CRI v1 image API"
Sep 10 17:11:54.904175 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.904155    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 17:11:54.909395 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.909374    2576 fs.go:135] Filesystem UUIDs: map[676590b7-eec4-443b-a0ab-cb8ae6d3c86f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 90b7559f-8bee-426e-8c88-535247c9901f:/dev/nvme0n1p4]
Sep 10 17:11:54.909478 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.909393    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 17:11:54.910259 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.910242    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 17:11:54.915611 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.915497    2576 manager.go:216] Machine: {Timestamp:2026-09-10 17:11:54.914158837 +0000 UTC m=+0.330209777 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099615 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec242941e286ce7f81cdd705231ab220 SystemUUID:ec242941-e286-ce7f-81cd-d705231ab220 BootID:4bbcacc8-3805-493b-8eac-7be6ebe85c84 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cd:18:ed:e0:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cd:18:ed:e0:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:44:c2:05:34:57 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 17:11:54.915611 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.915608    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 17:11:54.915712 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.915697    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 17:11:54.918562 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.918531    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 17:11:54.918735 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.918565    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-192.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 17:11:54.919446 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.919433    2576 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 17:11:54.919500 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.919450    2576 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 17:11:54.919500 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.919461    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 17:11:54.920122 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.920109    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 17:11:54.920863 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.920852    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 17:11:54.924807 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.924792    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 17:11:54.924955 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.924944    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 17:11:54.925020 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.924990    2576 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 17:11:54.925020 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.925012    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 17:11:54.925124 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.925030    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 17:11:54.925124 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.925044    2576 kubelet.go:398] "Adding apiserver pod source"
Sep 10 17:11:54.925124 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.925073    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 17:11:54.925461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.925446    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 17:11:54.925530 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.925469    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 17:11:54.927741 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.927721    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 17:11:54.929874 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.929860    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 17:11:54.929918 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.929890    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 17:11:54.930892 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.930881    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 17:11:54.930938 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.930897    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 17:11:54.930938 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.930903    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 17:11:54.930938 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.930908    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 17:11:54.930938 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.930917    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 17:11:54.930938 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.930923    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 17:11:54.930938 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.930937    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 17:11:54.931153 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.930942    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 17:11:54.931153 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.930948    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 17:11:54.931153 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.930954    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 17:11:54.931153 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.930962    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 17:11:54.931153 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.930967    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 17:11:54.931749 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.931736    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 17:11:54.931749 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.931748    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 17:11:54.935518 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.935497    2576 server.go:1268] "Started kubelet"
Sep 10 17:11:54.935618 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.935554    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 17:11:54.935790 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.935664    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 17:11:54.935904 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.935886    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 17:11:54.936447 ip-10-0-140-192 systemd[1]: Started Kubernetes Kubelet.
Sep 10 17:11:54.936945 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.936907    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 17:11:54.937089 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.937072    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-192.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 17:11:54.938122 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:54.938091    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 17:11:54.938122 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:54.938092    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 17:11:54.938409 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.938395    2576 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 17:11:54.939809 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:54.939776    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 17:11:54.942590 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.942573    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 17:11:54.942697 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.942581    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 17:11:54.942783 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.942696    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2556z"
Sep 10 17:11:54.942857 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:54.942777    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 10 17:11:54.943191 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.943162    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 17:11:54.943191 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.943182    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 17:11:54.943322 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.943267    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 17:11:54.943365 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.943332    2576 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 17:11:54.943365 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.943341    2576 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 17:11:54.944948 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:54.944923    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 17:11:54.946767 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:54.944756    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-192.ec2.internal.18d404e0a97a2cbc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-192.ec2.internal,UID:ip-10-0-140-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-192.ec2.internal,},FirstTimestamp:2026-09-10 17:11:54.935471292 +0000 UTC m=+0.351522232,LastTimestamp:2026-09-10 17:11:54.935471292 +0000 UTC m=+0.351522232,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-192.ec2.internal,}"
Sep 10 17:11:54.948118 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.948093    2576 factory.go:55] Registering systemd factory
Sep 10 17:11:54.948118 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.948120    2576 factory.go:223] Registration of the systemd container factory successfully
Sep 10 17:11:54.948345 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.948323    2576 factory.go:153] Registering CRI-O factory
Sep 10 17:11:54.948345 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.948342    2576 factory.go:223] Registration of the crio container factory successfully
Sep 10 17:11:54.948468 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.948395    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 17:11:54.948468 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.948415    2576 factory.go:103] Registering Raw factory
Sep 10 17:11:54.948468 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.948430    2576 manager.go:1196] Started watching for new ooms in manager
Sep 10 17:11:54.948761 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.948747    2576 manager.go:349] Starting recovery of all containers
Sep 10 17:11:54.949234 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:54.949209    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 17:11:54.949761 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.949734    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2556z"
Sep 10 17:11:54.957807 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.957642    2576 manager.go:354] Recovery completed
Sep 10 17:11:54.963636 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.963618    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 17:11:54.966790 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.966767    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 17:11:54.966902 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.966807    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 17:11:54.966902 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.966823    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Sep 10 17:11:54.967935 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.967920    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 17:11:54.967935 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.967933    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 17:11:54.968102 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.967945    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 17:11:54.968102 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.967948    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 17:11:54.968821 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.968804    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 17:11:54.968911 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.968833    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 17:11:54.968911 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.968846    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Sep 10 17:11:54.969340 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:54.969274    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-192.ec2.internal.18d404e0ab580cbe  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-192.ec2.internal,UID:ip-10-0-140-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-192.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-192.ec2.internal,},FirstTimestamp:2026-09-10 17:11:54.96678931 +0000 UTC m=+0.382840257,LastTimestamp:2026-09-10 17:11:54.96678931 +0000 UTC m=+0.382840257,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-192.ec2.internal,}"
Sep 10 17:11:54.970189 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.970176    2576 policy_none.go:49] "None policy: Start"
Sep 10 17:11:54.970243 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.970196    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 17:11:54.970243 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.970209    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 17:11:54.972273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:54.972257    2576 policy_none.go:47] "Start"
Sep 10 17:11:55.023157 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.018726    2576 manager.go:337] "Starting Device Plugin manager"
Sep 10 17:11:55.023157 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.018784    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 17:11:55.023157 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.018796    2576 server.go:87] "Starting device plugin registration server"
Sep 10 17:11:55.023157 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.019249    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 17:11:55.023157 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.019262    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 17:11:55.023157 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.019686    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 17:11:55.023157 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.019780    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 17:11:55.023157 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.019788    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 17:11:55.023157 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.020321    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 17:11:55.023157 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.020378    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 10 17:11:55.076534 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.076497    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 17:11:55.077720 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.077699    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 17:11:55.077844 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.077756    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 17:11:55.077844 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.077780    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 17:11:55.077844 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.077826    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 17:11:55.080150 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.080125    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 17:11:55.120368 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.120263    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 17:11:55.121344 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.121314    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 17:11:55.121463 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.121350    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 17:11:55.121463 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.121362    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Sep 10 17:11:55.121463 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.121385    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.127123 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.127102    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.127234 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.127130    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-192.ec2.internal\": node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 10 17:11:55.149596 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.149559    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 10 17:11:55.178660 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.178610    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"]
Sep 10 17:11:55.178817 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.178718    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 17:11:55.179725 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.179710    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 17:11:55.179803 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.179740    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 17:11:55.179803 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.179755    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Sep 10 17:11:55.181960 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.181943    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 17:11:55.182089 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.182076    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.182145 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.182115    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 17:11:55.182914 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.182890    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 17:11:55.182999 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.182919    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 17:11:55.182999 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.182931    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Sep 10 17:11:55.182999 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.182931    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 17:11:55.182999 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.182958    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 17:11:55.182999 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.182972    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Sep 10 17:11:55.185198 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.185180    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.185295 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.185212    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 17:11:55.186009 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.185993    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 17:11:55.186107 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.186020    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 17:11:55.186107 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.186033    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Sep 10 17:11:55.211866 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.211840    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-192.ec2.internal\" not found" node="ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.216355 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.216339    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-192.ec2.internal\" not found" node="ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.245468 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.245440    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/837b4f66dafcb9583a80e7a722354bf8-config\") pod \"kube-apiserver-proxy-ip-10-0-140-192.ec2.internal\" (UID: \"837b4f66dafcb9583a80e7a722354bf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.245468 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.245468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1aaa28eced54772227b642c1dccb5e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"a1aaa28eced54772227b642c1dccb5e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.245629 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.245487    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1aaa28eced54772227b642c1dccb5e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"a1aaa28eced54772227b642c1dccb5e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.250574 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.250555    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 10 17:11:55.346107 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.346075    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/837b4f66dafcb9583a80e7a722354bf8-config\") pod \"kube-apiserver-proxy-ip-10-0-140-192.ec2.internal\" (UID: \"837b4f66dafcb9583a80e7a722354bf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.346107 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.346113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1aaa28eced54772227b642c1dccb5e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"a1aaa28eced54772227b642c1dccb5e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.346293 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.346129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1aaa28eced54772227b642c1dccb5e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"a1aaa28eced54772227b642c1dccb5e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.346293 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.346191    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/837b4f66dafcb9583a80e7a722354bf8-config\") pod \"kube-apiserver-proxy-ip-10-0-140-192.ec2.internal\" (UID: \"837b4f66dafcb9583a80e7a722354bf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.346293 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.346205    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1aaa28eced54772227b642c1dccb5e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"a1aaa28eced54772227b642c1dccb5e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.346293 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.346198    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1aaa28eced54772227b642c1dccb5e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"a1aaa28eced54772227b642c1dccb5e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.351186 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.351165    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 10 17:11:55.452003 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.451928    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 10 17:11:55.514135 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.514105    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.519136 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.518950    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.552978 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.552954    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 10 17:11:55.653578 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.653529    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 10 17:11:55.754106 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.754016    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Sep 10 17:11:55.756780 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.756763    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 17:11:55.844193 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.844161    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.852634 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.852608    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 17:11:55.855168 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.855151    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 17:11:55.856165 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.856149    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Sep 10 17:11:55.865887 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.865866    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 17:11:55.879972 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.879950    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 17:11:55.880145 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.880126    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 17:11:55.880145 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.880127    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 17:11:55.880232 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.880127    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 17:11:55.925242 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.925206    2576 apiserver.go:52] "Watching apiserver"
Sep 10 17:11:55.939810 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.939764    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 17:11:55.940179 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.940158    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl","openshift-dns/node-resolver-gv72m","openshift-multus/multus-additional-cni-plugins-nwn9h","openshift-multus/multus-hll7w","openshift-multus/network-metrics-daemon-4xbqt","openshift-network-operator/iptables-alerter-x4z47","openshift-ovn-kubernetes/ovnkube-node-5hkvd","kube-system/global-pull-secret-syncer-55pvg","kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal","openshift-cluster-node-tuning-operator/tuned-867z2","openshift-image-registry/node-ca-ntdxg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal","openshift-network-diagnostics/network-check-target-9djxw","kube-system/konnectivity-agent-lxx99"]
Sep 10 17:11:55.942622 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.942599    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.943076 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.943044    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 17:11:55.944730 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.944715    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:11:55.944811 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.944786    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:11:55.944894 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.944879    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 17:11:55.944952 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.944888    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 17:11:55.944952 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.944884    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 17:11:55.945224 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.945205    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 17:11:55.945316 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.945305    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 17:11:55.945383 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.945371    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6m6lz\""
Sep 10 17:11:55.946138 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.946122    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 17:11:55.946950 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.946931    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:55.949160 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949137    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hll7w"
Sep 10 17:11:55.949423 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-run-openvswitch\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.949516 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.949516 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949465    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/41924057-6412-4ac4-8620-239853d4ff53-env-overrides\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.949516 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdsj2\" (UniqueName: \"kubernetes.io/projected/41924057-6412-4ac4-8620-239853d4ff53-kube-api-access-pdsj2\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.949642 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-slash\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.949642 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-var-lib-openvswitch\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.949642 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-run-ovn\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.949642 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-node-log\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.949642 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949610    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-log-socket\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.949880 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-cni-bin\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.949880 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-cni-netd\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.949880 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-systemd-units\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.949880 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-run-netns\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.949880 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-run-systemd\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.949880 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-run-ovn-kubernetes\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.949880 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/41924057-6412-4ac4-8620-239853d4ff53-ovnkube-config\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.950119 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949881    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9ghw\" (UniqueName: \"kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw\") pod \"network-check-target-9djxw\" (UID: \"649da03e-1ef2-473a-b16a-112caf256391\") " pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:11:55.950119 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.949909    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/41924057-6412-4ac4-8620-239853d4ff53-ovn-node-metrics-cert\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.950725 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.950590    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 17:11:55.950725 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.950597    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 17:11:55.950725 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.950629    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 17:11:55.950725 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.950603    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 17:11:55.951102 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.950963    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 17:11:55.952608 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.952541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/41924057-6412-4ac4-8620-239853d4ff53-ovnkube-script-lib\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.953933 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.953097    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-kubelet\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.953933 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.953434    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 17:11:55.953933 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.953726    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g8q78\""
Sep 10 17:11:55.953933 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.953796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-etc-openvswitch\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:55.954179 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.954096    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:11:55.954179 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.954154    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x4tfw\""
Sep 10 17:11:55.954272 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.954197    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:11:55.955668 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.955533    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 17:06:55 +0000 UTC" deadline="2028-02-24 09:50:03.524083816 +0000 UTC"
Sep 10 17:11:55.955757 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.955673    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12760h38m7.568419788s"
Sep 10 17:11:55.955816 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.955761    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x4z47"
Sep 10 17:11:55.957923 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.957907    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 17:11:55.958196 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.958173    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 17:11:55.958294 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.958225    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 17:11:55.958492 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.958471    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qjhbt\""
Sep 10 17:11:55.958609 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.958596    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lxx99"
Sep 10 17:11:55.960962 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.960945    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:55.961364 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.961349    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 17:11:55.961469 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.961452    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 17:11:55.961531 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.961468    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jkgw6\""
Sep 10 17:11:55.963077 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.963044    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 17:11:55.963077 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.963068    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rncgg\""
Sep 10 17:11:55.963196 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.963075    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 17:11:55.963360 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.963347    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gv72m"
Sep 10 17:11:55.963420 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.963382    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 17:11:55.965662 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.965645    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:55.965847 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.965825    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 17:11:55.966270 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.966246    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 17:11:55.966365 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.966295    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 17:11:55.966531 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.966512    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7p7jd\""
Sep 10 17:11:55.967882 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.967864    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 17:11:55.967882 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.967875    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5t7wm\""
Sep 10 17:11:55.968153 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.967956    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 17:11:55.968229 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.968136    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ntdxg"
Sep 10 17:11:55.970836 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.970815    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 17:11:55.971037 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.971025    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 17:11:55.974292 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.974270    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 17:11:55.974383 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.974329    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4g7cn\""
Sep 10 17:11:55.976714 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.976691    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:11:55.976809 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:55.976767    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:11:55.997936 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.997908    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r2pwb"
Sep 10 17:11:55.999690 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:55.999673    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 17:11:56.007514 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.007467    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r2pwb"
Sep 10 17:11:56.043889 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.043869    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 17:11:56.054509 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054476    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-cni-netd\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.054653 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-cnibin\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.054653 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054544    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-var-lib-cni-bin\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.054653 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054587    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-multus-conf-dir\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.054653 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054592    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-cni-netd\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.054653 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054629    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-device-dir\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.054653 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054650    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-run\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.054919 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-lib-modules\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.054919 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-host\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.054919 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-run-ovn-kubernetes\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.054919 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ghw\" (UniqueName: \"kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw\") pod \"network-check-target-9djxw\" (UID: \"649da03e-1ef2-473a-b16a-112caf256391\") " pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:11:56.054919 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054795    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-cni-binary-copy\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.054919 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh94j\" (UniqueName: \"kubernetes.io/projected/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-kube-api-access-vh94j\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.054919 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054833    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-run-ovn-kubernetes\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.054919 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/975bc37f-b97b-4804-b501-b1c2d87e72a3-agent-certs\") pod \"konnectivity-agent-lxx99\" (UID: \"975bc37f-b97b-4804-b501-b1c2d87e72a3\") " pod="kube-system/konnectivity-agent-lxx99"
Sep 10 17:11:56.054919 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-modprobe-d\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.054919 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054911    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bafbd9c5-ad9e-446b-8a01-64cdd4895832-host\") pod \"node-ca-ntdxg\" (UID: \"bafbd9c5-ad9e-446b-8a01-64cdd4895832\") " pod="openshift-image-registry/node-ca-ntdxg"
Sep 10 17:11:56.055286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bafbd9c5-ad9e-446b-8a01-64cdd4895832-serviceca\") pod \"node-ca-ntdxg\" (UID: \"bafbd9c5-ad9e-446b-8a01-64cdd4895832\") " pod="openshift-image-registry/node-ca-ntdxg"
Sep 10 17:11:56.055286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.054990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-system-cni-dir\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.055286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055015    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-etc-selinux\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.055286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055040    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76wqt\" (UniqueName: \"kubernetes.io/projected/3c0a4299-3198-4575-bba2-b689fa53c385-kube-api-access-76wqt\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.055286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-systemd\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.055286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055111    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/41924057-6412-4ac4-8620-239853d4ff53-env-overrides\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.055286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055134    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-socket-dir\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.055286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-log-socket\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.055286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-cni-bin\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.055286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055215    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57af622a-b174-4bad-9a84-d2d75c2ef6a0-cnibin\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.055286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055230    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-cni-bin\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.055286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkwlt\" (UniqueName: \"kubernetes.io/projected/8c1a0a20-5a72-4a67-817d-08658f7663ac-kube-api-access-wkwlt\") pod \"network-metrics-daemon-4xbqt\" (UID: \"8c1a0a20-5a72-4a67-817d-08658f7663ac\") " pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:11:56.055286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055240    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-log-socket\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.055286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-tmp\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.055752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-run-netns\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.055752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-multus-socket-dir-parent\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.055752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055353    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-run-netns\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.055752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055365    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-sys\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.055752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-kubelet-config\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:11:56.055752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs\") pod \"network-metrics-daemon-4xbqt\" (UID: \"8c1a0a20-5a72-4a67-817d-08658f7663ac\") " pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:11:56.055752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055442    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7573c74d-3687-455c-85c9-4bf2b6441696-hosts-file\") pod \"node-resolver-gv72m\" (UID: \"7573c74d-3687-455c-85c9-4bf2b6441696\") " pod="openshift-dns/node-resolver-gv72m"
Sep 10 17:11:56.055752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-kubernetes\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.055752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-kubelet\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.055752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055538    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-kubelet\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.055752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-run-openvswitch\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.055752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055577    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-run-openvswitch\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.055752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57af622a-b174-4bad-9a84-d2d75c2ef6a0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.056260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055948    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/41924057-6412-4ac4-8620-239853d4ff53-env-overrides\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.056260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.055990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7573c74d-3687-455c-85c9-4bf2b6441696-tmp-dir\") pod \"node-resolver-gv72m\" (UID: \"7573c74d-3687-455c-85c9-4bf2b6441696\") " pod="openshift-dns/node-resolver-gv72m"
Sep 10 17:11:56.056260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056011    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-sysctl-d\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.056260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-var-lib-kubelet\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.056260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-run-ovn\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.056260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-node-log\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.056260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056116    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-run-k8s-cni-cncf-io\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.056260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056151    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-run-ovn\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.056260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056153    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-node-log\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.056260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056169    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ckxn\" (UniqueName: \"kubernetes.io/projected/bafbd9c5-ad9e-446b-8a01-64cdd4895832-kube-api-access-8ckxn\") pod \"node-ca-ntdxg\" (UID: \"bafbd9c5-ad9e-446b-8a01-64cdd4895832\") " pod="openshift-image-registry/node-ca-ntdxg"
Sep 10 17:11:56.056260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056185    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-var-lib-kubelet\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.056260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-sys-fs\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.056644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-dbus\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:11:56.056644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056320    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-run-netns\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.056644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs4bn\" (UniqueName: \"kubernetes.io/projected/7573c74d-3687-455c-85c9-4bf2b6441696-kube-api-access-gs4bn\") pod \"node-resolver-gv72m\" (UID: \"7573c74d-3687-455c-85c9-4bf2b6441696\") " pod="openshift-dns/node-resolver-gv72m"
Sep 10 17:11:56.056644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-sysconfig\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.056644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056392    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-sysctl-conf\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.056644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.056644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdsj2\" (UniqueName: \"kubernetes.io/projected/41924057-6412-4ac4-8620-239853d4ff53-kube-api-access-pdsj2\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.056644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57af622a-b174-4bad-9a84-d2d75c2ef6a0-system-cni-dir\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.056644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056481    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.056644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57af622a-b174-4bad-9a84-d2d75c2ef6a0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.056644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056533    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-multus-cni-dir\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.056644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36-host-slash\") pod \"iptables-alerter-x4z47\" (UID: \"b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36\") " pod="openshift-network-operator/iptables-alerter-x4z47"
Sep 10 17:11:56.056644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056610    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-tuned\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.056644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36-iptables-alerter-script\") pod \"iptables-alerter-x4z47\" (UID: \"b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36\") " pod="openshift-network-operator/iptables-alerter-x4z47"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056650    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056674    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-slash\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-var-lib-openvswitch\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-host-slash\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056716    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57af622a-b174-4bad-9a84-d2d75c2ef6a0-cni-binary-copy\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056740    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-var-lib-openvswitch\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-run-multus-certs\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056766    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/975bc37f-b97b-4804-b501-b1c2d87e72a3-konnectivity-ca\") pod \"konnectivity-agent-lxx99\" (UID: \"975bc37f-b97b-4804-b501-b1c2d87e72a3\") " pod="kube-system/konnectivity-agent-lxx99"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-systemd-units\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-run-systemd\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/41924057-6412-4ac4-8620-239853d4ff53-ovnkube-config\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056877    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57af622a-b174-4bad-9a84-d2d75c2ef6a0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-systemd-units\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056904    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-run-systemd\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-var-lib-cni-multus\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.057184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.056957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-hostroot\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.057818 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.057000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/41924057-6412-4ac4-8620-239853d4ff53-ovn-node-metrics-cert\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.057818 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.057027    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/41924057-6412-4ac4-8620-239853d4ff53-ovnkube-script-lib\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.057818 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.057071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-multus-daemon-config\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.057818 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.057110    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-etc-kubernetes\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.057818 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.057172    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd6zb\" (UniqueName: \"kubernetes.io/projected/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-kube-api-access-fd6zb\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.057818 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.057196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-etc-openvswitch\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.057818 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.057222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfmp8\" (UniqueName: \"kubernetes.io/projected/57af622a-b174-4bad-9a84-d2d75c2ef6a0-kube-api-access-zfmp8\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.057818 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.057249    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpmth\" (UniqueName: \"kubernetes.io/projected/b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36-kube-api-access-rpmth\") pod \"iptables-alerter-x4z47\" (UID: \"b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36\") " pod="openshift-network-operator/iptables-alerter-x4z47"
Sep 10 17:11:56.057818 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.057290    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/41924057-6412-4ac4-8620-239853d4ff53-etc-openvswitch\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.057818 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.057291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-registration-dir\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.057818 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.057347    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/41924057-6412-4ac4-8620-239853d4ff53-ovnkube-config\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.058334 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.057871    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/41924057-6412-4ac4-8620-239853d4ff53-ovnkube-script-lib\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.059878 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.058501    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 17:11:56.062358 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.062339    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/41924057-6412-4ac4-8620-239853d4ff53-ovn-node-metrics-cert\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.067375 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.067359    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 17:11:56.067426 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.067381    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 17:11:56.067426 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.067391    2576 projected.go:196] Error preparing data for projected volume kube-api-access-g9ghw for pod openshift-network-diagnostics/network-check-target-9djxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:11:56.067502 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.067440    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw podName:649da03e-1ef2-473a-b16a-112caf256391 nodeName:}" failed. No retries permitted until 2026-09-10 17:11:56.567425836 +0000 UTC m=+1.983476776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g9ghw" (UniqueName: "kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw") pod "network-check-target-9djxw" (UID: "649da03e-1ef2-473a-b16a-112caf256391") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:11:56.070771 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.070753    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdsj2\" (UniqueName: \"kubernetes.io/projected/41924057-6412-4ac4-8620-239853d4ff53-kube-api-access-pdsj2\") pod \"ovnkube-node-5hkvd\" (UID: \"41924057-6412-4ac4-8620-239853d4ff53\") " pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.106826 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.106807    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 17:11:56.157962 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.157921    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57af622a-b174-4bad-9a84-d2d75c2ef6a0-cni-binary-copy\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.157962 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.157964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-run-multus-certs\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.158239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.157985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/975bc37f-b97b-4804-b501-b1c2d87e72a3-konnectivity-ca\") pod \"konnectivity-agent-lxx99\" (UID: \"975bc37f-b97b-4804-b501-b1c2d87e72a3\") " pod="kube-system/konnectivity-agent-lxx99"
Sep 10 17:11:56.158239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:11:56.158239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158030    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57af622a-b174-4bad-9a84-d2d75c2ef6a0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.158239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158074    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-run-multus-certs\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.158239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158116    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-var-lib-cni-multus\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.158239 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.158135    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 17:11:56.158239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158162    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-hostroot\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.158239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158189    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-var-lib-cni-multus\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.158239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-hostroot\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.158239 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.158227    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret podName:2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff nodeName:}" failed. No retries permitted until 2026-09-10 17:11:56.658203625 +0000 UTC m=+2.074254585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret") pod "global-pull-secret-syncer-55pvg" (UID: "2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff") : object "kube-system"/"original-pull-secret" not registered
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-multus-daemon-config\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-etc-kubernetes\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd6zb\" (UniqueName: \"kubernetes.io/projected/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-kube-api-access-fd6zb\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfmp8\" (UniqueName: \"kubernetes.io/projected/57af622a-b174-4bad-9a84-d2d75c2ef6a0-kube-api-access-zfmp8\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpmth\" (UniqueName: \"kubernetes.io/projected/b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36-kube-api-access-rpmth\") pod \"iptables-alerter-x4z47\" (UID: \"b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36\") " pod="openshift-network-operator/iptables-alerter-x4z47"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-registration-dir\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158442    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-cnibin\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-var-lib-cni-bin\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-multus-conf-dir\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-device-dir\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158523    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57af622a-b174-4bad-9a84-d2d75c2ef6a0-cni-binary-copy\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158541    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-run\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-lib-modules\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158586    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-registration-dir\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-host\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158612    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-multus-conf-dir\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.158729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-cni-binary-copy\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158640    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57af622a-b174-4bad-9a84-d2d75c2ef6a0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158657    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-device-dir\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158645    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh94j\" (UniqueName: \"kubernetes.io/projected/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-kube-api-access-vh94j\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158677    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-cnibin\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/975bc37f-b97b-4804-b501-b1c2d87e72a3-agent-certs\") pod \"konnectivity-agent-lxx99\" (UID: \"975bc37f-b97b-4804-b501-b1c2d87e72a3\") " pod="kube-system/konnectivity-agent-lxx99"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158721    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-var-lib-cni-bin\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-modprobe-d\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bafbd9c5-ad9e-446b-8a01-64cdd4895832-host\") pod \"node-ca-ntdxg\" (UID: \"bafbd9c5-ad9e-446b-8a01-64cdd4895832\") " pod="openshift-image-registry/node-ca-ntdxg"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158766    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-host\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-etc-kubernetes\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158779    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bafbd9c5-ad9e-446b-8a01-64cdd4895832-serviceca\") pod \"node-ca-ntdxg\" (UID: \"bafbd9c5-ad9e-446b-8a01-64cdd4895832\") " pod="openshift-image-registry/node-ca-ntdxg"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158812    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-system-cni-dir\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-etc-selinux\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158626    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/975bc37f-b97b-4804-b501-b1c2d87e72a3-konnectivity-ca\") pod \"konnectivity-agent-lxx99\" (UID: \"975bc37f-b97b-4804-b501-b1c2d87e72a3\") " pod="kube-system/konnectivity-agent-lxx99"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158862    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-lib-modules\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76wqt\" (UniqueName: \"kubernetes.io/projected/3c0a4299-3198-4575-bba2-b689fa53c385-kube-api-access-76wqt\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-run\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.159576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158907    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-multus-daemon-config\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-systemd\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-socket-dir\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158968    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bafbd9c5-ad9e-446b-8a01-64cdd4895832-host\") pod \"node-ca-ntdxg\" (UID: \"bafbd9c5-ad9e-446b-8a01-64cdd4895832\") " pod="openshift-image-registry/node-ca-ntdxg"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158971    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-system-cni-dir\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57af622a-b174-4bad-9a84-d2d75c2ef6a0-cnibin\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.158998    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-etc-selinux\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwlt\" (UniqueName: \"kubernetes.io/projected/8c1a0a20-5a72-4a67-817d-08658f7663ac-kube-api-access-wkwlt\") pod \"network-metrics-daemon-4xbqt\" (UID: \"8c1a0a20-5a72-4a67-817d-08658f7663ac\") " pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159042    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-tmp\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159065    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-systemd\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159075    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57af622a-b174-4bad-9a84-d2d75c2ef6a0-cnibin\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-multus-socket-dir-parent\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-sys\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-kubelet-config\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159138    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-multus-socket-dir-parent\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159128    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-socket-dir\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs\") pod \"network-metrics-daemon-4xbqt\" (UID: \"8c1a0a20-5a72-4a67-817d-08658f7663ac\") " pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7573c74d-3687-455c-85c9-4bf2b6441696-hosts-file\") pod \"node-resolver-gv72m\" (UID: \"7573c74d-3687-455c-85c9-4bf2b6441696\") " pod="openshift-dns/node-resolver-gv72m"
Sep 10 17:11:56.160461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159196    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-sys\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159201    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-kubelet-config\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-kubernetes\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159248    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57af622a-b174-4bad-9a84-d2d75c2ef6a0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.159257    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7573c74d-3687-455c-85c9-4bf2b6441696-tmp-dir\") pod \"node-resolver-gv72m\" (UID: \"7573c74d-3687-455c-85c9-4bf2b6441696\") " pod="openshift-dns/node-resolver-gv72m"
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-sysctl-d\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.159314    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs podName:8c1a0a20-5a72-4a67-817d-08658f7663ac nodeName:}" failed. No retries permitted until 2026-09-10 17:11:56.659297364 +0000 UTC m=+2.075348290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs") pod "network-metrics-daemon-4xbqt" (UID: "8c1a0a20-5a72-4a67-817d-08658f7663ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159257    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7573c74d-3687-455c-85c9-4bf2b6441696-hosts-file\") pod \"node-resolver-gv72m\" (UID: \"7573c74d-3687-455c-85c9-4bf2b6441696\") " pod="openshift-dns/node-resolver-gv72m"
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-var-lib-kubelet\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159180    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-cni-binary-copy\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-run-k8s-cni-cncf-io\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-sysctl-d\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159396    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ckxn\" (UniqueName: \"kubernetes.io/projected/bafbd9c5-ad9e-446b-8a01-64cdd4895832-kube-api-access-8ckxn\") pod \"node-ca-ntdxg\" (UID: \"bafbd9c5-ad9e-446b-8a01-64cdd4895832\") " pod="openshift-image-registry/node-ca-ntdxg"
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-var-lib-kubelet\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159436    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-var-lib-kubelet\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159454    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-sys-fs\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.161072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159477    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-run-k8s-cni-cncf-io\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159503    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-sys-fs\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159514    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-var-lib-kubelet\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159550    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7573c74d-3687-455c-85c9-4bf2b6441696-tmp-dir\") pod \"node-resolver-gv72m\" (UID: \"7573c74d-3687-455c-85c9-4bf2b6441696\") " pod="openshift-dns/node-resolver-gv72m"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159556    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-kubernetes\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-modprobe-d\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159588    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-dbus\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-run-netns\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159637    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs4bn\" (UniqueName: \"kubernetes.io/projected/7573c74d-3687-455c-85c9-4bf2b6441696-kube-api-access-gs4bn\") pod \"node-resolver-gv72m\" (UID: \"7573c74d-3687-455c-85c9-4bf2b6441696\") " pod="openshift-dns/node-resolver-gv72m"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-sysconfig\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159637    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-dbus\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159693    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-host-run-netns\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-sysconfig\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-sysctl-conf\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57af622a-b174-4bad-9a84-d2d75c2ef6a0-system-cni-dir\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57af622a-b174-4bad-9a84-d2d75c2ef6a0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-multus-cni-dir\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57af622a-b174-4bad-9a84-d2d75c2ef6a0-system-cni-dir\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.161689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36-host-slash\") pod \"iptables-alerter-x4z47\" (UID: \"b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36\") " pod="openshift-network-operator/iptables-alerter-x4z47"
Sep 10 17:11:56.162412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-tuned\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.162412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159919    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-sysctl-conf\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.162412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36-host-slash\") pod \"iptables-alerter-x4z47\" (UID: \"b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36\") " pod="openshift-network-operator/iptables-alerter-x4z47"
Sep 10 17:11:56.162412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36-iptables-alerter-script\") pod \"iptables-alerter-x4z47\" (UID: \"b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36\") " pod="openshift-network-operator/iptables-alerter-x4z47"
Sep 10 17:11:56.162412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.159998    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57af622a-b174-4bad-9a84-d2d75c2ef6a0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.162412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.160015    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.162412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.160109    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-multus-cni-dir\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.162412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.160118    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c0a4299-3198-4575-bba2-b689fa53c385-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.162412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.160148    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bafbd9c5-ad9e-446b-8a01-64cdd4895832-serviceca\") pod \"node-ca-ntdxg\" (UID: \"bafbd9c5-ad9e-446b-8a01-64cdd4895832\") " pod="openshift-image-registry/node-ca-ntdxg"
Sep 10 17:11:56.162412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.160151    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57af622a-b174-4bad-9a84-d2d75c2ef6a0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.162412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.160573    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36-iptables-alerter-script\") pod \"iptables-alerter-x4z47\" (UID: \"b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36\") " pod="openshift-network-operator/iptables-alerter-x4z47"
Sep 10 17:11:56.162412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.161623    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-tmp\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.162412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.161890    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-etc-tuned\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.162412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.162125    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/975bc37f-b97b-4804-b501-b1c2d87e72a3-agent-certs\") pod \"konnectivity-agent-lxx99\" (UID: \"975bc37f-b97b-4804-b501-b1c2d87e72a3\") " pod="kube-system/konnectivity-agent-lxx99"
Sep 10 17:11:56.168506 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.168482    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh94j\" (UniqueName: \"kubernetes.io/projected/e97e3a69-913c-46c8-b3e4-ab6e2aea19d4-kube-api-access-vh94j\") pod \"multus-hll7w\" (UID: \"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4\") " pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.175134 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.175104    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfmp8\" (UniqueName: \"kubernetes.io/projected/57af622a-b174-4bad-9a84-d2d75c2ef6a0-kube-api-access-zfmp8\") pod \"multus-additional-cni-plugins-nwn9h\" (UID: \"57af622a-b174-4bad-9a84-d2d75c2ef6a0\") " pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.175328 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.175304    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd6zb\" (UniqueName: \"kubernetes.io/projected/c2f5fe29-a25e-4118-ab1b-2ae36c1e4388-kube-api-access-fd6zb\") pod \"tuned-867z2\" (UID: \"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388\") " pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.175854 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.175824    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ckxn\" (UniqueName: \"kubernetes.io/projected/bafbd9c5-ad9e-446b-8a01-64cdd4895832-kube-api-access-8ckxn\") pod \"node-ca-ntdxg\" (UID: \"bafbd9c5-ad9e-446b-8a01-64cdd4895832\") " pod="openshift-image-registry/node-ca-ntdxg"
Sep 10 17:11:56.176005 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.175979    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs4bn\" (UniqueName: \"kubernetes.io/projected/7573c74d-3687-455c-85c9-4bf2b6441696-kube-api-access-gs4bn\") pod \"node-resolver-gv72m\" (UID: \"7573c74d-3687-455c-85c9-4bf2b6441696\") " pod="openshift-dns/node-resolver-gv72m"
Sep 10 17:11:56.176105 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.176075    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpmth\" (UniqueName: \"kubernetes.io/projected/b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36-kube-api-access-rpmth\") pod \"iptables-alerter-x4z47\" (UID: \"b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36\") " pod="openshift-network-operator/iptables-alerter-x4z47"
Sep 10 17:11:56.176274 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.176257    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76wqt\" (UniqueName: \"kubernetes.io/projected/3c0a4299-3198-4575-bba2-b689fa53c385-kube-api-access-76wqt\") pod \"aws-ebs-csi-driver-node-nfnfl\" (UID: \"3c0a4299-3198-4575-bba2-b689fa53c385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.176645 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.176630    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkwlt\" (UniqueName: \"kubernetes.io/projected/8c1a0a20-5a72-4a67-817d-08658f7663ac-kube-api-access-wkwlt\") pod \"network-metrics-daemon-4xbqt\" (UID: \"8c1a0a20-5a72-4a67-817d-08658f7663ac\") " pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:11:56.280146 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.280041    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:11:56.289831 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:56.289801    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41924057_6412_4ac4_8620_239853d4ff53.slice/crio-6b2864546b22a4167e3afe6795b9f082700ff7eb6ddc9ad1b6ca8c6efedca1e7 WatchSource:0}: Error finding container 6b2864546b22a4167e3afe6795b9f082700ff7eb6ddc9ad1b6ca8c6efedca1e7: Status 404 returned error can't find the container with id 6b2864546b22a4167e3afe6795b9f082700ff7eb6ddc9ad1b6ca8c6efedca1e7
Sep 10 17:11:56.296079 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.296045    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nwn9h"
Sep 10 17:11:56.304033 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:56.304007    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57af622a_b174_4bad_9a84_d2d75c2ef6a0.slice/crio-8047ca1e956de90306e1ba770d4de1b31329a2a407b2d3f56fab2466dfd1af9a WatchSource:0}: Error finding container 8047ca1e956de90306e1ba770d4de1b31329a2a407b2d3f56fab2466dfd1af9a: Status 404 returned error can't find the container with id 8047ca1e956de90306e1ba770d4de1b31329a2a407b2d3f56fab2466dfd1af9a
Sep 10 17:11:56.322099 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.322045    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hll7w"
Sep 10 17:11:56.330733 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:56.330707    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97e3a69_913c_46c8_b3e4_ab6e2aea19d4.slice/crio-6efa1227612708c0cdd6e23b03fc07f322aaa8f5200dc26301a7b34db0a59a37 WatchSource:0}: Error finding container 6efa1227612708c0cdd6e23b03fc07f322aaa8f5200dc26301a7b34db0a59a37: Status 404 returned error can't find the container with id 6efa1227612708c0cdd6e23b03fc07f322aaa8f5200dc26301a7b34db0a59a37
Sep 10 17:11:56.339285 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.339267    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x4z47"
Sep 10 17:11:56.347125 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:56.347100    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c5bc68_95cb_44d2_9cc9_2e5dd4fc5f36.slice/crio-214c11b8039b50503b8b931efe309644c10452683d3317426a6ef610b298145e WatchSource:0}: Error finding container 214c11b8039b50503b8b931efe309644c10452683d3317426a6ef610b298145e: Status 404 returned error can't find the container with id 214c11b8039b50503b8b931efe309644c10452683d3317426a6ef610b298145e
Sep 10 17:11:56.356729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.356708    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lxx99"
Sep 10 17:11:56.365022 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:56.365000    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod975bc37f_b97b_4804_b501_b1c2d87e72a3.slice/crio-04bd8a32c20733256074cc980d278f8eda99a0c2f7ab0f46f9ae6fc719cce50a WatchSource:0}: Error finding container 04bd8a32c20733256074cc980d278f8eda99a0c2f7ab0f46f9ae6fc719cce50a: Status 404 returned error can't find the container with id 04bd8a32c20733256074cc980d278f8eda99a0c2f7ab0f46f9ae6fc719cce50a
Sep 10 17:11:56.383206 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.383173    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl"
Sep 10 17:11:56.388117 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.388088    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gv72m"
Sep 10 17:11:56.393162 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:56.392982    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0a4299_3198_4575_bba2_b689fa53c385.slice/crio-3bcd9bf6ac401f558d1d9e4e4ac3701634c2e98ab169a8c83bf038b4746b40f8 WatchSource:0}: Error finding container 3bcd9bf6ac401f558d1d9e4e4ac3701634c2e98ab169a8c83bf038b4746b40f8: Status 404 returned error can't find the container with id 3bcd9bf6ac401f558d1d9e4e4ac3701634c2e98ab169a8c83bf038b4746b40f8
Sep 10 17:11:56.397880 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:56.397860    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7573c74d_3687_455c_85c9_4bf2b6441696.slice/crio-c5a615e6ba64840d270e5e313180e299833be3dcaff522d2f83c1752ced4443a WatchSource:0}: Error finding container c5a615e6ba64840d270e5e313180e299833be3dcaff522d2f83c1752ced4443a: Status 404 returned error can't find the container with id c5a615e6ba64840d270e5e313180e299833be3dcaff522d2f83c1752ced4443a
Sep 10 17:11:56.409312 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.409283    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-867z2"
Sep 10 17:11:56.415151 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.415133    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ntdxg"
Sep 10 17:11:56.418386 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:56.418363    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f5fe29_a25e_4118_ab1b_2ae36c1e4388.slice/crio-4528ebaa709644ffca8d9ebb12d28c33f6dedd66b5dc5f47f0c03963382afd79 WatchSource:0}: Error finding container 4528ebaa709644ffca8d9ebb12d28c33f6dedd66b5dc5f47f0c03963382afd79: Status 404 returned error can't find the container with id 4528ebaa709644ffca8d9ebb12d28c33f6dedd66b5dc5f47f0c03963382afd79
Sep 10 17:11:56.423762 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:11:56.423738    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbafbd9c5_ad9e_446b_8a01_64cdd4895832.slice/crio-6b3f49b9b0d97fa7c1d5db525b0037c704c40840a3992e954ec088df8f0f943b WatchSource:0}: Error finding container 6b3f49b9b0d97fa7c1d5db525b0037c704c40840a3992e954ec088df8f0f943b: Status 404 returned error can't find the container with id 6b3f49b9b0d97fa7c1d5db525b0037c704c40840a3992e954ec088df8f0f943b
Sep 10 17:11:56.664400 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.664314    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ghw\" (UniqueName: \"kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw\") pod \"network-check-target-9djxw\" (UID: \"649da03e-1ef2-473a-b16a-112caf256391\") " pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:11:56.664400 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.664378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs\") pod \"network-metrics-daemon-4xbqt\" (UID: \"8c1a0a20-5a72-4a67-817d-08658f7663ac\") " pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:11:56.664625 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:56.664431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:11:56.664625 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.664506    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 17:11:56.664625 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.664525    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 17:11:56.664625 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.664533    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 17:11:56.664625 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.664547    2576 projected.go:196] Error preparing data for projected volume kube-api-access-g9ghw for pod openshift-network-diagnostics/network-check-target-9djxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:11:56.664625 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.664573    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret podName:2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff nodeName:}" failed. No retries permitted until 2026-09-10 17:11:57.664561015 +0000 UTC m=+3.080611946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret") pod "global-pull-secret-syncer-55pvg" (UID: "2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff") : object "kube-system"/"original-pull-secret" not registered
Sep 10 17:11:56.664625 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.664603    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw podName:649da03e-1ef2-473a-b16a-112caf256391 nodeName:}" failed. No retries permitted until 2026-09-10 17:11:57.66458515 +0000 UTC m=+3.080636104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9ghw" (UniqueName: "kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw") pod "network-check-target-9djxw" (UID: "649da03e-1ef2-473a-b16a-112caf256391") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:11:56.664970 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.664670    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:11:56.664970 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:56.664707    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs podName:8c1a0a20-5a72-4a67-817d-08658f7663ac nodeName:}" failed. No retries permitted until 2026-09-10 17:11:57.664694728 +0000 UTC m=+3.080745672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs") pod "network-metrics-daemon-4xbqt" (UID: "8c1a0a20-5a72-4a67-817d-08658f7663ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:11:57.011423 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.011287    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 17:06:56 +0000 UTC" deadline="2028-03-05 00:34:14.134077445 +0000 UTC"
Sep 10 17:11:57.011423 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.011370    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12991h22m17.122712004s"
Sep 10 17:11:57.081637 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.081016    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:11:57.081637 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:57.081176    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:11:57.111775 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.111602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lxx99" event={"ID":"975bc37f-b97b-4804-b501-b1c2d87e72a3","Type":"ContainerStarted","Data":"04bd8a32c20733256074cc980d278f8eda99a0c2f7ab0f46f9ae6fc719cce50a"}
Sep 10 17:11:57.135522 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.135433    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwn9h" event={"ID":"57af622a-b174-4bad-9a84-d2d75c2ef6a0","Type":"ContainerStarted","Data":"8047ca1e956de90306e1ba770d4de1b31329a2a407b2d3f56fab2466dfd1af9a"}
Sep 10 17:11:57.150656 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.150516    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd" event={"ID":"41924057-6412-4ac4-8620-239853d4ff53","Type":"ContainerStarted","Data":"6b2864546b22a4167e3afe6795b9f082700ff7eb6ddc9ad1b6ca8c6efedca1e7"}
Sep 10 17:11:57.170909 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.170868    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal" event={"ID":"a1aaa28eced54772227b642c1dccb5e2","Type":"ContainerStarted","Data":"58238d043a02a963f65c4d599c8750014cfae9a0fccc54a853d13660b4395ccf"}
Sep 10 17:11:57.190820 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.190776    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-867z2" event={"ID":"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388","Type":"ContainerStarted","Data":"4528ebaa709644ffca8d9ebb12d28c33f6dedd66b5dc5f47f0c03963382afd79"}
Sep 10 17:11:57.222868 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.222821    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl" event={"ID":"3c0a4299-3198-4575-bba2-b689fa53c385","Type":"ContainerStarted","Data":"3bcd9bf6ac401f558d1d9e4e4ac3701634c2e98ab169a8c83bf038b4746b40f8"}
Sep 10 17:11:57.226444 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.226226    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 17:11:57.245964 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.245542    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x4z47" event={"ID":"b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36","Type":"ContainerStarted","Data":"214c11b8039b50503b8b931efe309644c10452683d3317426a6ef610b298145e"}
Sep 10 17:11:57.263789 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.263697    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hll7w" event={"ID":"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4","Type":"ContainerStarted","Data":"6efa1227612708c0cdd6e23b03fc07f322aaa8f5200dc26301a7b34db0a59a37"}
Sep 10 17:11:57.300794 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.300253    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal" event={"ID":"837b4f66dafcb9583a80e7a722354bf8","Type":"ContainerStarted","Data":"f13fec93e39292f12abb1bb8cccb2945a986adbd0a4ed81d6f033d69d6aa6b5b"}
Sep 10 17:11:57.323503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.323311    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ntdxg" event={"ID":"bafbd9c5-ad9e-446b-8a01-64cdd4895832","Type":"ContainerStarted","Data":"6b3f49b9b0d97fa7c1d5db525b0037c704c40840a3992e954ec088df8f0f943b"}
Sep 10 17:11:57.333363 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.333316    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gv72m" event={"ID":"7573c74d-3687-455c-85c9-4bf2b6441696","Type":"ContainerStarted","Data":"c5a615e6ba64840d270e5e313180e299833be3dcaff522d2f83c1752ced4443a"}
Sep 10 17:11:57.674633 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.674541    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:11:57.674633 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.674618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ghw\" (UniqueName: \"kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw\") pod \"network-check-target-9djxw\" (UID: \"649da03e-1ef2-473a-b16a-112caf256391\") " pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:11:57.674889 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.674659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs\") pod \"network-metrics-daemon-4xbqt\" (UID: \"8c1a0a20-5a72-4a67-817d-08658f7663ac\") " pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:11:57.674889 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:57.674792    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:11:57.674889 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:57.674865    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs podName:8c1a0a20-5a72-4a67-817d-08658f7663ac nodeName:}" failed. No retries permitted until 2026-09-10 17:11:59.674840673 +0000 UTC m=+5.090891621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs") pod "network-metrics-daemon-4xbqt" (UID: "8c1a0a20-5a72-4a67-817d-08658f7663ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:11:57.676863 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:57.675310    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 17:11:57.676863 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:57.675370    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret podName:2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff nodeName:}" failed. No retries permitted until 2026-09-10 17:11:59.675353461 +0000 UTC m=+5.091404405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret") pod "global-pull-secret-syncer-55pvg" (UID: "2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff") : object "kube-system"/"original-pull-secret" not registered
Sep 10 17:11:57.676863 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:57.675452    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 17:11:57.676863 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:57.675472    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 17:11:57.676863 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:57.675485    2576 projected.go:196] Error preparing data for projected volume kube-api-access-g9ghw for pod openshift-network-diagnostics/network-check-target-9djxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:11:57.676863 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:57.675523    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw podName:649da03e-1ef2-473a-b16a-112caf256391 nodeName:}" failed. No retries permitted until 2026-09-10 17:11:59.675511393 +0000 UTC m=+5.091562338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9ghw" (UniqueName: "kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw") pod "network-check-target-9djxw" (UID: "649da03e-1ef2-473a-b16a-112caf256391") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:11:57.938534 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:57.938412    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 17:11:58.012051 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:58.011972    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 17:06:56 +0000 UTC" deadline="2028-03-20 15:29:41.750168735 +0000 UTC"
Sep 10 17:11:58.012051 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:58.012013    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13366h17m43.738160546s"
Sep 10 17:11:58.080142 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:58.078979    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:11:58.080142 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:58.079142    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:11:58.080142 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:58.079566    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:11:58.080142 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:58.079669    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:11:58.483972 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:58.483942    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 17:11:59.081042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:59.080280    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:11:59.081042 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:59.080440    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:11:59.696953 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:59.696911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:11:59.697156 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:59.696980    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ghw\" (UniqueName: \"kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw\") pod \"network-check-target-9djxw\" (UID: \"649da03e-1ef2-473a-b16a-112caf256391\") " pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:11:59.697156 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:11:59.697051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs\") pod \"network-metrics-daemon-4xbqt\" (UID: \"8c1a0a20-5a72-4a67-817d-08658f7663ac\") " pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:11:59.697299 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:59.697198    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:11:59.697299 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:59.697270    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs podName:8c1a0a20-5a72-4a67-817d-08658f7663ac nodeName:}" failed. No retries permitted until 2026-09-10 17:12:03.697249211 +0000 UTC m=+9.113300143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs") pod "network-metrics-daemon-4xbqt" (UID: "8c1a0a20-5a72-4a67-817d-08658f7663ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:11:59.697430 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:59.697343    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 17:11:59.697430 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:59.697377    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret podName:2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff nodeName:}" failed. No retries permitted until 2026-09-10 17:12:03.697365825 +0000 UTC m=+9.113416758 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret") pod "global-pull-secret-syncer-55pvg" (UID: "2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff") : object "kube-system"/"original-pull-secret" not registered
Sep 10 17:11:59.697541 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:59.697458    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 17:11:59.697541 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:59.697477    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 17:11:59.697541 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:59.697489    2576 projected.go:196] Error preparing data for projected volume kube-api-access-g9ghw for pod openshift-network-diagnostics/network-check-target-9djxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:11:59.697541 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:11:59.697526    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw podName:649da03e-1ef2-473a-b16a-112caf256391 nodeName:}" failed. No retries permitted until 2026-09-10 17:12:03.697515103 +0000 UTC m=+9.113566031 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9ghw" (UniqueName: "kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw") pod "network-check-target-9djxw" (UID: "649da03e-1ef2-473a-b16a-112caf256391") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:12:00.078265 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:00.078149    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:00.083144 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:00.082426    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:00.083144 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:00.082938    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:00.083144 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:00.083072    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:01.079075 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:01.079033    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:01.079264 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:01.079219    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:12:02.079073 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:02.078994    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:02.079073 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:02.078994    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:02.079684 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:02.079164    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:02.079684 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:02.079283    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:03.078658 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:03.078614    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:03.078866 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:03.078772    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:12:03.733171 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:03.733125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:03.733740 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:03.733208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ghw\" (UniqueName: \"kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw\") pod \"network-check-target-9djxw\" (UID: \"649da03e-1ef2-473a-b16a-112caf256391\") " pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:03.733740 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:03.733271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs\") pod \"network-metrics-daemon-4xbqt\" (UID: \"8c1a0a20-5a72-4a67-817d-08658f7663ac\") " pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:03.733740 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:03.733409    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:12:03.733740 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:03.733477    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs podName:8c1a0a20-5a72-4a67-817d-08658f7663ac nodeName:}" failed. No retries permitted until 2026-09-10 17:12:11.733456447 +0000 UTC m=+17.149507391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs") pod "network-metrics-daemon-4xbqt" (UID: "8c1a0a20-5a72-4a67-817d-08658f7663ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:12:03.733740 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:03.733651    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 17:12:03.733740 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:03.733691    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret podName:2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff nodeName:}" failed. No retries permitted until 2026-09-10 17:12:11.733677558 +0000 UTC m=+17.149728504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret") pod "global-pull-secret-syncer-55pvg" (UID: "2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff") : object "kube-system"/"original-pull-secret" not registered
Sep 10 17:12:03.734098 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:03.733766    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 17:12:03.734098 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:03.733782    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 17:12:03.734098 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:03.733794    2576 projected.go:196] Error preparing data for projected volume kube-api-access-g9ghw for pod openshift-network-diagnostics/network-check-target-9djxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:12:03.734098 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:03.733827    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw podName:649da03e-1ef2-473a-b16a-112caf256391 nodeName:}" failed. No retries permitted until 2026-09-10 17:12:11.733816405 +0000 UTC m=+17.149867349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9ghw" (UniqueName: "kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw") pod "network-check-target-9djxw" (UID: "649da03e-1ef2-473a-b16a-112caf256391") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:12:04.078250 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:04.078121    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:04.078250 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:04.078155    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:04.078487 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:04.078267    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:04.078487 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:04.078406    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:05.082451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:05.080467    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:05.082451 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:05.080635    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:12:06.078734 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:06.078694    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:06.078919 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:06.078694    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:06.078919 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:06.078840    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:06.079065 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:06.078960    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:07.079043 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:07.079010    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:07.079473 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:07.079162    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:12:08.079042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:08.078974    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:08.079213 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:08.079086    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:08.079213 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:08.079135    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:08.079581 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:08.079228    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:09.078352 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:09.078320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:09.078507 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:09.078462    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:12:10.078941 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:10.078901    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:10.079373 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:10.078907    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:10.079373 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:10.079039    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:10.079373 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:10.079127    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:11.079147 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:11.079111    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:11.079740 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:11.079280    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:12:11.794142 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:11.794096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ghw\" (UniqueName: \"kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw\") pod \"network-check-target-9djxw\" (UID: \"649da03e-1ef2-473a-b16a-112caf256391\") " pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:11.794142 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:11.794143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs\") pod \"network-metrics-daemon-4xbqt\" (UID: \"8c1a0a20-5a72-4a67-817d-08658f7663ac\") " pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:11.794450 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:11.794189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:11.794450 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:11.794298    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 17:12:11.794450 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:11.794304    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 17:12:11.794450 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:11.794332    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 17:12:11.794450 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:11.794347    2576 projected.go:196] Error preparing data for projected volume kube-api-access-g9ghw for pod openshift-network-diagnostics/network-check-target-9djxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:12:11.794450 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:11.794363    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret podName:2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff nodeName:}" failed. No retries permitted until 2026-09-10 17:12:27.794348428 +0000 UTC m=+33.210399368 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret") pod "global-pull-secret-syncer-55pvg" (UID: "2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff") : object "kube-system"/"original-pull-secret" not registered
Sep 10 17:12:11.794450 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:11.794299    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:12:11.794450 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:11.794401    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw podName:649da03e-1ef2-473a-b16a-112caf256391 nodeName:}" failed. No retries permitted until 2026-09-10 17:12:27.794384602 +0000 UTC m=+33.210435533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9ghw" (UniqueName: "kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw") pod "network-check-target-9djxw" (UID: "649da03e-1ef2-473a-b16a-112caf256391") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:12:11.794450 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:11.794451    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs podName:8c1a0a20-5a72-4a67-817d-08658f7663ac nodeName:}" failed. No retries permitted until 2026-09-10 17:12:27.794431193 +0000 UTC m=+33.210482134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs") pod "network-metrics-daemon-4xbqt" (UID: "8c1a0a20-5a72-4a67-817d-08658f7663ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:12:12.078042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:12.077961    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:12.078042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:12.077971    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:12.078281 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:12.078113    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:12.078281 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:12.078136    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:13.078606 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:13.078573    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:13.079083 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:13.078719    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:12:14.078175 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:14.078135    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:14.078175 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:14.078159    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:14.078388 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:14.078266    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:14.078388 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:14.078359    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:15.078915 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:15.078882    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:15.079386 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:15.079005    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:12:16.078633 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:16.078468    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:16.078718 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:16.078526    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:16.078718 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:16.078703    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:16.078808 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:16.078771    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:16.399260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:16.399220    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd" event={"ID":"41924057-6412-4ac4-8620-239853d4ff53","Type":"ContainerStarted","Data":"7ebe230968dd97fa3451ab01c6fa3e1669fb7c5b487675ea375717a760835bc2"}
Sep 10 17:12:16.399866 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:16.399375    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd" event={"ID":"41924057-6412-4ac4-8620-239853d4ff53","Type":"ContainerStarted","Data":"e764468f5116a28b5070afd25b607f654de55ab6c3834df3cee753ba9d2a8ce2"}
Sep 10 17:12:16.401015 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:16.400909    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-867z2" event={"ID":"c2f5fe29-a25e-4118-ab1b-2ae36c1e4388","Type":"ContainerStarted","Data":"995b74b9669844e8467ee187ae65291a45dbecafde64f5d8ce7a8dc40c684a52"}
Sep 10 17:12:16.402733 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:16.402705    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hll7w" event={"ID":"e97e3a69-913c-46c8-b3e4-ab6e2aea19d4","Type":"ContainerStarted","Data":"ef8c2e33ee87b22ff9aef937516b889585d84f78903a0c60d859ee4fd30232d6"}
Sep 10 17:12:16.404356 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:16.404331    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal" event={"ID":"837b4f66dafcb9583a80e7a722354bf8","Type":"ContainerStarted","Data":"ea24043f9474d38994f1426a34c24b28c4694cb095c1fc00d79e25b59499f71e"}
Sep 10 17:12:16.417715 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:16.417660    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-867z2" podStartSLOduration=2.006850824 podStartE2EDuration="21.417640381s" totalImagesPullingTime="19.410789557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:12:16.416856228 +0000 UTC m=+21.832907178" watchObservedRunningTime="2026-09-10 17:12:16.417640381 +0000 UTC m=+21.833691330"
Sep 10 17:12:16.448810 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:16.448735    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal" podStartSLOduration=20.4487155 podStartE2EDuration="20.4487155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:11:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:12:16.433104732 +0000 UTC m=+21.849155682" watchObservedRunningTime="2026-09-10 17:12:16.4487155 +0000 UTC m=+21.864766450"
Sep 10 17:12:16.449381 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:16.449347    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hll7w" podStartSLOduration=1.931653733 podStartE2EDuration="21.449335423s" totalImagesPullingTime="19.51768169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:12:16.449134994 +0000 UTC m=+21.865185945" watchObservedRunningTime="2026-09-10 17:12:16.449335423 +0000 UTC m=+21.865386373"
Sep 10 17:12:17.081313 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.080964    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:17.081468 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:17.081443    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:12:17.408641 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.408604    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ntdxg" event={"ID":"bafbd9c5-ad9e-446b-8a01-64cdd4895832","Type":"ContainerStarted","Data":"f8a84ea923691eb55e5a32e9c398114251ee4c768a86af522b627f18436b2c55"}
Sep 10 17:12:17.410472 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.410422    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gv72m" event={"ID":"7573c74d-3687-455c-85c9-4bf2b6441696","Type":"ContainerStarted","Data":"a8efd94416dc4f088dc431af8d0dc7db1bdc88197ba03c8a805015decb8aadc4"}
Sep 10 17:12:17.412328 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.412207    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lxx99" event={"ID":"975bc37f-b97b-4804-b501-b1c2d87e72a3","Type":"ContainerStarted","Data":"3a8a6744412dbddd827fffc9f2dca30ab8ca540cb1ef61fd77619b2d6ede1d4c"}
Sep 10 17:12:17.413972 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.413945    2576 generic.go:356] "Generic (PLEG): container finished" podID="57af622a-b174-4bad-9a84-d2d75c2ef6a0" containerID="51343a858a50a8aecce211da32f57f22b61780277bdc09b0e2413a203df2d1af" exitCode=0
Sep 10 17:12:17.414097 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.414016    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwn9h" event={"ID":"57af622a-b174-4bad-9a84-d2d75c2ef6a0","Type":"ContainerDied","Data":"51343a858a50a8aecce211da32f57f22b61780277bdc09b0e2413a203df2d1af"}
Sep 10 17:12:17.417726 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.417698    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd" event={"ID":"41924057-6412-4ac4-8620-239853d4ff53","Type":"ContainerStarted","Data":"2396df5f7598fb88bbd9d970a5050779b490a2811e3d3aedca6dc49c8bcc4a44"}
Sep 10 17:12:17.417824 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.417782    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd" event={"ID":"41924057-6412-4ac4-8620-239853d4ff53","Type":"ContainerStarted","Data":"5caa71b973d4cac1f1d29f859e906794011e5cafb3b392c1c6e33307bee104a7"}
Sep 10 17:12:17.417895 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.417831    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd" event={"ID":"41924057-6412-4ac4-8620-239853d4ff53","Type":"ContainerStarted","Data":"396e2ff1993aee32f0221724b4f27b06e0852aa679b20dd06f46612bb223eb85"}
Sep 10 17:12:17.417895 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.417880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd" event={"ID":"41924057-6412-4ac4-8620-239853d4ff53","Type":"ContainerStarted","Data":"b320b0722af84e7eec440a5009ab8b6ded7884935c286802e550ec4c62ebd35a"}
Sep 10 17:12:17.419338 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.419318    2576 generic.go:356] "Generic (PLEG): container finished" podID="a1aaa28eced54772227b642c1dccb5e2" containerID="5b972243b5384e65025854821c30ec3a3ded9823cb2d389b8b9f48d06cbe1060" exitCode=0
Sep 10 17:12:17.419434 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.419404    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal" event={"ID":"a1aaa28eced54772227b642c1dccb5e2","Type":"ContainerDied","Data":"5b972243b5384e65025854821c30ec3a3ded9823cb2d389b8b9f48d06cbe1060"}
Sep 10 17:12:17.421284 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.421261    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl" event={"ID":"3c0a4299-3198-4575-bba2-b689fa53c385","Type":"ContainerStarted","Data":"7df5f37994ef75daca85b42b3635f821d11814d3d31deb2b99af1b2e157fcfb1"}
Sep 10 17:12:17.423905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.423881    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x4z47" event={"ID":"b3c5bc68-95cb-44d2-9cc9-2e5dd4fc5f36","Type":"ContainerStarted","Data":"6ad407045c02cbf7076163c4d816df1d232ad821185e129200c9b2726dd358ea"}
Sep 10 17:12:17.425212 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.425175    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ntdxg" podStartSLOduration=3.085075539 podStartE2EDuration="22.425162343s" totalImagesPullingTime="19.340086804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:12:17.424295156 +0000 UTC m=+22.840346106" watchObservedRunningTime="2026-09-10 17:12:17.425162343 +0000 UTC m=+22.841213292"
Sep 10 17:12:17.470210 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.470147    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lxx99" podStartSLOduration=10.515052089 podStartE2EDuration="22.470124824s" totalImagesPullingTime="11.955072735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:12:17.45132925 +0000 UTC m=+22.867380199" watchObservedRunningTime="2026-09-10 17:12:17.470124824 +0000 UTC m=+22.886175774"
Sep 10 17:12:17.470380 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.470347    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gv72m" podStartSLOduration=3.055067437 podStartE2EDuration="22.470339859s" totalImagesPullingTime="19.415272422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:12:17.469861517 +0000 UTC m=+22.885912471" watchObservedRunningTime="2026-09-10 17:12:17.470339859 +0000 UTC m=+22.886390810"
Sep 10 17:12:17.504816 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:17.504758    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x4z47" podStartSLOduration=3.087883031 podStartE2EDuration="22.50473837s" totalImagesPullingTime="19.416855339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:12:17.504464205 +0000 UTC m=+22.920515155" watchObservedRunningTime="2026-09-10 17:12:17.50473837 +0000 UTC m=+22.920789319"
Sep 10 17:12:18.016446 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:18.016421    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 17:12:18.033142 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:18.033045    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T17:12:18.016446453Z","UUID":"25e39716-ecf5-45bc-9826-06878d85d155","Handler":null,"Name":"","Endpoint":""}
Sep 10 17:12:18.034359 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:18.034343    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 17:12:18.034448 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:18.034369    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 17:12:18.078671 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:18.078636    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:18.078994 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:18.078773    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:18.078994 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:18.078798    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:18.078994 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:18.078924    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:18.428814 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:18.428774    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal" event={"ID":"a1aaa28eced54772227b642c1dccb5e2","Type":"ContainerStarted","Data":"aa14b816fba07590650c0c5c3b305de4bc221386434720f7eab2bfadd2b669b9"}
Sep 10 17:12:18.430925 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:18.430890    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl" event={"ID":"3c0a4299-3198-4575-bba2-b689fa53c385","Type":"ContainerStarted","Data":"49767586d851568c81f857a4c075bbcf746e4c517b83698287cd70d88c43f3c8"}
Sep 10 17:12:19.078122 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:19.078026    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:19.078245 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:19.078151    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:12:19.438196 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:19.437938    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd" event={"ID":"41924057-6412-4ac4-8620-239853d4ff53","Type":"ContainerStarted","Data":"cadaeb640ceefb2ac6e9f015ea852948d283d0f84484f4515f125a0eb300a0b4"}
Sep 10 17:12:19.440463 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:19.440434    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl" event={"ID":"3c0a4299-3198-4575-bba2-b689fa53c385","Type":"ContainerStarted","Data":"ea5e5a942f2ffdea1351bc6ec40174ee1f0035ddc1fd6ddf25e74456344b7201"}
Sep 10 17:12:19.457591 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:19.457539    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal" podStartSLOduration=23.457521409 podStartE2EDuration="23.457521409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:11:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:12:18.445115814 +0000 UTC m=+23.861166762" watchObservedRunningTime="2026-09-10 17:12:19.457521409 +0000 UTC m=+24.873572358"
Sep 10 17:12:19.457748 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:19.457687    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nfnfl" podStartSLOduration=2.546645807 podStartE2EDuration="24.457677831s" totalImagesPullingTime="21.911032024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:11:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:12:19.456442289 +0000 UTC m=+24.872493252" watchObservedRunningTime="2026-09-10 17:12:19.457677831 +0000 UTC m=+24.873728779"
Sep 10 17:12:20.078425 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:20.078391    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:20.078633 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:20.078392    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:20.078633 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:20.078498    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:20.078633 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:20.078586    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:21.078169 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:21.078135    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:21.078587 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:21.078292    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:12:22.078689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:22.078651    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:22.079148 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:22.078651    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:22.079148 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:22.078787    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:22.079148 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:22.078863    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:22.216068 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:22.216012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lxx99"
Sep 10 17:12:22.216667 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:22.216647    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lxx99"
Sep 10 17:12:22.447749 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:22.447713    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lxx99"
Sep 10 17:12:22.448293 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:22.448274    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lxx99"
Sep 10 17:12:23.082550 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:23.082528    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:23.082882 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:23.082652    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:12:23.451864 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:23.451608    2576 generic.go:356] "Generic (PLEG): container finished" podID="57af622a-b174-4bad-9a84-d2d75c2ef6a0" containerID="0ff9c4b9551cd9cd42d1a51b7536aa212eb5a3e1e6da8317918fc5a29c811e1e" exitCode=0
Sep 10 17:12:23.452047 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:23.451682    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwn9h" event={"ID":"57af622a-b174-4bad-9a84-d2d75c2ef6a0","Type":"ContainerDied","Data":"0ff9c4b9551cd9cd42d1a51b7536aa212eb5a3e1e6da8317918fc5a29c811e1e"}
Sep 10 17:12:23.455936 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:23.455907    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd" event={"ID":"41924057-6412-4ac4-8620-239853d4ff53","Type":"ContainerStarted","Data":"ec89850688ef8ea6d7571c5af34028d8b8dadbc960d934d7ae19a07522b55fca"}
Sep 10 17:12:23.495503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:23.495455    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd" podStartSLOduration=8.596604055 podStartE2EDuration="28.495441122s" totalImagesPullingTime="19.898837067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:12:23.495431743 +0000 UTC m=+28.911482689" watchObservedRunningTime="2026-09-10 17:12:23.495441122 +0000 UTC m=+28.911492071"
Sep 10 17:12:24.079093 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:24.079033    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:24.079263 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:24.079047    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:24.079263 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:24.079175    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:24.079263 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:24.079229    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:24.458426 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:24.458389    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:12:24.458902 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:24.458462    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:12:24.458902 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:24.458496    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:12:24.473324 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:24.473299    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:12:24.473449 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:24.473410    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:12:24.786999 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:24.786915    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-55pvg"]
Sep 10 17:12:24.787174 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:24.787035    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:24.787262 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:24.787183    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:24.787505 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:24.787472    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9djxw"]
Sep 10 17:12:24.787592 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:24.787549    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:24.787650 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:24.787617    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:24.788348 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:24.788326    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4xbqt"]
Sep 10 17:12:24.788453 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:24.788428    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:24.788551 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:24.788531    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:12:25.461309 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:25.461270    2576 generic.go:356] "Generic (PLEG): container finished" podID="57af622a-b174-4bad-9a84-d2d75c2ef6a0" containerID="181ef3021ab677853b7bc1f94a21f82bf806d6f54972f4704f944be27c4b341d" exitCode=0
Sep 10 17:12:25.462145 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:25.461355    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwn9h" event={"ID":"57af622a-b174-4bad-9a84-d2d75c2ef6a0","Type":"ContainerDied","Data":"181ef3021ab677853b7bc1f94a21f82bf806d6f54972f4704f944be27c4b341d"}
Sep 10 17:12:26.078741 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:26.078520    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:26.078921 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:26.078579    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:26.079429 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:26.078982    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:12:26.079429 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:26.079006    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:27.078457 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:27.078421    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:27.078819 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:27.078543    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:27.468150 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:27.468089    2576 generic.go:356] "Generic (PLEG): container finished" podID="57af622a-b174-4bad-9a84-d2d75c2ef6a0" containerID="3a36d4f61a702ef7d22b42e2cad67c27e97b590c2862aaec82082b84f26593cc" exitCode=0
Sep 10 17:12:27.468290 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:27.468176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwn9h" event={"ID":"57af622a-b174-4bad-9a84-d2d75c2ef6a0","Type":"ContainerDied","Data":"3a36d4f61a702ef7d22b42e2cad67c27e97b590c2862aaec82082b84f26593cc"}
Sep 10 17:12:27.816692 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:27.816595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs\") pod \"network-metrics-daemon-4xbqt\" (UID: \"8c1a0a20-5a72-4a67-817d-08658f7663ac\") " pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:27.816692 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:27.816653    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:27.816898 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:27.816694    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ghw\" (UniqueName: \"kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw\") pod \"network-check-target-9djxw\" (UID: \"649da03e-1ef2-473a-b16a-112caf256391\") " pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:27.816898 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:27.816738    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:12:27.816898 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:27.816802    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 17:12:27.816898 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:27.816808    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 17:12:27.816898 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:27.816819    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 17:12:27.816898 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:27.816832    2576 projected.go:196] Error preparing data for projected volume kube-api-access-g9ghw for pod openshift-network-diagnostics/network-check-target-9djxw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:12:27.816898 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:27.816806    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs podName:8c1a0a20-5a72-4a67-817d-08658f7663ac nodeName:}" failed. No retries permitted until 2026-09-10 17:12:59.816790526 +0000 UTC m=+65.232841468 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs") pod "network-metrics-daemon-4xbqt" (UID: "8c1a0a20-5a72-4a67-817d-08658f7663ac") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 17:12:27.816898 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:27.816887    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret podName:2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff nodeName:}" failed. No retries permitted until 2026-09-10 17:12:59.816871033 +0000 UTC m=+65.232921977 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret") pod "global-pull-secret-syncer-55pvg" (UID: "2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff") : object "kube-system"/"original-pull-secret" not registered
Sep 10 17:12:27.817216 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:27.816903    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw podName:649da03e-1ef2-473a-b16a-112caf256391 nodeName:}" failed. No retries permitted until 2026-09-10 17:12:59.816893937 +0000 UTC m=+65.232944865 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9ghw" (UniqueName: "kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw") pod "network-check-target-9djxw" (UID: "649da03e-1ef2-473a-b16a-112caf256391") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 17:12:28.078752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:28.078668    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:28.079175 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:28.078677    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:28.079175 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:28.078829    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xbqt" podUID="8c1a0a20-5a72-4a67-817d-08658f7663ac"
Sep 10 17:12:28.079175 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:28.078882    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9djxw" podUID="649da03e-1ef2-473a-b16a-112caf256391"
Sep 10 17:12:29.082526 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.082498    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:29.082997 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:29.082598    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-55pvg" podUID="2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff"
Sep 10 17:12:29.829314 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.829285    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeReady"
Sep 10 17:12:29.829507 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.829404    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 17:12:29.862034 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.861993    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-845c4cb945-bx2sw"]
Sep 10 17:12:29.881528 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.881490    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ftqvt"]
Sep 10 17:12:29.881827 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.881785    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:29.884152 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.884126    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 17:12:29.884289 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.884178    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 17:12:29.884289 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.884121    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 17:12:29.884289 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.884136    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ppxr2\""
Sep 10 17:12:29.889413 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.889387    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 17:12:29.893568 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.893547    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v4gw2"]
Sep 10 17:12:29.893693 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.893660    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:29.896874 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.896852    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 17:12:29.896983 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.896920    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-52r9p\""
Sep 10 17:12:29.896983 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.896918    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 17:12:29.909584 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.909557    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-845c4cb945-bx2sw"]
Sep 10 17:12:29.909700 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.909598    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ftqvt"]
Sep 10 17:12:29.909700 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.909620    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v4gw2"]
Sep 10 17:12:29.909700 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.909650    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v4gw2"
Sep 10 17:12:29.911822 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.911771    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 17:12:29.911822 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.911787    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 17:12:29.911993 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.911771    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 17:12:29.911993 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:29.911833    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gj68b\""
Sep 10 17:12:30.034152 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.034080    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rwlf\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-kube-api-access-9rwlf\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.034152 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.034115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4hqk\" (UniqueName: \"kubernetes.io/projected/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-kube-api-access-j4hqk\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:30.034152 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.034151    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2fbf4846-9ece-410e-a123-862937184628-image-registry-private-configuration\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.034434 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.034178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2fbf4846-9ece-410e-a123-862937184628-trusted-ca\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.034434 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.034237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.034434 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.034271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-config-volume\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:30.034434 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.034293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f81944b4-eafc-4f91-b8f4-0d2b22f34d96-cert\") pod \"ingress-canary-v4gw2\" (UID: \"f81944b4-eafc-4f91-b8f4-0d2b22f34d96\") " pod="openshift-ingress-canary/ingress-canary-v4gw2"
Sep 10 17:12:30.034434 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.034334    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:30.034434 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.034405    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-tmp-dir\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:30.034676 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.034439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-bound-sa-token\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.034676 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.034470    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2fbf4846-9ece-410e-a123-862937184628-registry-certificates\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.034676 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.034492    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2fbf4846-9ece-410e-a123-862937184628-installation-pull-secrets\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.034676 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.034516    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqhtk\" (UniqueName: \"kubernetes.io/projected/f81944b4-eafc-4f91-b8f4-0d2b22f34d96-kube-api-access-vqhtk\") pod \"ingress-canary-v4gw2\" (UID: \"f81944b4-eafc-4f91-b8f4-0d2b22f34d96\") " pod="openshift-ingress-canary/ingress-canary-v4gw2"
Sep 10 17:12:30.034676 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.034535    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2fbf4846-9ece-410e-a123-862937184628-ca-trust-extracted\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.078498 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.078462    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:30.078659 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.078472    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:30.082817 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.082398    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 17:12:30.082817 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.082450    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 17:12:30.082817 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.082398    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f2g8g\""
Sep 10 17:12:30.082817 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.082572    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8vgb7\""
Sep 10 17:12:30.082817 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.082745    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 17:12:30.135656 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.135617    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:30.135856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.135688    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-tmp-dir\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:30.135856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.135714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-bound-sa-token\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.135856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.135747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2fbf4846-9ece-410e-a123-862937184628-registry-certificates\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.135856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.135773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2fbf4846-9ece-410e-a123-862937184628-installation-pull-secrets\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.135856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.135797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqhtk\" (UniqueName: \"kubernetes.io/projected/f81944b4-eafc-4f91-b8f4-0d2b22f34d96-kube-api-access-vqhtk\") pod \"ingress-canary-v4gw2\" (UID: \"f81944b4-eafc-4f91-b8f4-0d2b22f34d96\") " pod="openshift-ingress-canary/ingress-canary-v4gw2"
Sep 10 17:12:30.135856 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:30.135795    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 17:12:30.135856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.135827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2fbf4846-9ece-410e-a123-862937184628-ca-trust-extracted\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.136210 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:30.135876    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls podName:7d4e0fe9-9c23-4184-a6d5-488642f43f1f nodeName:}" failed. No retries permitted until 2026-09-10 17:12:30.63585456 +0000 UTC m=+36.051905501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls") pod "dns-default-ftqvt" (UID: "7d4e0fe9-9c23-4184-a6d5-488642f43f1f") : secret "dns-default-metrics-tls" not found
Sep 10 17:12:30.136210 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.135914    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rwlf\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-kube-api-access-9rwlf\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.136210 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.135949    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4hqk\" (UniqueName: \"kubernetes.io/projected/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-kube-api-access-j4hqk\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:30.136210 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.136007    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2fbf4846-9ece-410e-a123-862937184628-image-registry-private-configuration\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.136210 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.136033    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2fbf4846-9ece-410e-a123-862937184628-trusted-ca\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.136210 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.136075    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.136210 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.136102    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-config-volume\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:30.136210 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.136125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f81944b4-eafc-4f91-b8f4-0d2b22f34d96-cert\") pod \"ingress-canary-v4gw2\" (UID: \"f81944b4-eafc-4f91-b8f4-0d2b22f34d96\") " pod="openshift-ingress-canary/ingress-canary-v4gw2"
Sep 10 17:12:30.136210 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.136142    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-tmp-dir\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:30.136644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.136227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2fbf4846-9ece-410e-a123-862937184628-ca-trust-extracted\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.136644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.136369    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2fbf4846-9ece-410e-a123-862937184628-registry-certificates\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.136644 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:30.136527    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 17:12:30.136644 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:30.136539    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845c4cb945-bx2sw: secret "image-registry-tls" not found
Sep 10 17:12:30.136644 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:30.136581    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls podName:2fbf4846-9ece-410e-a123-862937184628 nodeName:}" failed. No retries permitted until 2026-09-10 17:12:30.636564291 +0000 UTC m=+36.052615219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls") pod "image-registry-845c4cb945-bx2sw" (UID: "2fbf4846-9ece-410e-a123-862937184628") : secret "image-registry-tls" not found
Sep 10 17:12:30.136894 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.136853    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-config-volume\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:30.137505 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.137480    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2fbf4846-9ece-410e-a123-862937184628-trusted-ca\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.141286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.141250    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2fbf4846-9ece-410e-a123-862937184628-image-registry-private-configuration\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.141286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.141277    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2fbf4846-9ece-410e-a123-862937184628-installation-pull-secrets\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.141423 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.141257    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f81944b4-eafc-4f91-b8f4-0d2b22f34d96-cert\") pod \"ingress-canary-v4gw2\" (UID: \"f81944b4-eafc-4f91-b8f4-0d2b22f34d96\") " pod="openshift-ingress-canary/ingress-canary-v4gw2"
Sep 10 17:12:30.144586 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.144564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4hqk\" (UniqueName: \"kubernetes.io/projected/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-kube-api-access-j4hqk\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:30.144682 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.144564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqhtk\" (UniqueName: \"kubernetes.io/projected/f81944b4-eafc-4f91-b8f4-0d2b22f34d96-kube-api-access-vqhtk\") pod \"ingress-canary-v4gw2\" (UID: \"f81944b4-eafc-4f91-b8f4-0d2b22f34d96\") " pod="openshift-ingress-canary/ingress-canary-v4gw2"
Sep 10 17:12:30.144735 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.144711    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-bound-sa-token\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.144852 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.144835    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rwlf\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-kube-api-access-9rwlf\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.219220 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.219185    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v4gw2"
Sep 10 17:12:30.639819 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.639787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:30.640002 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:30.639882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:30.640002 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:30.639973    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 17:12:30.640002 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:30.639988    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 17:12:30.640002 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:30.640000    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845c4cb945-bx2sw: secret "image-registry-tls" not found
Sep 10 17:12:30.640209 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:30.640042    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls podName:7d4e0fe9-9c23-4184-a6d5-488642f43f1f nodeName:}" failed. No retries permitted until 2026-09-10 17:12:31.640024974 +0000 UTC m=+37.056075930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls") pod "dns-default-ftqvt" (UID: "7d4e0fe9-9c23-4184-a6d5-488642f43f1f") : secret "dns-default-metrics-tls" not found
Sep 10 17:12:30.640209 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:30.640073    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls podName:2fbf4846-9ece-410e-a123-862937184628 nodeName:}" failed. No retries permitted until 2026-09-10 17:12:31.640066784 +0000 UTC m=+37.056117711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls") pod "image-registry-845c4cb945-bx2sw" (UID: "2fbf4846-9ece-410e-a123-862937184628") : secret "image-registry-tls" not found
Sep 10 17:12:31.078865 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:31.078787    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:31.081239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:31.081208    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 17:12:31.648302 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:31.648145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:31.648646 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:31.648319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:31.648646 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:31.648288    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 17:12:31.648646 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:31.648378    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845c4cb945-bx2sw: secret "image-registry-tls" not found
Sep 10 17:12:31.648646 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:31.648431    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls podName:2fbf4846-9ece-410e-a123-862937184628 nodeName:}" failed. No retries permitted until 2026-09-10 17:12:33.648416088 +0000 UTC m=+39.064467031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls") pod "image-registry-845c4cb945-bx2sw" (UID: "2fbf4846-9ece-410e-a123-862937184628") : secret "image-registry-tls" not found
Sep 10 17:12:31.648646 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:31.648433    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 17:12:31.648646 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:31.648482    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls podName:7d4e0fe9-9c23-4184-a6d5-488642f43f1f nodeName:}" failed. No retries permitted until 2026-09-10 17:12:33.648469592 +0000 UTC m=+39.064520519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls") pod "dns-default-ftqvt" (UID: "7d4e0fe9-9c23-4184-a6d5-488642f43f1f") : secret "dns-default-metrics-tls" not found
Sep 10 17:12:31.678398 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:31.678371    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v4gw2"]
Sep 10 17:12:31.682236 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:12:31.682212    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81944b4_eafc_4f91_b8f4_0d2b22f34d96.slice/crio-781c4188b4b256e19640f861989cc3cac1f4adf9de4705449a13cc30ddb6aa86 WatchSource:0}: Error finding container 781c4188b4b256e19640f861989cc3cac1f4adf9de4705449a13cc30ddb6aa86: Status 404 returned error can't find the container with id 781c4188b4b256e19640f861989cc3cac1f4adf9de4705449a13cc30ddb6aa86
Sep 10 17:12:31.931015 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:31.930940    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8fgsv"]
Sep 10 17:12:31.946026 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:31.946001    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8fgsv"]
Sep 10 17:12:31.946198 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:31.946122    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:31.948391 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:31.948368    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 17:12:31.948391 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:31.948386    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 17:12:31.948391 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:31.948398    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2k9xc\""
Sep 10 17:12:31.948639 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:31.948368    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 17:12:31.949040 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:31.949021    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 17:12:32.051417 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.051368    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-data-volume\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:32.051585 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.051442    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfj4q\" (UniqueName: \"kubernetes.io/projected/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-api-access-nfj4q\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:32.051585 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.051489    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:32.051585 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.051564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:32.051686 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.051592    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-crio-socket\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:32.152912 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.152876    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:32.153105 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.152938    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-crio-socket\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:32.153105 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.152988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-data-volume\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:32.153105 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:32.153034    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 17:12:32.153105 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.153060    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfj4q\" (UniqueName: \"kubernetes.io/projected/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-api-access-nfj4q\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:32.153308 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:32.153123    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls podName:c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c nodeName:}" failed. No retries permitted until 2026-09-10 17:12:32.653102757 +0000 UTC m=+38.069153686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8fgsv" (UID: "c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c") : secret "insights-runtime-extractor-tls" not found
Sep 10 17:12:32.153308 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.153216    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-crio-socket\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:32.153308 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.153249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:32.153449 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:32.153385    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 17:12:32.153449 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.153424    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-data-volume\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:32.153544 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:32.153472    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm podName:c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c nodeName:}" failed. No retries permitted until 2026-09-10 17:12:32.653447714 +0000 UTC m=+38.069498663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8fgsv" (UID: "c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c") : configmap "kube-rbac-proxy" not found
Sep 10 17:12:32.163710 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.163682    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfj4q\" (UniqueName: \"kubernetes.io/projected/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-api-access-nfj4q\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:32.484565 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.484530    2576 generic.go:356] "Generic (PLEG): container finished" podID="57af622a-b174-4bad-9a84-d2d75c2ef6a0" containerID="93e9af1a48535a45a0321284361ec520ae21bc1a096d95af224415874395a8a4" exitCode=0
Sep 10 17:12:32.484749 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.484617    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwn9h" event={"ID":"57af622a-b174-4bad-9a84-d2d75c2ef6a0","Type":"ContainerDied","Data":"93e9af1a48535a45a0321284361ec520ae21bc1a096d95af224415874395a8a4"}
Sep 10 17:12:32.485978 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.485950    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v4gw2" event={"ID":"f81944b4-eafc-4f91-b8f4-0d2b22f34d96","Type":"ContainerStarted","Data":"781c4188b4b256e19640f861989cc3cac1f4adf9de4705449a13cc30ddb6aa86"}
Sep 10 17:12:32.657890 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.657859    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:32.658667 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:32.657944    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:32.658667 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:32.658074    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 17:12:32.658667 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:32.658128    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls podName:c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c nodeName:}" failed. No retries permitted until 2026-09-10 17:12:33.65811453 +0000 UTC m=+39.074165469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8fgsv" (UID: "c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c") : secret "insights-runtime-extractor-tls" not found
Sep 10 17:12:32.658667 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:32.658176    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 17:12:32.658667 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:32.658243    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm podName:c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c nodeName:}" failed. No retries permitted until 2026-09-10 17:12:33.658224257 +0000 UTC m=+39.074275198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8fgsv" (UID: "c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c") : configmap "kube-rbac-proxy" not found
Sep 10 17:12:33.493239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:33.493144    2576 generic.go:356] "Generic (PLEG): container finished" podID="57af622a-b174-4bad-9a84-d2d75c2ef6a0" containerID="90d63c7035918d0ab3e2359443d8129c1076e13c694b7a7c6f17767511f3ffb3" exitCode=0
Sep 10 17:12:33.493405 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:33.493242    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwn9h" event={"ID":"57af622a-b174-4bad-9a84-d2d75c2ef6a0","Type":"ContainerDied","Data":"90d63c7035918d0ab3e2359443d8129c1076e13c694b7a7c6f17767511f3ffb3"}
Sep 10 17:12:33.669290 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:33.669249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:33.669885 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:33.669331    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:33.669885 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:33.669363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:33.669885 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:33.669390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:33.669885 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:33.669399    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 17:12:33.669885 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:33.669481    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm podName:c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c nodeName:}" failed. No retries permitted until 2026-09-10 17:12:35.669455831 +0000 UTC m=+41.085506777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8fgsv" (UID: "c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c") : configmap "kube-rbac-proxy" not found
Sep 10 17:12:33.669885 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:33.669575    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 17:12:33.669885 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:33.669593    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 17:12:33.669885 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:33.669609    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845c4cb945-bx2sw: secret "image-registry-tls" not found
Sep 10 17:12:33.669885 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:33.669623    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls podName:7d4e0fe9-9c23-4184-a6d5-488642f43f1f nodeName:}" failed. No retries permitted until 2026-09-10 17:12:37.669609839 +0000 UTC m=+43.085660768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls") pod "dns-default-ftqvt" (UID: "7d4e0fe9-9c23-4184-a6d5-488642f43f1f") : secret "dns-default-metrics-tls" not found
Sep 10 17:12:33.669885 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:33.669624    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 17:12:33.669885 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:33.669652    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls podName:2fbf4846-9ece-410e-a123-862937184628 nodeName:}" failed. No retries permitted until 2026-09-10 17:12:37.669638239 +0000 UTC m=+43.085689182 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls") pod "image-registry-845c4cb945-bx2sw" (UID: "2fbf4846-9ece-410e-a123-862937184628") : secret "image-registry-tls" not found
Sep 10 17:12:33.669885 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:33.669676    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls podName:c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c nodeName:}" failed. No retries permitted until 2026-09-10 17:12:35.669660618 +0000 UTC m=+41.085711564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8fgsv" (UID: "c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c") : secret "insights-runtime-extractor-tls" not found
Sep 10 17:12:34.499285 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:34.499239    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nwn9h" event={"ID":"57af622a-b174-4bad-9a84-d2d75c2ef6a0","Type":"ContainerStarted","Data":"05664fe68f6a470ee9ed58f13eb812b3496f10a391f5e918a76e25eac3cfde48"}
Sep 10 17:12:34.500756 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:34.500732    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v4gw2" event={"ID":"f81944b4-eafc-4f91-b8f4-0d2b22f34d96","Type":"ContainerStarted","Data":"42a8a3dcf761e7c5b8ea15d9ad85e728fdbbcc93a283cf2778ab893863913009"}
Sep 10 17:12:34.532217 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:34.532165    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nwn9h" podStartSLOduration=8.294304776 podStartE2EDuration="39.532149638s" totalImagesPullingTime="31.237844862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:11:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:12:34.532071379 +0000 UTC m=+39.948122319" watchObservedRunningTime="2026-09-10 17:12:34.532149638 +0000 UTC m=+39.948200587"
Sep 10 17:12:34.554322 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:34.554269    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v4gw2" podStartSLOduration=3.17663203 podStartE2EDuration="5.554252095s" totalImagesPullingTime="2.377620065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:12:34.553021223 +0000 UTC m=+39.969072186" watchObservedRunningTime="2026-09-10 17:12:34.554252095 +0000 UTC m=+39.970303035"
Sep 10 17:12:34.698353 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:34.698326    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gv72m_7573c74d-3687-455c-85c9-4bf2b6441696/dns-node-resolver/0.log"
Sep 10 17:12:35.686772 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:35.686728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:35.686948 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:35.686816    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 17:12:35.686948 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:35.686885    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm podName:c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c nodeName:}" failed. No retries permitted until 2026-09-10 17:12:39.686865608 +0000 UTC m=+45.102916552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8fgsv" (UID: "c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c") : configmap "kube-rbac-proxy" not found
Sep 10 17:12:35.687074 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:35.687014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:35.687143 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:35.687128    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 17:12:35.687192 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:35.687182    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls podName:c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c nodeName:}" failed. No retries permitted until 2026-09-10 17:12:39.687165172 +0000 UTC m=+45.103216117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8fgsv" (UID: "c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c") : secret "insights-runtime-extractor-tls" not found
Sep 10 17:12:35.896526 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:35.896497    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ntdxg_bafbd9c5-ad9e-446b-8a01-64cdd4895832/node-ca/0.log"
Sep 10 17:12:36.718138 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:36.718103    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v4gw2_f81944b4-eafc-4f91-b8f4-0d2b22f34d96/serve-healthcheck-canary/0.log"
Sep 10 17:12:37.702374 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:37.702334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:37.702374 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:37.702375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:37.702869 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:37.702488    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 17:12:37.702869 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:37.702500    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 17:12:37.702869 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:37.702523    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-845c4cb945-bx2sw: secret "image-registry-tls" not found
Sep 10 17:12:37.702869 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:37.702540    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls podName:7d4e0fe9-9c23-4184-a6d5-488642f43f1f nodeName:}" failed. No retries permitted until 2026-09-10 17:12:45.702525653 +0000 UTC m=+51.118576592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls") pod "dns-default-ftqvt" (UID: "7d4e0fe9-9c23-4184-a6d5-488642f43f1f") : secret "dns-default-metrics-tls" not found
Sep 10 17:12:37.702869 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:37.702581    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls podName:2fbf4846-9ece-410e-a123-862937184628 nodeName:}" failed. No retries permitted until 2026-09-10 17:12:45.702562392 +0000 UTC m=+51.118613336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls") pod "image-registry-845c4cb945-bx2sw" (UID: "2fbf4846-9ece-410e-a123-862937184628") : secret "image-registry-tls" not found
Sep 10 17:12:39.716787 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:39.716751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:39.717186 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:39.716828    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:39.717186 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:39.716898    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 17:12:39.717186 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:39.716907    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 17:12:39.717186 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:39.716961    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls podName:c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c nodeName:}" failed. No retries permitted until 2026-09-10 17:12:47.716945334 +0000 UTC m=+53.132996266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8fgsv" (UID: "c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c") : secret "insights-runtime-extractor-tls" not found
Sep 10 17:12:39.717186 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:39.716975    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm podName:c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c nodeName:}" failed. No retries permitted until 2026-09-10 17:12:47.716969525 +0000 UTC m=+53.133020455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8fgsv" (UID: "c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c") : configmap "kube-rbac-proxy" not found
Sep 10 17:12:45.762138 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:45.762093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:45.762138 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:45.762135    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:45.764568 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:45.764545    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d4e0fe9-9c23-4184-a6d5-488642f43f1f-metrics-tls\") pod \"dns-default-ftqvt\" (UID: \"7d4e0fe9-9c23-4184-a6d5-488642f43f1f\") " pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:45.764690 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:45.764671    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls\") pod \"image-registry-845c4cb945-bx2sw\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") " pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:45.794699 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:45.794660    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:45.802596 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:45.802570    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:46.083144 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:46.082581    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-845c4cb945-bx2sw"]
Sep 10 17:12:46.087318 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:12:46.087292    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fbf4846_9ece_410e_a123_862937184628.slice/crio-4da3d49dd4f29b76abf493afed3bc04c302b905142482534711b9d1a4eefda1b WatchSource:0}: Error finding container 4da3d49dd4f29b76abf493afed3bc04c302b905142482534711b9d1a4eefda1b: Status 404 returned error can't find the container with id 4da3d49dd4f29b76abf493afed3bc04c302b905142482534711b9d1a4eefda1b
Sep 10 17:12:46.091133 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:46.091076    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ftqvt"]
Sep 10 17:12:46.096880 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:12:46.096853    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4e0fe9_9c23_4184_a6d5_488642f43f1f.slice/crio-25cec208ad53036996a17f84738298853c52585899b7ced79c68be3f7076d04f WatchSource:0}: Error finding container 25cec208ad53036996a17f84738298853c52585899b7ced79c68be3f7076d04f: Status 404 returned error can't find the container with id 25cec208ad53036996a17f84738298853c52585899b7ced79c68be3f7076d04f
Sep 10 17:12:46.528323 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:46.528284    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ftqvt" event={"ID":"7d4e0fe9-9c23-4184-a6d5-488642f43f1f","Type":"ContainerStarted","Data":"25cec208ad53036996a17f84738298853c52585899b7ced79c68be3f7076d04f"}
Sep 10 17:12:46.529588 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:46.529563    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-845c4cb945-bx2sw" event={"ID":"2fbf4846-9ece-410e-a123-862937184628","Type":"ContainerStarted","Data":"5f646e5f47a1091c01fc4379124cefc902c42c8f8581d37273e672e53f435d74"}
Sep 10 17:12:46.529698 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:46.529605    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-845c4cb945-bx2sw" event={"ID":"2fbf4846-9ece-410e-a123-862937184628","Type":"ContainerStarted","Data":"4da3d49dd4f29b76abf493afed3bc04c302b905142482534711b9d1a4eefda1b"}
Sep 10 17:12:46.529749 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:46.529709    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:12:46.552948 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:46.552893    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-845c4cb945-bx2sw" podStartSLOduration=23.552875621 podStartE2EDuration="23.552875621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:12:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:12:46.551828866 +0000 UTC m=+51.967879826" watchObservedRunningTime="2026-09-10 17:12:46.552875621 +0000 UTC m=+51.968926572"
Sep 10 17:12:47.777163 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:47.777129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:47.777539 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:47.777202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:47.777539 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:47.777269    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 17:12:47.777539 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:12:47.777375    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls podName:c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c nodeName:}" failed. No retries permitted until 2026-09-10 17:13:03.777355406 +0000 UTC m=+69.193406337 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8fgsv" (UID: "c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c") : secret "insights-runtime-extractor-tls" not found
Sep 10 17:12:47.777692 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:47.777675    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:12:48.536808 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:48.536778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ftqvt" event={"ID":"7d4e0fe9-9c23-4184-a6d5-488642f43f1f","Type":"ContainerStarted","Data":"e153d9f0e448754cf1aab47ca7a5a678d16b5b97e3a56f78c32609271b856df5"}
Sep 10 17:12:48.536984 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:48.536832    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ftqvt" event={"ID":"7d4e0fe9-9c23-4184-a6d5-488642f43f1f","Type":"ContainerStarted","Data":"f99e60f24e143c6effc01301537d47631f4b2866b87506c4d2f6c2a1dd2695ac"}
Sep 10 17:12:48.536984 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:48.536940    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:48.553734 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:48.553633    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ftqvt" podStartSLOduration=17.352156314 podStartE2EDuration="19.553614038s" totalImagesPullingTime="2.201457724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:12:48.552331405 +0000 UTC m=+53.968382353" watchObservedRunningTime="2026-09-10 17:12:48.553614038 +0000 UTC m=+53.969664987"
Sep 10 17:12:54.788750 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.788716    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"]
Sep 10 17:12:54.793484 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.793454    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"]
Sep 10 17:12:54.793623 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.793600    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"
Sep 10 17:12:54.797412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.797387    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 10 17:12:54.797412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.797401    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 17:12:54.797582 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.797415    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 17:12:54.797582 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.797488    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 17:12:54.798093 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.798073    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.802104 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.801664    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 10 17:12:54.802104 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.801711    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 10 17:12:54.802104 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.802034    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 10 17:12:54.802104 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.802090    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 10 17:12:54.809420 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.809394    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"]
Sep 10 17:12:54.810522 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.810498    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"]
Sep 10 17:12:54.815882 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.815855    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-845c4cb945-bx2sw"]
Sep 10 17:12:54.833530 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.833493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f6a44b2-cfd6-420a-93fe-6789972c605a-hub\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.833716 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.833535    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f6a44b2-cfd6-420a-93fe-6789972c605a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.833716 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.833565    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzrgf\" (UniqueName: \"kubernetes.io/projected/e5485122-496a-45e4-b6e7-db5b93b95c45-kube-api-access-bzrgf\") pod \"klusterlet-addon-workmgr-674f67445c-cj9sc\" (UID: \"e5485122-496a-45e4-b6e7-db5b93b95c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"
Sep 10 17:12:54.833716 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.833603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5485122-496a-45e4-b6e7-db5b93b95c45-tmp\") pod \"klusterlet-addon-workmgr-674f67445c-cj9sc\" (UID: \"e5485122-496a-45e4-b6e7-db5b93b95c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"
Sep 10 17:12:54.833716 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.833624    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f6a44b2-cfd6-420a-93fe-6789972c605a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.833906 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.833763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f6a44b2-cfd6-420a-93fe-6789972c605a-ca\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.833906 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.833846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f6a44b2-cfd6-420a-93fe-6789972c605a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.833906 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.833877    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgn8n\" (UniqueName: \"kubernetes.io/projected/7f6a44b2-cfd6-420a-93fe-6789972c605a-kube-api-access-jgn8n\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.834001 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.833913    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e5485122-496a-45e4-b6e7-db5b93b95c45-klusterlet-config\") pod \"klusterlet-addon-workmgr-674f67445c-cj9sc\" (UID: \"e5485122-496a-45e4-b6e7-db5b93b95c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"
Sep 10 17:12:54.934263 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.934215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f6a44b2-cfd6-420a-93fe-6789972c605a-ca\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.934448 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.934303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f6a44b2-cfd6-420a-93fe-6789972c605a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.934448 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.934321    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgn8n\" (UniqueName: \"kubernetes.io/projected/7f6a44b2-cfd6-420a-93fe-6789972c605a-kube-api-access-jgn8n\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.934448 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.934345    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e5485122-496a-45e4-b6e7-db5b93b95c45-klusterlet-config\") pod \"klusterlet-addon-workmgr-674f67445c-cj9sc\" (UID: \"e5485122-496a-45e4-b6e7-db5b93b95c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"
Sep 10 17:12:54.934448 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.934369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f6a44b2-cfd6-420a-93fe-6789972c605a-hub\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.934690 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.934439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f6a44b2-cfd6-420a-93fe-6789972c605a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.934690 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.934491    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzrgf\" (UniqueName: \"kubernetes.io/projected/e5485122-496a-45e4-b6e7-db5b93b95c45-kube-api-access-bzrgf\") pod \"klusterlet-addon-workmgr-674f67445c-cj9sc\" (UID: \"e5485122-496a-45e4-b6e7-db5b93b95c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"
Sep 10 17:12:54.934690 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.934544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5485122-496a-45e4-b6e7-db5b93b95c45-tmp\") pod \"klusterlet-addon-workmgr-674f67445c-cj9sc\" (UID: \"e5485122-496a-45e4-b6e7-db5b93b95c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"
Sep 10 17:12:54.934690 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.934583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f6a44b2-cfd6-420a-93fe-6789972c605a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.934910 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.934891    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5485122-496a-45e4-b6e7-db5b93b95c45-tmp\") pod \"klusterlet-addon-workmgr-674f67445c-cj9sc\" (UID: \"e5485122-496a-45e4-b6e7-db5b93b95c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"
Sep 10 17:12:54.936533 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.936517    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 10 17:12:54.936782 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.936768    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 10 17:12:54.937068 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.937037    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 17:12:54.937168 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.937148    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 10 17:12:54.937391 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.937376    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 10 17:12:54.937433 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.937389    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 10 17:12:54.945256 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.945232    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f6a44b2-cfd6-420a-93fe-6789972c605a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.945426 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.945345    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 17:12:54.947123 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.947103    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f6a44b2-cfd6-420a-93fe-6789972c605a-hub\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.947408 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.947390    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e5485122-496a-45e4-b6e7-db5b93b95c45-klusterlet-config\") pod \"klusterlet-addon-workmgr-674f67445c-cj9sc\" (UID: \"e5485122-496a-45e4-b6e7-db5b93b95c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"
Sep 10 17:12:54.947458 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.947419    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f6a44b2-cfd6-420a-93fe-6789972c605a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.947508 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.947493    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f6a44b2-cfd6-420a-93fe-6789972c605a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.947823 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.947802    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f6a44b2-cfd6-420a-93fe-6789972c605a-ca\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:54.960104 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.960080    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzrgf\" (UniqueName: \"kubernetes.io/projected/e5485122-496a-45e4-b6e7-db5b93b95c45-kube-api-access-bzrgf\") pod \"klusterlet-addon-workmgr-674f67445c-cj9sc\" (UID: \"e5485122-496a-45e4-b6e7-db5b93b95c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"
Sep 10 17:12:54.960262 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:54.960240    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgn8n\" (UniqueName: \"kubernetes.io/projected/7f6a44b2-cfd6-420a-93fe-6789972c605a-kube-api-access-jgn8n\") pod \"cluster-proxy-proxy-agent-7d465bc699-qdcfw\" (UID: \"7f6a44b2-cfd6-420a-93fe-6789972c605a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:55.108380 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:55.108306    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 17:12:55.116536 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:55.116510    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"
Sep 10 17:12:55.118136 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:55.118116    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"
Sep 10 17:12:55.400747 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:55.400713    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"]
Sep 10 17:12:55.404378 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:55.404343    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw"]
Sep 10 17:12:55.405220 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:12:55.405187    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5485122_496a_45e4_b6e7_db5b93b95c45.slice/crio-c5235b9248151b9d880dbb17b700347fd3b2df5fe7d0a18a70d3b2a6e5af3c4d WatchSource:0}: Error finding container c5235b9248151b9d880dbb17b700347fd3b2df5fe7d0a18a70d3b2a6e5af3c4d: Status 404 returned error can't find the container with id c5235b9248151b9d880dbb17b700347fd3b2df5fe7d0a18a70d3b2a6e5af3c4d
Sep 10 17:12:55.407246 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:12:55.407225    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f6a44b2_cfd6_420a_93fe_6789972c605a.slice/crio-69703816500b3e99ab98c42d1133e28c6bb01bd546909998796de41b01930eec WatchSource:0}: Error finding container 69703816500b3e99ab98c42d1133e28c6bb01bd546909998796de41b01930eec: Status 404 returned error can't find the container with id 69703816500b3e99ab98c42d1133e28c6bb01bd546909998796de41b01930eec
Sep 10 17:12:55.557306 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:55.557267    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc" event={"ID":"e5485122-496a-45e4-b6e7-db5b93b95c45","Type":"ContainerStarted","Data":"c5235b9248151b9d880dbb17b700347fd3b2df5fe7d0a18a70d3b2a6e5af3c4d"}
Sep 10 17:12:55.558380 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:55.558359    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw" event={"ID":"7f6a44b2-cfd6-420a-93fe-6789972c605a","Type":"ContainerStarted","Data":"69703816500b3e99ab98c42d1133e28c6bb01bd546909998796de41b01930eec"}
Sep 10 17:12:56.485426 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:56.483960    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5hkvd"
Sep 10 17:12:58.541973 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:58.541944    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ftqvt"
Sep 10 17:12:59.881598 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:59.881558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs\") pod \"network-metrics-daemon-4xbqt\" (UID: \"8c1a0a20-5a72-4a67-817d-08658f7663ac\") " pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:59.882104 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:59.881629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:59.882104 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:59.881670    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ghw\" (UniqueName: \"kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw\") pod \"network-check-target-9djxw\" (UID: \"649da03e-1ef2-473a-b16a-112caf256391\") " pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:12:59.883987 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:59.883963    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 17:12:59.884489 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:59.884465    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 17:12:59.884600 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:59.884470    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 17:12:59.894533 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:59.894508    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 17:12:59.895191 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:59.895169    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c1a0a20-5a72-4a67-817d-08658f7663ac-metrics-certs\") pod \"network-metrics-daemon-4xbqt\" (UID: \"8c1a0a20-5a72-4a67-817d-08658f7663ac\") " pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:12:59.895332 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:59.895254    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff-original-pull-secret\") pod \"global-pull-secret-syncer-55pvg\" (UID: \"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff\") " pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:12:59.905815 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:12:59.905789    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9ghw\" (UniqueName: \"kubernetes.io/projected/649da03e-1ef2-473a-b16a-112caf256391-kube-api-access-g9ghw\") pod \"network-check-target-9djxw\" (UID: \"649da03e-1ef2-473a-b16a-112caf256391\") " pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:13:00.094942 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:00.094911    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f2g8g\""
Sep 10 17:13:00.103776 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:00.103751    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:13:00.111429 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:00.111397    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8vgb7\""
Sep 10 17:13:00.120038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:00.120012    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xbqt"
Sep 10 17:13:00.189407 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:00.189320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-55pvg"
Sep 10 17:13:01.508089 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:01.507995    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9djxw"]
Sep 10 17:13:01.511378 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:01.511344    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4xbqt"]
Sep 10 17:13:01.511753 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:13:01.511726    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649da03e_1ef2_473a_b16a_112caf256391.slice/crio-fe1c40bd81bbff57e83cfaafe7cefb090a87ef551e1ed24f50bbf311ffe5e4c4 WatchSource:0}: Error finding container fe1c40bd81bbff57e83cfaafe7cefb090a87ef551e1ed24f50bbf311ffe5e4c4: Status 404 returned error can't find the container with id fe1c40bd81bbff57e83cfaafe7cefb090a87ef551e1ed24f50bbf311ffe5e4c4
Sep 10 17:13:01.514411 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:01.514386    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-55pvg"]
Sep 10 17:13:01.515399 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:13:01.515344    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c1a0a20_5a72_4a67_817d_08658f7663ac.slice/crio-ff99cea89519bc23cd948119f2629b4f21a59be169856aab2ffca8d4cd839abc WatchSource:0}: Error finding container ff99cea89519bc23cd948119f2629b4f21a59be169856aab2ffca8d4cd839abc: Status 404 returned error can't find the container with id ff99cea89519bc23cd948119f2629b4f21a59be169856aab2ffca8d4cd839abc
Sep 10 17:13:01.518030 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:13:01.518010    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d4ad2d8_0a87_42e5_8f82_e0c85b7dfcff.slice/crio-bba520ae69f3ffef0c03451fcfa1c17142b6934fa36dff9c74bd6582966e35ae WatchSource:0}: Error finding container bba520ae69f3ffef0c03451fcfa1c17142b6934fa36dff9c74bd6582966e35ae: Status 404 returned error can't find the container with id bba520ae69f3ffef0c03451fcfa1c17142b6934fa36dff9c74bd6582966e35ae
Sep 10 17:13:01.578858 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:01.578823    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc" event={"ID":"e5485122-496a-45e4-b6e7-db5b93b95c45","Type":"ContainerStarted","Data":"a7c6a9a52da28009a861355db670c229930808811bddeab8e90a40197f4eefcc"}
Sep 10 17:13:01.579033 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:01.579016    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"
Sep 10 17:13:01.580312 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:01.580268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-55pvg" event={"ID":"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff","Type":"ContainerStarted","Data":"bba520ae69f3ffef0c03451fcfa1c17142b6934fa36dff9c74bd6582966e35ae"}
Sep 10 17:13:01.580917 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:01.580895    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc"
Sep 10 17:13:01.582497 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:01.582480    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw" event={"ID":"7f6a44b2-cfd6-420a-93fe-6789972c605a","Type":"ContainerStarted","Data":"092c5e92536bdde3920ca681b07eabd4afeac30f2780604bef73b09192590ae1"}
Sep 10 17:13:01.582615 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:01.582506    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw" event={"ID":"7f6a44b2-cfd6-420a-93fe-6789972c605a","Type":"ContainerStarted","Data":"8e49f14f6c04e46515bfd3c60f543a01aff187f521f9222eb2938db3d443dc58"}
Sep 10 17:13:01.582615 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:01.582519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw" event={"ID":"7f6a44b2-cfd6-420a-93fe-6789972c605a","Type":"ContainerStarted","Data":"59643e897d0a6343941f8960b862802f334eccb4b7b4acb5c8613b2fd2cdcd88"}
Sep 10 17:13:01.583712 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:01.583691    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9djxw" event={"ID":"649da03e-1ef2-473a-b16a-112caf256391","Type":"ContainerStarted","Data":"fe1c40bd81bbff57e83cfaafe7cefb090a87ef551e1ed24f50bbf311ffe5e4c4"}
Sep 10 17:13:01.584709 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:01.584691    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4xbqt" event={"ID":"8c1a0a20-5a72-4a67-817d-08658f7663ac","Type":"ContainerStarted","Data":"ff99cea89519bc23cd948119f2629b4f21a59be169856aab2ffca8d4cd839abc"}
Sep 10 17:13:01.593811 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:01.593775    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-674f67445c-cj9sc" podStartSLOduration=1.7454630500000001 podStartE2EDuration="7.593763368s" totalImagesPullingTime="5.848300318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:12:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:13:01.592787674 +0000 UTC m=+67.008838625" watchObservedRunningTime="2026-09-10 17:13:01.593763368 +0000 UTC m=+67.009814316"
Sep 10 17:13:01.626782 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:01.626740    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d465bc699-qdcfw" podStartSLOduration=1.790207834 podStartE2EDuration="7.626725858s" totalImagesPullingTime="5.836518024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:12:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:13:01.625783632 +0000 UTC m=+67.041834582" watchObservedRunningTime="2026-09-10 17:13:01.626725858 +0000 UTC m=+67.042776807"
Sep 10 17:13:03.595778 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:03.595728    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4xbqt" event={"ID":"8c1a0a20-5a72-4a67-817d-08658f7663ac","Type":"ContainerStarted","Data":"9bea75c71af6cc5564b2e3193653de63ae68579f68f60293872b263de5a5447a"}
Sep 10 17:13:03.596273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:03.595802    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4xbqt" event={"ID":"8c1a0a20-5a72-4a67-817d-08658f7663ac","Type":"ContainerStarted","Data":"a109c5d7a5c654fd0d4027879970c2623f6c4c5aa9ff3ac9b8f04ffd0b605064"}
Sep 10 17:13:03.812821 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:03.812693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:13:03.815446 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:03.815419    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8fgsv\" (UID: \"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c\") " pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:13:04.058871 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:04.058760    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2k9xc\""
Sep 10 17:13:04.066787 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:04.066647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8fgsv"
Sep 10 17:13:04.822156 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:04.822111    2576 patch_prober.go:28] interesting pod/image-registry-845c4cb945-bx2sw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 10 17:13:04.822602 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:04.822172    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-845c4cb945-bx2sw" podUID="2fbf4846-9ece-410e-a123-862937184628" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 17:13:06.560362 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:06.560254    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4xbqt" podStartSLOduration=69.934554132 podStartE2EDuration="1m11.560232305s" totalImagesPullingTime="1.625678173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:13:03.612251766 +0000 UTC m=+69.028302716" watchObservedRunningTime="2026-09-10 17:13:06.560232305 +0000 UTC m=+71.976283258"
Sep 10 17:13:06.560746 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:06.560434    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8fgsv"]
Sep 10 17:13:06.563920 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:13:06.563887    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2aa2d6e_b8c7_4d9c_b8f1_97a531bfc26c.slice/crio-e8268c1e59c3e0c7aa13b5721dcef528cdc9f121b84a22220a06f72c1af62d02 WatchSource:0}: Error finding container e8268c1e59c3e0c7aa13b5721dcef528cdc9f121b84a22220a06f72c1af62d02: Status 404 returned error can't find the container with id e8268c1e59c3e0c7aa13b5721dcef528cdc9f121b84a22220a06f72c1af62d02
Sep 10 17:13:06.608010 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:06.607981    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8fgsv" event={"ID":"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c","Type":"ContainerStarted","Data":"e8268c1e59c3e0c7aa13b5721dcef528cdc9f121b84a22220a06f72c1af62d02"}
Sep 10 17:13:06.609658 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:06.609629    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-55pvg" event={"ID":"2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff","Type":"ContainerStarted","Data":"916b88562fbc7c2b73bb227d6b854865ac920eadf16a3fb19b03288259e3f952"}
Sep 10 17:13:06.611201 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:06.611174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9djxw" event={"ID":"649da03e-1ef2-473a-b16a-112caf256391","Type":"ContainerStarted","Data":"67ed3151cb3b95aeb4ca93cbeb12091ad900a38dba2ecde45081d8ea6ed302c0"}
Sep 10 17:13:06.611344 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:06.611319    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:13:06.625560 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:06.625382    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-55pvg" podStartSLOduration=66.842924523 podStartE2EDuration="1m11.625368323s" totalImagesPullingTime="4.7824438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:13:06.624980575 +0000 UTC m=+72.041031524" watchObservedRunningTime="2026-09-10 17:13:06.625368323 +0000 UTC m=+72.041419272"
Sep 10 17:13:06.638340 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:06.638277    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9djxw" podStartSLOduration=66.854707539 podStartE2EDuration="1m11.638258459s" totalImagesPullingTime="4.78355092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:11:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:13:06.637959684 +0000 UTC m=+72.054010634" watchObservedRunningTime="2026-09-10 17:13:06.638258459 +0000 UTC m=+72.054309411"
Sep 10 17:13:07.616288 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:07.616245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8fgsv" event={"ID":"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c","Type":"ContainerStarted","Data":"30699e7cb3279d495e6abba2f8b29374330215f15a7feb64dd8d81b9c2d9a85e"}
Sep 10 17:13:07.616692 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:07.616305    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8fgsv" event={"ID":"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c","Type":"ContainerStarted","Data":"f07e89e8d798ae1146293e25e81c27c5b44fffae54f890b6a9cd3ee292da85a5"}
Sep 10 17:13:09.625230 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:09.625199    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8fgsv" event={"ID":"c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c","Type":"ContainerStarted","Data":"79a7e173a787b440a8fe748cbcdd7910cc7da06da660f2d1937be19f838ba2f4"}
Sep 10 17:13:09.645173 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:09.645124    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8fgsv" podStartSLOduration=36.708613125 podStartE2EDuration="38.64510726s" totalImagesPullingTime="1.936494135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:12:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:13:09.644407556 +0000 UTC m=+75.060458506" watchObservedRunningTime="2026-09-10 17:13:09.64510726 +0000 UTC m=+75.061158209"
Sep 10 17:13:10.158125 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.158091    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"]
Sep 10 17:13:10.160268 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.160251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.166985 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.166964    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 10 17:13:10.169467 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.169394    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-thsm9\""
Sep 10 17:13:10.172691 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.170457    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 10 17:13:10.174584 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.174562    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 17:13:10.175005 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.174992    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 17:13:10.175113 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.175096    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 17:13:10.176603 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.176587    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 10 17:13:10.198752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.198724    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"]
Sep 10 17:13:10.243205 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.243175    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5z272"]
Sep 10 17:13:10.245328 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.245307    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.247605 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.247577    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 17:13:10.247718 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.247610    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 17:13:10.247718 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.247636    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 17:13:10.247718 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.247652    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-279hs\""
Sep 10 17:13:10.265810 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.265783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kd2q\" (UniqueName: \"kubernetes.io/projected/c82dbd4a-443b-4b11-b1bc-b777d8f29868-kube-api-access-6kd2q\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.265937 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.265813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c82dbd4a-443b-4b11-b1bc-b777d8f29868-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.265937 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.265840    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c82dbd4a-443b-4b11-b1bc-b777d8f29868-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.265937 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.265857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c82dbd4a-443b-4b11-b1bc-b777d8f29868-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.265937 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.265913    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c82dbd4a-443b-4b11-b1bc-b777d8f29868-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.266086 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.265986    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c82dbd4a-443b-4b11-b1bc-b777d8f29868-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.366874 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.366836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c82dbd4a-443b-4b11-b1bc-b777d8f29868-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.366874 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.366879    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e11ee9d7-d98c-4381-9e58-758ddb0882dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.367191 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.366907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg58r\" (UniqueName: \"kubernetes.io/projected/e11ee9d7-d98c-4381-9e58-758ddb0882dd-kube-api-access-lg58r\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.367191 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.366956    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e11ee9d7-d98c-4381-9e58-758ddb0882dd-sys\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.367191 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.367002    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kd2q\" (UniqueName: \"kubernetes.io/projected/c82dbd4a-443b-4b11-b1bc-b777d8f29868-kube-api-access-6kd2q\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.367191 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.367039    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e11ee9d7-d98c-4381-9e58-758ddb0882dd-node-exporter-wtmp\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.367191 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.367088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c82dbd4a-443b-4b11-b1bc-b777d8f29868-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.367191 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.367114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e11ee9d7-d98c-4381-9e58-758ddb0882dd-root\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.367191 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.367143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e11ee9d7-d98c-4381-9e58-758ddb0882dd-metrics-client-ca\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.367532 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.367230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c82dbd4a-443b-4b11-b1bc-b777d8f29868-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.367532 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.367288    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c82dbd4a-443b-4b11-b1bc-b777d8f29868-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.367532 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.367314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e11ee9d7-d98c-4381-9e58-758ddb0882dd-node-exporter-tls\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.367532 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.367349    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c82dbd4a-443b-4b11-b1bc-b777d8f29868-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.367532 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.367406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e11ee9d7-d98c-4381-9e58-758ddb0882dd-node-exporter-textfile\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.367532 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.367438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e11ee9d7-d98c-4381-9e58-758ddb0882dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.367796 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.367548    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c82dbd4a-443b-4b11-b1bc-b777d8f29868-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.367796 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.367659    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c82dbd4a-443b-4b11-b1bc-b777d8f29868-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.367796 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.367765    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c82dbd4a-443b-4b11-b1bc-b777d8f29868-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.369636 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.369611    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c82dbd4a-443b-4b11-b1bc-b777d8f29868-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.369771 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.369753    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c82dbd4a-443b-4b11-b1bc-b777d8f29868-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.377657 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.377631    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kd2q\" (UniqueName: \"kubernetes.io/projected/c82dbd4a-443b-4b11-b1bc-b777d8f29868-kube-api-access-6kd2q\") pod \"kube-state-metrics-74cb57df7-d8rtg\" (UID: \"c82dbd4a-443b-4b11-b1bc-b777d8f29868\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.468700 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.468604    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"
Sep 10 17:13:10.468700 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.468683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg58r\" (UniqueName: \"kubernetes.io/projected/e11ee9d7-d98c-4381-9e58-758ddb0882dd-kube-api-access-lg58r\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.468922 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.468722    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e11ee9d7-d98c-4381-9e58-758ddb0882dd-sys\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.468922 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.468785    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e11ee9d7-d98c-4381-9e58-758ddb0882dd-sys\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.468922 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.468821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e11ee9d7-d98c-4381-9e58-758ddb0882dd-node-exporter-wtmp\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.468922 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.468842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e11ee9d7-d98c-4381-9e58-758ddb0882dd-root\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.468922 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.468869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e11ee9d7-d98c-4381-9e58-758ddb0882dd-metrics-client-ca\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.468922 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.468911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e11ee9d7-d98c-4381-9e58-758ddb0882dd-node-exporter-tls\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.469243 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.468932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e11ee9d7-d98c-4381-9e58-758ddb0882dd-root\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.469243 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.468943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e11ee9d7-d98c-4381-9e58-758ddb0882dd-node-exporter-textfile\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.469243 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.468975    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e11ee9d7-d98c-4381-9e58-758ddb0882dd-node-exporter-wtmp\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.469243 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.468997    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e11ee9d7-d98c-4381-9e58-758ddb0882dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.469243 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.469037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e11ee9d7-d98c-4381-9e58-758ddb0882dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.469458 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.469358    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e11ee9d7-d98c-4381-9e58-758ddb0882dd-node-exporter-textfile\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.469708 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.469674    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e11ee9d7-d98c-4381-9e58-758ddb0882dd-metrics-client-ca\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.469834 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.469709    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e11ee9d7-d98c-4381-9e58-758ddb0882dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.471621 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.471603    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e11ee9d7-d98c-4381-9e58-758ddb0882dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.471899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.471880    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e11ee9d7-d98c-4381-9e58-758ddb0882dd-node-exporter-tls\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.478284 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.478201    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg58r\" (UniqueName: \"kubernetes.io/projected/e11ee9d7-d98c-4381-9e58-758ddb0882dd-kube-api-access-lg58r\") pod \"node-exporter-5z272\" (UID: \"e11ee9d7-d98c-4381-9e58-758ddb0882dd\") " pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.554512 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.554479    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5z272"
Sep 10 17:13:10.568014 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:13:10.567991    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode11ee9d7_d98c_4381_9e58_758ddb0882dd.slice/crio-45ba4c973013427658f39483201ffae3755cfe6f3a2363d5f50bb7d0a3982433 WatchSource:0}: Error finding container 45ba4c973013427658f39483201ffae3755cfe6f3a2363d5f50bb7d0a3982433: Status 404 returned error can't find the container with id 45ba4c973013427658f39483201ffae3755cfe6f3a2363d5f50bb7d0a3982433
Sep 10 17:13:10.629334 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.629290    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5z272" event={"ID":"e11ee9d7-d98c-4381-9e58-758ddb0882dd","Type":"ContainerStarted","Data":"45ba4c973013427658f39483201ffae3755cfe6f3a2363d5f50bb7d0a3982433"}
Sep 10 17:13:10.740608 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:10.740530    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg"]
Sep 10 17:13:10.743390 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:13:10.743364    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82dbd4a_443b_4b11_b1bc_b777d8f29868.slice/crio-5ac32442f2a03c0471a2a3d1c46e1c292add0613f021051c3348e739f48d1aa5 WatchSource:0}: Error finding container 5ac32442f2a03c0471a2a3d1c46e1c292add0613f021051c3348e739f48d1aa5: Status 404 returned error can't find the container with id 5ac32442f2a03c0471a2a3d1c46e1c292add0613f021051c3348e739f48d1aa5
Sep 10 17:13:11.634897 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:11.634858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg" event={"ID":"c82dbd4a-443b-4b11-b1bc-b777d8f29868","Type":"ContainerStarted","Data":"5ac32442f2a03c0471a2a3d1c46e1c292add0613f021051c3348e739f48d1aa5"}
Sep 10 17:13:12.639516 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:12.639477    2576 generic.go:356] "Generic (PLEG): container finished" podID="e11ee9d7-d98c-4381-9e58-758ddb0882dd" containerID="b6e690413e99639259dd3a6df9751f3a0cccf01fc6821044270ef381c75d9e96" exitCode=0
Sep 10 17:13:12.639920 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:12.639564    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5z272" event={"ID":"e11ee9d7-d98c-4381-9e58-758ddb0882dd","Type":"ContainerDied","Data":"b6e690413e99639259dd3a6df9751f3a0cccf01fc6821044270ef381c75d9e96"}
Sep 10 17:13:12.641907 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:12.641882    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg" event={"ID":"c82dbd4a-443b-4b11-b1bc-b777d8f29868","Type":"ContainerStarted","Data":"a411f372ecbc7811b88813c9e717e487f5413d63baf6d0698891d9424331264f"}
Sep 10 17:13:12.642038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:12.641937    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg" event={"ID":"c82dbd4a-443b-4b11-b1bc-b777d8f29868","Type":"ContainerStarted","Data":"17086824e8e2a4db61f4530c41c3a835f78c39e67467a64e9f824aa22ec23b26"}
Sep 10 17:13:12.642038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:12.641968    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg" event={"ID":"c82dbd4a-443b-4b11-b1bc-b777d8f29868","Type":"ContainerStarted","Data":"3e2e5503383523a2db542f2bb1bd77898ae1f1a5c561b4b160d97a2f332781c1"}
Sep 10 17:13:12.684386 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:12.684319    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-d8rtg" podStartSLOduration=1.408556748 podStartE2EDuration="2.684296966s" totalImagesPullingTime="1.275740218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:13:12.683568283 +0000 UTC m=+78.099619258" watchObservedRunningTime="2026-09-10 17:13:12.684296966 +0000 UTC m=+78.100347919"
Sep 10 17:13:13.647301 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:13.647259    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5z272" event={"ID":"e11ee9d7-d98c-4381-9e58-758ddb0882dd","Type":"ContainerStarted","Data":"cb3d54d106b83f9a4cba1da65dc6962b30198f29971321dbacd665f1cd2d8758"}
Sep 10 17:13:13.647721 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:13.647330    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5z272" event={"ID":"e11ee9d7-d98c-4381-9e58-758ddb0882dd","Type":"ContainerStarted","Data":"ecc438f23a68dfb14b0a772a850881805db9e617655dbc3a83e705e7688712ea"}
Sep 10 17:13:13.667875 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:13.667816    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5z272" podStartSLOduration=2.473121636 podStartE2EDuration="3.667797541s" totalImagesPullingTime="1.12160701s" totalInitContainerRuntime="73.068895ms" isStatefulPod=true podCreationTimestamp="2026-09-10 17:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:13:13.667319422 +0000 UTC m=+79.083370370" watchObservedRunningTime="2026-09-10 17:13:13.667797541 +0000 UTC m=+79.083848516"
Sep 10 17:13:14.820902 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:14.820877    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:13:19.836209 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:19.836044    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-845c4cb945-bx2sw" podUID="2fbf4846-9ece-410e-a123-862937184628" containerName="registry" containerID="cri-o://5f646e5f47a1091c01fc4379124cefc902c42c8f8581d37273e672e53f435d74" gracePeriod=30
Sep 10 17:13:20.073042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.073015    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:13:20.143024 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.142987    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2fbf4846-9ece-410e-a123-862937184628-installation-pull-secrets\") pod \"2fbf4846-9ece-410e-a123-862937184628\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") "
Sep 10 17:13:20.143208 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.143036    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-bound-sa-token\") pod \"2fbf4846-9ece-410e-a123-862937184628\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") "
Sep 10 17:13:20.143208 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.143167    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rwlf\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-kube-api-access-9rwlf\") pod \"2fbf4846-9ece-410e-a123-862937184628\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") "
Sep 10 17:13:20.143208 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.143203    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2fbf4846-9ece-410e-a123-862937184628-registry-certificates\") pod \"2fbf4846-9ece-410e-a123-862937184628\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") "
Sep 10 17:13:20.143345 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.143235    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls\") pod \"2fbf4846-9ece-410e-a123-862937184628\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") "
Sep 10 17:13:20.143345 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.143257    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2fbf4846-9ece-410e-a123-862937184628-image-registry-private-configuration\") pod \"2fbf4846-9ece-410e-a123-862937184628\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") "
Sep 10 17:13:20.143345 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.143275    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2fbf4846-9ece-410e-a123-862937184628-trusted-ca\") pod \"2fbf4846-9ece-410e-a123-862937184628\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") "
Sep 10 17:13:20.143345 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.143292    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2fbf4846-9ece-410e-a123-862937184628-ca-trust-extracted\") pod \"2fbf4846-9ece-410e-a123-862937184628\" (UID: \"2fbf4846-9ece-410e-a123-862937184628\") "
Sep 10 17:13:20.143863 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.143806    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fbf4846-9ece-410e-a123-862937184628-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2fbf4846-9ece-410e-a123-862937184628" (UID: "2fbf4846-9ece-410e-a123-862937184628"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:13:20.143989 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.143874    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fbf4846-9ece-410e-a123-862937184628-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2fbf4846-9ece-410e-a123-862937184628" (UID: "2fbf4846-9ece-410e-a123-862937184628"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:13:20.146021 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.145988    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fbf4846-9ece-410e-a123-862937184628-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2fbf4846-9ece-410e-a123-862937184628" (UID: "2fbf4846-9ece-410e-a123-862937184628"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:13:20.146150 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.146036    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2fbf4846-9ece-410e-a123-862937184628" (UID: "2fbf4846-9ece-410e-a123-862937184628"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:13:20.146150 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.146113    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2fbf4846-9ece-410e-a123-862937184628" (UID: "2fbf4846-9ece-410e-a123-862937184628"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:13:20.146262 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.146149    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fbf4846-9ece-410e-a123-862937184628-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2fbf4846-9ece-410e-a123-862937184628" (UID: "2fbf4846-9ece-410e-a123-862937184628"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:13:20.146262 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.146220    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-kube-api-access-9rwlf" (OuterVolumeSpecName: "kube-api-access-9rwlf") pod "2fbf4846-9ece-410e-a123-862937184628" (UID: "2fbf4846-9ece-410e-a123-862937184628"). InnerVolumeSpecName "kube-api-access-9rwlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:13:20.152433 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.152410    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fbf4846-9ece-410e-a123-862937184628-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2fbf4846-9ece-410e-a123-862937184628" (UID: "2fbf4846-9ece-410e-a123-862937184628"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:13:20.244324 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.244292    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2fbf4846-9ece-410e-a123-862937184628-installation-pull-secrets\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:13:20.244324 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.244320    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-bound-sa-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:13:20.244324 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.244329    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rwlf\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-kube-api-access-9rwlf\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:13:20.244529 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.244338    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2fbf4846-9ece-410e-a123-862937184628-registry-certificates\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:13:20.244529 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.244348    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2fbf4846-9ece-410e-a123-862937184628-registry-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:13:20.244529 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.244358    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2fbf4846-9ece-410e-a123-862937184628-image-registry-private-configuration\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:13:20.244529 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.244366    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2fbf4846-9ece-410e-a123-862937184628-trusted-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:13:20.244529 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.244374    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2fbf4846-9ece-410e-a123-862937184628-ca-trust-extracted\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:13:20.671483 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.671449    2576 generic.go:356] "Generic (PLEG): container finished" podID="2fbf4846-9ece-410e-a123-862937184628" containerID="5f646e5f47a1091c01fc4379124cefc902c42c8f8581d37273e672e53f435d74" exitCode=0
Sep 10 17:13:20.671651 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.671495    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-845c4cb945-bx2sw"
Sep 10 17:13:20.671651 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.671507    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-845c4cb945-bx2sw" event={"ID":"2fbf4846-9ece-410e-a123-862937184628","Type":"ContainerDied","Data":"5f646e5f47a1091c01fc4379124cefc902c42c8f8581d37273e672e53f435d74"}
Sep 10 17:13:20.671651 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.671551    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-845c4cb945-bx2sw" event={"ID":"2fbf4846-9ece-410e-a123-862937184628","Type":"ContainerDied","Data":"4da3d49dd4f29b76abf493afed3bc04c302b905142482534711b9d1a4eefda1b"}
Sep 10 17:13:20.671651 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.671571    2576 scope.go:117] "RemoveContainer" containerID="5f646e5f47a1091c01fc4379124cefc902c42c8f8581d37273e672e53f435d74"
Sep 10 17:13:20.680016 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.679997    2576 scope.go:117] "RemoveContainer" containerID="5f646e5f47a1091c01fc4379124cefc902c42c8f8581d37273e672e53f435d74"
Sep 10 17:13:20.680301 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:13:20.680274    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f646e5f47a1091c01fc4379124cefc902c42c8f8581d37273e672e53f435d74\": container with ID starting with 5f646e5f47a1091c01fc4379124cefc902c42c8f8581d37273e672e53f435d74 not found: ID does not exist" containerID="5f646e5f47a1091c01fc4379124cefc902c42c8f8581d37273e672e53f435d74"
Sep 10 17:13:20.680381 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.680310    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f646e5f47a1091c01fc4379124cefc902c42c8f8581d37273e672e53f435d74"} err="failed to get container status \"5f646e5f47a1091c01fc4379124cefc902c42c8f8581d37273e672e53f435d74\": rpc error: code = NotFound desc = could not find container \"5f646e5f47a1091c01fc4379124cefc902c42c8f8581d37273e672e53f435d74\": container with ID starting with 5f646e5f47a1091c01fc4379124cefc902c42c8f8581d37273e672e53f435d74 not found: ID does not exist"
Sep 10 17:13:20.693826 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.692326    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-845c4cb945-bx2sw"]
Sep 10 17:13:20.695225 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:20.695203    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-845c4cb945-bx2sw"]
Sep 10 17:13:21.083079 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:21.082988    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fbf4846-9ece-410e-a123-862937184628" path="/var/lib/kubelet/pods/2fbf4846-9ece-410e-a123-862937184628/volumes"
Sep 10 17:13:37.619067 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:13:37.619025    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9djxw"
Sep 10 17:16:54.958490 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:16:54.958465    2576 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 17:17:05.045757 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.045721    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mdfjf"]
Sep 10 17:17:05.047298 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.045986    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fbf4846-9ece-410e-a123-862937184628" containerName="registry"
Sep 10 17:17:05.047298 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.046004    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fbf4846-9ece-410e-a123-862937184628" containerName="registry"
Sep 10 17:17:05.047298 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.046071    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fbf4846-9ece-410e-a123-862937184628" containerName="registry"
Sep 10 17:17:05.047869 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.047853    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mdfjf"
Sep 10 17:17:05.052192 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.052169    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 17:17:05.052486 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.052465    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 17:17:05.054535 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.054519    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mtzkd\""
Sep 10 17:17:05.068364 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.068333    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mdfjf"]
Sep 10 17:17:05.188108 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.188036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq88g\" (UniqueName: \"kubernetes.io/projected/730f6b80-a6bd-46c6-8465-6303a2ee681e-kube-api-access-zq88g\") pod \"cert-manager-operator-controller-manager-55c444bf86-mdfjf\" (UID: \"730f6b80-a6bd-46c6-8465-6303a2ee681e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mdfjf"
Sep 10 17:17:05.188364 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.188114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/730f6b80-a6bd-46c6-8465-6303a2ee681e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mdfjf\" (UID: \"730f6b80-a6bd-46c6-8465-6303a2ee681e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mdfjf"
Sep 10 17:17:05.289192 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.289148    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq88g\" (UniqueName: \"kubernetes.io/projected/730f6b80-a6bd-46c6-8465-6303a2ee681e-kube-api-access-zq88g\") pod \"cert-manager-operator-controller-manager-55c444bf86-mdfjf\" (UID: \"730f6b80-a6bd-46c6-8465-6303a2ee681e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mdfjf"
Sep 10 17:17:05.289308 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.289200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/730f6b80-a6bd-46c6-8465-6303a2ee681e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mdfjf\" (UID: \"730f6b80-a6bd-46c6-8465-6303a2ee681e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mdfjf"
Sep 10 17:17:05.289548 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.289533    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/730f6b80-a6bd-46c6-8465-6303a2ee681e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mdfjf\" (UID: \"730f6b80-a6bd-46c6-8465-6303a2ee681e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mdfjf"
Sep 10 17:17:05.298574 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.298502    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq88g\" (UniqueName: \"kubernetes.io/projected/730f6b80-a6bd-46c6-8465-6303a2ee681e-kube-api-access-zq88g\") pod \"cert-manager-operator-controller-manager-55c444bf86-mdfjf\" (UID: \"730f6b80-a6bd-46c6-8465-6303a2ee681e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mdfjf"
Sep 10 17:17:05.356521 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.356479    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mdfjf"
Sep 10 17:17:05.669905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.669720    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mdfjf"]
Sep 10 17:17:05.672671 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:17:05.672635    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod730f6b80_a6bd_46c6_8465_6303a2ee681e.slice/crio-e05714a223680afefdf4a4d16aced91f53fd447ced37c8c78f7b652a01de29ed WatchSource:0}: Error finding container e05714a223680afefdf4a4d16aced91f53fd447ced37c8c78f7b652a01de29ed: Status 404 returned error can't find the container with id e05714a223680afefdf4a4d16aced91f53fd447ced37c8c78f7b652a01de29ed
Sep 10 17:17:05.675246 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:05.675232    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 17:17:06.394842 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:06.394806    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mdfjf" event={"ID":"730f6b80-a6bd-46c6-8465-6303a2ee681e","Type":"ContainerStarted","Data":"e05714a223680afefdf4a4d16aced91f53fd447ced37c8c78f7b652a01de29ed"}
Sep 10 17:17:08.405355 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:08.405319    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mdfjf" event={"ID":"730f6b80-a6bd-46c6-8465-6303a2ee681e","Type":"ContainerStarted","Data":"f0ad20732d1c568528743fab7899c2ff9e282d19dfc737d497bd833faffba5cb"}
Sep 10 17:17:08.428790 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:08.428737    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mdfjf" podStartSLOduration=0.791744441 podStartE2EDuration="3.428719195s" totalImagesPullingTime="2.636974754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:17:08.427510772 +0000 UTC m=+313.843561722" watchObservedRunningTime="2026-09-10 17:17:08.428719195 +0000 UTC m=+313.844770144"
Sep 10 17:17:11.838458 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:11.838425    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6z89w"]
Sep 10 17:17:11.840592 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:11.840570    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6z89w"
Sep 10 17:17:11.843035 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:11.843017    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-g559r\""
Sep 10 17:17:11.843567 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:11.843547    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 17:17:11.843761 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:11.843743    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 17:17:11.852673 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:11.852647    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6z89w"]
Sep 10 17:17:11.940141 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:11.940106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d257e8d-5cb7-4997-b9ac-19b31c0b7e97-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6z89w\" (UID: \"0d257e8d-5cb7-4997-b9ac-19b31c0b7e97\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6z89w"
Sep 10 17:17:11.940316 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:11.940154    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlh5p\" (UniqueName: \"kubernetes.io/projected/0d257e8d-5cb7-4997-b9ac-19b31c0b7e97-kube-api-access-mlh5p\") pod \"cert-manager-cainjector-559cdd8c87-6z89w\" (UID: \"0d257e8d-5cb7-4997-b9ac-19b31c0b7e97\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6z89w"
Sep 10 17:17:12.041018 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:12.040966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d257e8d-5cb7-4997-b9ac-19b31c0b7e97-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6z89w\" (UID: \"0d257e8d-5cb7-4997-b9ac-19b31c0b7e97\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6z89w"
Sep 10 17:17:12.041018 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:12.041023    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlh5p\" (UniqueName: \"kubernetes.io/projected/0d257e8d-5cb7-4997-b9ac-19b31c0b7e97-kube-api-access-mlh5p\") pod \"cert-manager-cainjector-559cdd8c87-6z89w\" (UID: \"0d257e8d-5cb7-4997-b9ac-19b31c0b7e97\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6z89w"
Sep 10 17:17:12.049209 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:12.049183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d257e8d-5cb7-4997-b9ac-19b31c0b7e97-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6z89w\" (UID: \"0d257e8d-5cb7-4997-b9ac-19b31c0b7e97\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6z89w"
Sep 10 17:17:12.049344 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:12.049314    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlh5p\" (UniqueName: \"kubernetes.io/projected/0d257e8d-5cb7-4997-b9ac-19b31c0b7e97-kube-api-access-mlh5p\") pod \"cert-manager-cainjector-559cdd8c87-6z89w\" (UID: \"0d257e8d-5cb7-4997-b9ac-19b31c0b7e97\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6z89w"
Sep 10 17:17:12.149312 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:12.149280    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6z89w"
Sep 10 17:17:12.418892 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:12.418691    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6z89w"]
Sep 10 17:17:12.421433 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:17:12.421409    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d257e8d_5cb7_4997_b9ac_19b31c0b7e97.slice/crio-b96c694fb40c33be66297f134d0bb860eb719603b145e8e2f1b857a7a247592d WatchSource:0}: Error finding container b96c694fb40c33be66297f134d0bb860eb719603b145e8e2f1b857a7a247592d: Status 404 returned error can't find the container with id b96c694fb40c33be66297f134d0bb860eb719603b145e8e2f1b857a7a247592d
Sep 10 17:17:13.424886 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:13.424851    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6z89w" event={"ID":"0d257e8d-5cb7-4997-b9ac-19b31c0b7e97","Type":"ContainerStarted","Data":"b96c694fb40c33be66297f134d0bb860eb719603b145e8e2f1b857a7a247592d"}
Sep 10 17:17:15.433937 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:15.433894    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6z89w" event={"ID":"0d257e8d-5cb7-4997-b9ac-19b31c0b7e97","Type":"ContainerStarted","Data":"a7944fec3ad1b8c355f2a9eff06ecc0d6dc569ecb9dc624122ecc917eb713dda"}
Sep 10 17:17:15.454244 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:15.454189    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6z89w" podStartSLOduration=2.085025023 podStartE2EDuration="4.454171422s" totalImagesPullingTime="2.369146399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:17:15.45308093 +0000 UTC m=+320.869131869" watchObservedRunningTime="2026-09-10 17:17:15.454171422 +0000 UTC m=+320.870222372"
Sep 10 17:17:23.023798 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:23.023763    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-98vw2"]
Sep 10 17:17:23.025845 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:23.025828    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-98vw2"
Sep 10 17:17:23.028878 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:23.028854    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 17:17:23.029009 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:23.028895    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-q29qt\""
Sep 10 17:17:23.029596 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:23.029576    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 17:17:23.040022 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:23.039995    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-98vw2"]
Sep 10 17:17:23.130295 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:23.130258    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a8b52d8-fdf9-45df-b6b4-6fea939b648b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-98vw2\" (UID: \"4a8b52d8-fdf9-45df-b6b4-6fea939b648b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-98vw2"
Sep 10 17:17:23.130478 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:23.130318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbm4m\" (UniqueName: \"kubernetes.io/projected/4a8b52d8-fdf9-45df-b6b4-6fea939b648b-kube-api-access-jbm4m\") pod \"openshift-lws-operator-fd8ccff4c-98vw2\" (UID: \"4a8b52d8-fdf9-45df-b6b4-6fea939b648b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-98vw2"
Sep 10 17:17:23.230847 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:23.230813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a8b52d8-fdf9-45df-b6b4-6fea939b648b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-98vw2\" (UID: \"4a8b52d8-fdf9-45df-b6b4-6fea939b648b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-98vw2"
Sep 10 17:17:23.230937 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:23.230860    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbm4m\" (UniqueName: \"kubernetes.io/projected/4a8b52d8-fdf9-45df-b6b4-6fea939b648b-kube-api-access-jbm4m\") pod \"openshift-lws-operator-fd8ccff4c-98vw2\" (UID: \"4a8b52d8-fdf9-45df-b6b4-6fea939b648b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-98vw2"
Sep 10 17:17:23.231233 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:23.231215    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a8b52d8-fdf9-45df-b6b4-6fea939b648b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-98vw2\" (UID: \"4a8b52d8-fdf9-45df-b6b4-6fea939b648b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-98vw2"
Sep 10 17:17:23.239870 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:23.239847    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbm4m\" (UniqueName: \"kubernetes.io/projected/4a8b52d8-fdf9-45df-b6b4-6fea939b648b-kube-api-access-jbm4m\") pod \"openshift-lws-operator-fd8ccff4c-98vw2\" (UID: \"4a8b52d8-fdf9-45df-b6b4-6fea939b648b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-98vw2"
Sep 10 17:17:23.335041 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:23.334949    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-98vw2"
Sep 10 17:17:23.607306 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:23.607222    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-98vw2"]
Sep 10 17:17:23.610288 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:17:23.610258    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a8b52d8_fdf9_45df_b6b4_6fea939b648b.slice/crio-c058f9b5403de945461b1e0c4c5cf16e4d56be4b3aa500333eb473c7f1df86dd WatchSource:0}: Error finding container c058f9b5403de945461b1e0c4c5cf16e4d56be4b3aa500333eb473c7f1df86dd: Status 404 returned error can't find the container with id c058f9b5403de945461b1e0c4c5cf16e4d56be4b3aa500333eb473c7f1df86dd
Sep 10 17:17:24.473945 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:24.473903    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-98vw2" event={"ID":"4a8b52d8-fdf9-45df-b6b4-6fea939b648b","Type":"ContainerStarted","Data":"c058f9b5403de945461b1e0c4c5cf16e4d56be4b3aa500333eb473c7f1df86dd"}
Sep 10 17:17:26.482383 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:26.482350    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-98vw2" event={"ID":"4a8b52d8-fdf9-45df-b6b4-6fea939b648b","Type":"ContainerStarted","Data":"401e60a902963c48fd4f8f3f1495cfe0e8d53d54080108349b93a68d32376c7b"}
Sep 10 17:17:26.501855 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:26.501779    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-98vw2" podStartSLOduration=1.17170366 podStartE2EDuration="3.501761572s" totalImagesPullingTime="2.330057912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:17:26.501472326 +0000 UTC m=+331.917523276" watchObservedRunningTime="2026-09-10 17:17:26.501761572 +0000 UTC m=+331.917812521"
Sep 10 17:17:42.062089 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.062038    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"]
Sep 10 17:17:42.107934 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.107901    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.122441 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.122414    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 17:17:42.123086 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.123040    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 17:17:42.123274 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.123175    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 17:17:42.123568 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.123519    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 17:17:42.150993 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.150962    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tv4fm\""
Sep 10 17:17:42.153612 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.153583    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"]
Sep 10 17:17:42.271312 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.271277    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94f2273d-3b11-4997-b736-b1b93902e61f-webhook-cert\") pod \"opendatahub-operator-controller-manager-86f7548996-lv77p\" (UID: \"94f2273d-3b11-4997-b736-b1b93902e61f\") " pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.271512 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.271321    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94f2273d-3b11-4997-b736-b1b93902e61f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86f7548996-lv77p\" (UID: \"94f2273d-3b11-4997-b736-b1b93902e61f\") " pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.271512 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.271403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94f2273d-3b11-4997-b736-b1b93902e61f-tmp\") pod \"opendatahub-operator-controller-manager-86f7548996-lv77p\" (UID: \"94f2273d-3b11-4997-b736-b1b93902e61f\") " pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.271512 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.271463    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94f2273d-3b11-4997-b736-b1b93902e61f-manifests\") pod \"opendatahub-operator-controller-manager-86f7548996-lv77p\" (UID: \"94f2273d-3b11-4997-b736-b1b93902e61f\") " pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.271512 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.271507    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qt9k\" (UniqueName: \"kubernetes.io/projected/94f2273d-3b11-4997-b736-b1b93902e61f-kube-api-access-5qt9k\") pod \"opendatahub-operator-controller-manager-86f7548996-lv77p\" (UID: \"94f2273d-3b11-4997-b736-b1b93902e61f\") " pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.372588 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.372541    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94f2273d-3b11-4997-b736-b1b93902e61f-webhook-cert\") pod \"opendatahub-operator-controller-manager-86f7548996-lv77p\" (UID: \"94f2273d-3b11-4997-b736-b1b93902e61f\") " pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.373354 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.373327    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94f2273d-3b11-4997-b736-b1b93902e61f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86f7548996-lv77p\" (UID: \"94f2273d-3b11-4997-b736-b1b93902e61f\") " pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.373578 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.373563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94f2273d-3b11-4997-b736-b1b93902e61f-tmp\") pod \"opendatahub-operator-controller-manager-86f7548996-lv77p\" (UID: \"94f2273d-3b11-4997-b736-b1b93902e61f\") " pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.373691 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.373678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94f2273d-3b11-4997-b736-b1b93902e61f-manifests\") pod \"opendatahub-operator-controller-manager-86f7548996-lv77p\" (UID: \"94f2273d-3b11-4997-b736-b1b93902e61f\") " pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.373793 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.373780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qt9k\" (UniqueName: \"kubernetes.io/projected/94f2273d-3b11-4997-b736-b1b93902e61f-kube-api-access-5qt9k\") pod \"opendatahub-operator-controller-manager-86f7548996-lv77p\" (UID: \"94f2273d-3b11-4997-b736-b1b93902e61f\") " pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.374282 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.374258    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94f2273d-3b11-4997-b736-b1b93902e61f-manifests\") pod \"opendatahub-operator-controller-manager-86f7548996-lv77p\" (UID: \"94f2273d-3b11-4997-b736-b1b93902e61f\") " pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.377176 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.377144    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94f2273d-3b11-4997-b736-b1b93902e61f-webhook-cert\") pod \"opendatahub-operator-controller-manager-86f7548996-lv77p\" (UID: \"94f2273d-3b11-4997-b736-b1b93902e61f\") " pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.377639 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.377618    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94f2273d-3b11-4997-b736-b1b93902e61f-tmp\") pod \"opendatahub-operator-controller-manager-86f7548996-lv77p\" (UID: \"94f2273d-3b11-4997-b736-b1b93902e61f\") " pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.377980 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.377959    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94f2273d-3b11-4997-b736-b1b93902e61f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86f7548996-lv77p\" (UID: \"94f2273d-3b11-4997-b736-b1b93902e61f\") " pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.398355 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.398331    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qt9k\" (UniqueName: \"kubernetes.io/projected/94f2273d-3b11-4997-b736-b1b93902e61f-kube-api-access-5qt9k\") pod \"opendatahub-operator-controller-manager-86f7548996-lv77p\" (UID: \"94f2273d-3b11-4997-b736-b1b93902e61f\") " pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.418097 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.418034    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:42.723929 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:42.723739    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"]
Sep 10 17:17:42.728126 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:17:42.728100    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f2273d_3b11_4997_b736_b1b93902e61f.slice/crio-2c82bac2c0917ec21ef0056a799ccdaabece23cff2372a50d028d459ca88ec42 WatchSource:0}: Error finding container 2c82bac2c0917ec21ef0056a799ccdaabece23cff2372a50d028d459ca88ec42: Status 404 returned error can't find the container with id 2c82bac2c0917ec21ef0056a799ccdaabece23cff2372a50d028d459ca88ec42
Sep 10 17:17:43.549952 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:43.549911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p" event={"ID":"94f2273d-3b11-4997-b736-b1b93902e61f","Type":"ContainerStarted","Data":"2c82bac2c0917ec21ef0056a799ccdaabece23cff2372a50d028d459ca88ec42"}
Sep 10 17:17:46.564137 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:46.564094    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p" event={"ID":"94f2273d-3b11-4997-b736-b1b93902e61f","Type":"ContainerStarted","Data":"1212d4cf2fff29f9fc773d5e0c049975f270023ae316486ebad63bab8f6e05c0"}
Sep 10 17:17:47.569146 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:47.569111    2576 generic.go:356] "Generic (PLEG): container finished" podID="94f2273d-3b11-4997-b736-b1b93902e61f" containerID="1212d4cf2fff29f9fc773d5e0c049975f270023ae316486ebad63bab8f6e05c0" exitCode=0
Sep 10 17:17:47.569555 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:47.569196    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p" event={"ID":"94f2273d-3b11-4997-b736-b1b93902e61f","Type":"ContainerDied","Data":"1212d4cf2fff29f9fc773d5e0c049975f270023ae316486ebad63bab8f6e05c0"}
Sep 10 17:17:48.577230 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:48.577193    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p" event={"ID":"94f2273d-3b11-4997-b736-b1b93902e61f","Type":"ContainerStarted","Data":"285e7c8971699c0b6d946fb8dabfc91aaa748de0488d7614065888e29bef4156"}
Sep 10 17:17:48.577600 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:48.577347    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:17:48.607654 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:48.607599    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p" podStartSLOduration=2.19021667 podStartE2EDuration="6.60757671s" totalImagesPullingTime="3.392324709s" totalInitContainerRuntime="1.025035331s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:17:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:17:48.606215113 +0000 UTC m=+354.022266075" watchObservedRunningTime="2026-09-10 17:17:48.60757671 +0000 UTC m=+354.023627659"
Sep 10 17:17:59.583862 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:17:59.583830    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86f7548996-lv77p"
Sep 10 17:18:01.678170 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:01.678132    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-647997b56d-cbb57"]
Sep 10 17:18:01.686293 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:01.686273    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-647997b56d-cbb57"
Sep 10 17:18:01.692429 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:01.692274    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 17:18:01.692429 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:01.692284    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 17:18:01.692429 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:01.692326    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 17:18:01.693755 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:01.693738    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 17:18:01.718887 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:01.718856    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-647997b56d-cbb57"]
Sep 10 17:18:01.723457 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:01.723429    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c279008-c8c3-4434-bd3f-d680fd9722f1-tls-certs\") pod \"kube-auth-proxy-647997b56d-cbb57\" (UID: \"2c279008-c8c3-4434-bd3f-d680fd9722f1\") " pod="openshift-ingress/kube-auth-proxy-647997b56d-cbb57"
Sep 10 17:18:01.723635 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:01.723540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnqr2\" (UniqueName: \"kubernetes.io/projected/2c279008-c8c3-4434-bd3f-d680fd9722f1-kube-api-access-wnqr2\") pod \"kube-auth-proxy-647997b56d-cbb57\" (UID: \"2c279008-c8c3-4434-bd3f-d680fd9722f1\") " pod="openshift-ingress/kube-auth-proxy-647997b56d-cbb57"
Sep 10 17:18:01.723635 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:01.723569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c279008-c8c3-4434-bd3f-d680fd9722f1-tmp\") pod \"kube-auth-proxy-647997b56d-cbb57\" (UID: \"2c279008-c8c3-4434-bd3f-d680fd9722f1\") " pod="openshift-ingress/kube-auth-proxy-647997b56d-cbb57"
Sep 10 17:18:01.824867 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:01.824827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnqr2\" (UniqueName: \"kubernetes.io/projected/2c279008-c8c3-4434-bd3f-d680fd9722f1-kube-api-access-wnqr2\") pod \"kube-auth-proxy-647997b56d-cbb57\" (UID: \"2c279008-c8c3-4434-bd3f-d680fd9722f1\") " pod="openshift-ingress/kube-auth-proxy-647997b56d-cbb57"
Sep 10 17:18:01.824867 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:01.824869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c279008-c8c3-4434-bd3f-d680fd9722f1-tmp\") pod \"kube-auth-proxy-647997b56d-cbb57\" (UID: \"2c279008-c8c3-4434-bd3f-d680fd9722f1\") " pod="openshift-ingress/kube-auth-proxy-647997b56d-cbb57"
Sep 10 17:18:01.825125 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:01.824890    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c279008-c8c3-4434-bd3f-d680fd9722f1-tls-certs\") pod \"kube-auth-proxy-647997b56d-cbb57\" (UID: \"2c279008-c8c3-4434-bd3f-d680fd9722f1\") " pod="openshift-ingress/kube-auth-proxy-647997b56d-cbb57"
Sep 10 17:18:01.825125 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:18:01.825085    2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 10 17:18:01.825210 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:18:01.825196    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c279008-c8c3-4434-bd3f-d680fd9722f1-tls-certs podName:2c279008-c8c3-4434-bd3f-d680fd9722f1 nodeName:}" failed. No retries permitted until 2026-09-10 17:18:02.325175084 +0000 UTC m=+367.741226026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2c279008-c8c3-4434-bd3f-d680fd9722f1-tls-certs") pod "kube-auth-proxy-647997b56d-cbb57" (UID: "2c279008-c8c3-4434-bd3f-d680fd9722f1") : secret "kube-auth-proxy-tls" not found
Sep 10 17:18:01.827189 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:01.827170    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c279008-c8c3-4434-bd3f-d680fd9722f1-tmp\") pod \"kube-auth-proxy-647997b56d-cbb57\" (UID: \"2c279008-c8c3-4434-bd3f-d680fd9722f1\") " pod="openshift-ingress/kube-auth-proxy-647997b56d-cbb57"
Sep 10 17:18:01.840803 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:01.840772    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnqr2\" (UniqueName: \"kubernetes.io/projected/2c279008-c8c3-4434-bd3f-d680fd9722f1-kube-api-access-wnqr2\") pod \"kube-auth-proxy-647997b56d-cbb57\" (UID: \"2c279008-c8c3-4434-bd3f-d680fd9722f1\") " pod="openshift-ingress/kube-auth-proxy-647997b56d-cbb57"
Sep 10 17:18:02.329972 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:02.329925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c279008-c8c3-4434-bd3f-d680fd9722f1-tls-certs\") pod \"kube-auth-proxy-647997b56d-cbb57\" (UID: \"2c279008-c8c3-4434-bd3f-d680fd9722f1\") " pod="openshift-ingress/kube-auth-proxy-647997b56d-cbb57"
Sep 10 17:18:02.332370 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:02.332339    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c279008-c8c3-4434-bd3f-d680fd9722f1-tls-certs\") pod \"kube-auth-proxy-647997b56d-cbb57\" (UID: \"2c279008-c8c3-4434-bd3f-d680fd9722f1\") " pod="openshift-ingress/kube-auth-proxy-647997b56d-cbb57"
Sep 10 17:18:02.595653 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:02.595564    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-647997b56d-cbb57"
Sep 10 17:18:02.883813 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:02.883776    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-647997b56d-cbb57"]
Sep 10 17:18:02.887720 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:18:02.887694    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c279008_c8c3_4434_bd3f_d680fd9722f1.slice/crio-8d1b6e01dc70e1ee0a8b2887942a21f28c1c42e14ea07d02ddac3ead11931b4e WatchSource:0}: Error finding container 8d1b6e01dc70e1ee0a8b2887942a21f28c1c42e14ea07d02ddac3ead11931b4e: Status 404 returned error can't find the container with id 8d1b6e01dc70e1ee0a8b2887942a21f28c1c42e14ea07d02ddac3ead11931b4e
Sep 10 17:18:03.581309 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.581275    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"]
Sep 10 17:18:03.584527 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.584505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.587277 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.587252    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 17:18:03.587277 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.587266    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 17:18:03.587610 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.587595    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 17:18:03.587690 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.587674    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 17:18:03.587771 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.587755    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-m8vgq\""
Sep 10 17:18:03.600950 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.600925    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"]
Sep 10 17:18:03.641941 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.641905    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-647997b56d-cbb57" event={"ID":"2c279008-c8c3-4434-bd3f-d680fd9722f1","Type":"ContainerStarted","Data":"8d1b6e01dc70e1ee0a8b2887942a21f28c1c42e14ea07d02ddac3ead11931b4e"}
Sep 10 17:18:03.644607 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.644568    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.644754 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.644610    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.644754 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.644697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nctv9\" (UniqueName: \"kubernetes.io/projected/47c8ca83-2798-454a-b90d-3086e970752e-kube-api-access-nctv9\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.644754 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.644743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.644910 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.644774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/47c8ca83-2798-454a-b90d-3086e970752e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.644910 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.644831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47c8ca83-2798-454a-b90d-3086e970752e-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.644910 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.644854    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/47c8ca83-2798-454a-b90d-3086e970752e-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.745758 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.745718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.745944 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.745769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/47c8ca83-2798-454a-b90d-3086e970752e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.745944 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.745793    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47c8ca83-2798-454a-b90d-3086e970752e-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.745944 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.745825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/47c8ca83-2798-454a-b90d-3086e970752e-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.745944 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.745864    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.745944 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.745888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.746250 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.745945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nctv9\" (UniqueName: \"kubernetes.io/projected/47c8ca83-2798-454a-b90d-3086e970752e-kube-api-access-nctv9\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.746867 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.746806    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/47c8ca83-2798-454a-b90d-3086e970752e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.748726 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.748698    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.748885 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.748853    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/47c8ca83-2798-454a-b90d-3086e970752e-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.748993 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.748962    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.749527 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.749504    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.757643 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.757617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47c8ca83-2798-454a-b90d-3086e970752e-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.798227 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.798194    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nctv9\" (UniqueName: \"kubernetes.io/projected/47c8ca83-2798-454a-b90d-3086e970752e-kube-api-access-nctv9\") pod \"istiod-openshift-gateway-7b7995d5cd-s879k\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:03.895278 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:03.895238    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:04.186000 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:04.185918    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"]
Sep 10 17:18:04.189245 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:18:04.189215    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c8ca83_2798_454a_b90d_3086e970752e.slice/crio-4577d401d5d6bdf02713466bcfadeb7430551be205a8d8d411667ce45c026965 WatchSource:0}: Error finding container 4577d401d5d6bdf02713466bcfadeb7430551be205a8d8d411667ce45c026965: Status 404 returned error can't find the container with id 4577d401d5d6bdf02713466bcfadeb7430551be205a8d8d411667ce45c026965
Sep 10 17:18:04.648902 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:04.648816    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k" event={"ID":"47c8ca83-2798-454a-b90d-3086e970752e","Type":"ContainerStarted","Data":"4577d401d5d6bdf02713466bcfadeb7430551be205a8d8d411667ce45c026965"}
Sep 10 17:18:06.660938 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:06.660901    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-647997b56d-cbb57" event={"ID":"2c279008-c8c3-4434-bd3f-d680fd9722f1","Type":"ContainerStarted","Data":"6ee9aa8b9fce9d5fbd7684700a64d160ef433ff13362aa42ef1233f488980505"}
Sep 10 17:18:06.679885 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:06.679824    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-647997b56d-cbb57" podStartSLOduration=2.696091371 podStartE2EDuration="5.679803119s" totalImagesPullingTime="2.983711748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:18:06.678000818 +0000 UTC m=+372.094051782" watchObservedRunningTime="2026-09-10 17:18:06.679803119 +0000 UTC m=+372.095854070"
Sep 10 17:18:07.640401 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:07.640360    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:18:07.640475 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:07.640436    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:18:08.670225 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:08.670187    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k" event={"ID":"47c8ca83-2798-454a-b90d-3086e970752e","Type":"ContainerStarted","Data":"ac3d8333ec235c4c01286b3b01aafd5df0ab233401471d7318de499e410ee6de"}
Sep 10 17:18:08.670696 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:08.670382    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:08.672224 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:08.672198    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-s879k container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 17:18:08.672337 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:08.672243    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k" podUID="47c8ca83-2798-454a-b90d-3086e970752e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 17:18:08.690510 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:08.690459    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k" podStartSLOduration=2.242241277 podStartE2EDuration="5.690443121s" totalImagesPullingTime="3.448201844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:18:08.688344991 +0000 UTC m=+374.104395939" watchObservedRunningTime="2026-09-10 17:18:08.690443121 +0000 UTC m=+374.106494070"
Sep 10 17:18:09.675547 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:09.675515    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:19.646599 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.644766    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"]
Sep 10 17:18:19.648094 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.648041    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.690384 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.690349    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"]
Sep 10 17:18:19.784437 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.784398    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13eaade1-fdd4-41a3-a56d-091c217bfc95-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.784437 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.784441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nmh8\" (UniqueName: \"kubernetes.io/projected/13eaade1-fdd4-41a3-a56d-091c217bfc95-kube-api-access-7nmh8\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.784646 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.784484    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/13eaade1-fdd4-41a3-a56d-091c217bfc95-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.784646 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.784511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/13eaade1-fdd4-41a3-a56d-091c217bfc95-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.784646 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.784527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/13eaade1-fdd4-41a3-a56d-091c217bfc95-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.784646 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.784593    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13eaade1-fdd4-41a3-a56d-091c217bfc95-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.784646 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.784638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/13eaade1-fdd4-41a3-a56d-091c217bfc95-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.885990 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.885956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13eaade1-fdd4-41a3-a56d-091c217bfc95-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.886195 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.886000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/13eaade1-fdd4-41a3-a56d-091c217bfc95-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.886195 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.886034    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13eaade1-fdd4-41a3-a56d-091c217bfc95-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.886195 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.886079    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nmh8\" (UniqueName: \"kubernetes.io/projected/13eaade1-fdd4-41a3-a56d-091c217bfc95-kube-api-access-7nmh8\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.886360 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.886197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/13eaade1-fdd4-41a3-a56d-091c217bfc95-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.886360 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.886249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/13eaade1-fdd4-41a3-a56d-091c217bfc95-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.886360 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.886274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/13eaade1-fdd4-41a3-a56d-091c217bfc95-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.886912 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.886863    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/13eaade1-fdd4-41a3-a56d-091c217bfc95-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.889039 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.888989    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/13eaade1-fdd4-41a3-a56d-091c217bfc95-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.889195 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.889046    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13eaade1-fdd4-41a3-a56d-091c217bfc95-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.889276 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.889247    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/13eaade1-fdd4-41a3-a56d-091c217bfc95-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.889333 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.889309    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/13eaade1-fdd4-41a3-a56d-091c217bfc95-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.894516 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.894492    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nmh8\" (UniqueName: \"kubernetes.io/projected/13eaade1-fdd4-41a3-a56d-091c217bfc95-kube-api-access-7nmh8\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.894924 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.894906    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13eaade1-fdd4-41a3-a56d-091c217bfc95-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-jbmd9\" (UID: \"13eaade1-fdd4-41a3-a56d-091c217bfc95\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:19.957285 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:19.957186    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:20.249397 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:20.249308    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"]
Sep 10 17:18:20.251856 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:18:20.251825    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13eaade1_fdd4_41a3_a56d_091c217bfc95.slice/crio-11a3bca64c0b26a4211b25599302eb5ef351185663e8f77c52f944da2e1b6ef0 WatchSource:0}: Error finding container 11a3bca64c0b26a4211b25599302eb5ef351185663e8f77c52f944da2e1b6ef0: Status 404 returned error can't find the container with id 11a3bca64c0b26a4211b25599302eb5ef351185663e8f77c52f944da2e1b6ef0
Sep 10 17:18:20.254883 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:20.254854    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:18:20.254961 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:20.254913    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:18:20.719078 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:20.719031    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9" event={"ID":"13eaade1-fdd4-41a3-a56d-091c217bfc95","Type":"ContainerStarted","Data":"9afd8d4731dd673ed8401825fa28b31c17aeaf1e77b0607cec0d0e9558a18970"}
Sep 10 17:18:20.719497 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:20.719098    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9" event={"ID":"13eaade1-fdd4-41a3-a56d-091c217bfc95","Type":"ContainerStarted","Data":"11a3bca64c0b26a4211b25599302eb5ef351185663e8f77c52f944da2e1b6ef0"}
Sep 10 17:18:20.719497 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:20.719148    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:20.779621 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:20.779561    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9" podStartSLOduration=1.779539357 podStartE2EDuration="1.779539357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:18:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:18:20.779434622 +0000 UTC m=+386.195485572" watchObservedRunningTime="2026-09-10 17:18:20.779539357 +0000 UTC m=+386.195590298"
Sep 10 17:18:21.725185 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:21.725153    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jbmd9"
Sep 10 17:18:21.915805 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:21.915772    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"]
Sep 10 17:18:21.915991 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:21.915970    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k" podUID="47c8ca83-2798-454a-b90d-3086e970752e" containerName="discovery" containerID="cri-o://ac3d8333ec235c4c01286b3b01aafd5df0ab233401471d7318de499e410ee6de" gracePeriod=30
Sep 10 17:18:22.155024 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.154998    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:22.305701 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.305619    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nctv9\" (UniqueName: \"kubernetes.io/projected/47c8ca83-2798-454a-b90d-3086e970752e-kube-api-access-nctv9\") pod \"47c8ca83-2798-454a-b90d-3086e970752e\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") "
Sep 10 17:18:22.305701 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.305656    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-cacerts\") pod \"47c8ca83-2798-454a-b90d-3086e970752e\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") "
Sep 10 17:18:22.305701 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.305682    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47c8ca83-2798-454a-b90d-3086e970752e-istio-token\") pod \"47c8ca83-2798-454a-b90d-3086e970752e\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") "
Sep 10 17:18:22.305965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.305704    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-istio-csr-dns-cert\") pod \"47c8ca83-2798-454a-b90d-3086e970752e\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") "
Sep 10 17:18:22.305965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.305725    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-istio-kubeconfig\") pod \"47c8ca83-2798-454a-b90d-3086e970752e\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") "
Sep 10 17:18:22.305965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.305742    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/47c8ca83-2798-454a-b90d-3086e970752e-local-certs\") pod \"47c8ca83-2798-454a-b90d-3086e970752e\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") "
Sep 10 17:18:22.305965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.305819    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/47c8ca83-2798-454a-b90d-3086e970752e-istio-csr-ca-configmap\") pod \"47c8ca83-2798-454a-b90d-3086e970752e\" (UID: \"47c8ca83-2798-454a-b90d-3086e970752e\") "
Sep 10 17:18:22.306338 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.306305    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47c8ca83-2798-454a-b90d-3086e970752e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "47c8ca83-2798-454a-b90d-3086e970752e" (UID: "47c8ca83-2798-454a-b90d-3086e970752e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:18:22.308684 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.308643    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "47c8ca83-2798-454a-b90d-3086e970752e" (UID: "47c8ca83-2798-454a-b90d-3086e970752e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:18:22.308795 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.308687    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47c8ca83-2798-454a-b90d-3086e970752e-kube-api-access-nctv9" (OuterVolumeSpecName: "kube-api-access-nctv9") pod "47c8ca83-2798-454a-b90d-3086e970752e" (UID: "47c8ca83-2798-454a-b90d-3086e970752e"). InnerVolumeSpecName "kube-api-access-nctv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:18:22.309001 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.308964    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47c8ca83-2798-454a-b90d-3086e970752e-local-certs" (OuterVolumeSpecName: "local-certs") pod "47c8ca83-2798-454a-b90d-3086e970752e" (UID: "47c8ca83-2798-454a-b90d-3086e970752e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:18:22.309001 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.308972    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "47c8ca83-2798-454a-b90d-3086e970752e" (UID: "47c8ca83-2798-454a-b90d-3086e970752e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:18:22.309168 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.309014    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47c8ca83-2798-454a-b90d-3086e970752e-istio-token" (OuterVolumeSpecName: "istio-token") pod "47c8ca83-2798-454a-b90d-3086e970752e" (UID: "47c8ca83-2798-454a-b90d-3086e970752e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:18:22.309247 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.309225    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-cacerts" (OuterVolumeSpecName: "cacerts") pod "47c8ca83-2798-454a-b90d-3086e970752e" (UID: "47c8ca83-2798-454a-b90d-3086e970752e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:18:22.384461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.384430    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj"]
Sep 10 17:18:22.384734 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.384721    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47c8ca83-2798-454a-b90d-3086e970752e" containerName="discovery"
Sep 10 17:18:22.384776 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.384736    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="47c8ca83-2798-454a-b90d-3086e970752e" containerName="discovery"
Sep 10 17:18:22.384812 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.384788    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="47c8ca83-2798-454a-b90d-3086e970752e" containerName="discovery"
Sep 10 17:18:22.386791 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.386775    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj"
Sep 10 17:18:22.389301 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.389279    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 10 17:18:22.389440 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.389285    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cltvg\""
Sep 10 17:18:22.403611 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.403581    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj"]
Sep 10 17:18:22.406936 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.406909    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/47c8ca83-2798-454a-b90d-3086e970752e-istio-csr-ca-configmap\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:18:22.406936 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.406931    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nctv9\" (UniqueName: \"kubernetes.io/projected/47c8ca83-2798-454a-b90d-3086e970752e-kube-api-access-nctv9\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:18:22.406936 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.406942    2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-cacerts\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:18:22.407162 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.406951    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47c8ca83-2798-454a-b90d-3086e970752e-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:18:22.407162 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.406960    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-istio-csr-dns-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:18:22.407162 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.406967    2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/47c8ca83-2798-454a-b90d-3086e970752e-istio-kubeconfig\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:18:22.407162 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.406977    2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/47c8ca83-2798-454a-b90d-3086e970752e-local-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:18:22.508348 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.508305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edc43364-447c-4d74-999d-3e970c9f7db9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lmsnj\" (UID: \"edc43364-447c-4d74-999d-3e970c9f7db9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj"
Sep 10 17:18:22.508348 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.508348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7khb\" (UniqueName: \"kubernetes.io/projected/edc43364-447c-4d74-999d-3e970c9f7db9-kube-api-access-l7khb\") pod \"llmisvc-controller-manager-777c6bd7d5-lmsnj\" (UID: \"edc43364-447c-4d74-999d-3e970c9f7db9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj"
Sep 10 17:18:22.609422 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.609329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edc43364-447c-4d74-999d-3e970c9f7db9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lmsnj\" (UID: \"edc43364-447c-4d74-999d-3e970c9f7db9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj"
Sep 10 17:18:22.609422 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.609368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7khb\" (UniqueName: \"kubernetes.io/projected/edc43364-447c-4d74-999d-3e970c9f7db9-kube-api-access-l7khb\") pod \"llmisvc-controller-manager-777c6bd7d5-lmsnj\" (UID: \"edc43364-447c-4d74-999d-3e970c9f7db9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj"
Sep 10 17:18:22.609651 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:18:22.609503    2576 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 10 17:18:22.609651 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:18:22.609579    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc43364-447c-4d74-999d-3e970c9f7db9-cert podName:edc43364-447c-4d74-999d-3e970c9f7db9 nodeName:}" failed. No retries permitted until 2026-09-10 17:18:23.109556903 +0000 UTC m=+388.525607857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/edc43364-447c-4d74-999d-3e970c9f7db9-cert") pod "llmisvc-controller-manager-777c6bd7d5-lmsnj" (UID: "edc43364-447c-4d74-999d-3e970c9f7db9") : secret "llmisvc-webhook-server-cert" not found
Sep 10 17:18:22.622478 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.622444    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7khb\" (UniqueName: \"kubernetes.io/projected/edc43364-447c-4d74-999d-3e970c9f7db9-kube-api-access-l7khb\") pod \"llmisvc-controller-manager-777c6bd7d5-lmsnj\" (UID: \"edc43364-447c-4d74-999d-3e970c9f7db9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj"
Sep 10 17:18:22.729275 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.729238    2576 generic.go:356] "Generic (PLEG): container finished" podID="47c8ca83-2798-454a-b90d-3086e970752e" containerID="ac3d8333ec235c4c01286b3b01aafd5df0ab233401471d7318de499e410ee6de" exitCode=0
Sep 10 17:18:22.729681 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.729287    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"
Sep 10 17:18:22.729681 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.729299    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k" event={"ID":"47c8ca83-2798-454a-b90d-3086e970752e","Type":"ContainerDied","Data":"ac3d8333ec235c4c01286b3b01aafd5df0ab233401471d7318de499e410ee6de"}
Sep 10 17:18:22.729681 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.729357    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k" event={"ID":"47c8ca83-2798-454a-b90d-3086e970752e","Type":"ContainerDied","Data":"4577d401d5d6bdf02713466bcfadeb7430551be205a8d8d411667ce45c026965"}
Sep 10 17:18:22.729681 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.729379    2576 scope.go:117] "RemoveContainer" containerID="ac3d8333ec235c4c01286b3b01aafd5df0ab233401471d7318de499e410ee6de"
Sep 10 17:18:22.744087 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.740822    2576 scope.go:117] "RemoveContainer" containerID="ac3d8333ec235c4c01286b3b01aafd5df0ab233401471d7318de499e410ee6de"
Sep 10 17:18:22.747609 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:18:22.747575    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac3d8333ec235c4c01286b3b01aafd5df0ab233401471d7318de499e410ee6de\": container with ID starting with ac3d8333ec235c4c01286b3b01aafd5df0ab233401471d7318de499e410ee6de not found: ID does not exist" containerID="ac3d8333ec235c4c01286b3b01aafd5df0ab233401471d7318de499e410ee6de"
Sep 10 17:18:22.747730 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.747614    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac3d8333ec235c4c01286b3b01aafd5df0ab233401471d7318de499e410ee6de"} err="failed to get container status \"ac3d8333ec235c4c01286b3b01aafd5df0ab233401471d7318de499e410ee6de\": rpc error: code = NotFound desc = could not find container \"ac3d8333ec235c4c01286b3b01aafd5df0ab233401471d7318de499e410ee6de\": container with ID starting with ac3d8333ec235c4c01286b3b01aafd5df0ab233401471d7318de499e410ee6de not found: ID does not exist"
Sep 10 17:18:22.779834 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.779798    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"]
Sep 10 17:18:22.793019 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:22.792992    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-s879k"]
Sep 10 17:18:23.084483 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:23.084448    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47c8ca83-2798-454a-b90d-3086e970752e" path="/var/lib/kubelet/pods/47c8ca83-2798-454a-b90d-3086e970752e/volumes"
Sep 10 17:18:23.114356 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:23.114320    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edc43364-447c-4d74-999d-3e970c9f7db9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lmsnj\" (UID: \"edc43364-447c-4d74-999d-3e970c9f7db9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj"
Sep 10 17:18:23.116702 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:23.116684    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edc43364-447c-4d74-999d-3e970c9f7db9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lmsnj\" (UID: \"edc43364-447c-4d74-999d-3e970c9f7db9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj"
Sep 10 17:18:23.295951 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:23.295911    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj"
Sep 10 17:18:23.592443 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:23.592264    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj"]
Sep 10 17:18:23.595075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:18:23.595006    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podedc43364_447c_4d74_999d_3e970c9f7db9.slice/crio-3758e58c3909723359e072162a6dd82cc9e6699085cb9657b1e090e99e13a0ea WatchSource:0}: Error finding container 3758e58c3909723359e072162a6dd82cc9e6699085cb9657b1e090e99e13a0ea: Status 404 returned error can't find the container with id 3758e58c3909723359e072162a6dd82cc9e6699085cb9657b1e090e99e13a0ea
Sep 10 17:18:23.736666 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:23.736623    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj" event={"ID":"edc43364-447c-4d74-999d-3e970c9f7db9","Type":"ContainerStarted","Data":"3758e58c3909723359e072162a6dd82cc9e6699085cb9657b1e090e99e13a0ea"}
Sep 10 17:18:27.757347 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:27.757305    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj" event={"ID":"edc43364-447c-4d74-999d-3e970c9f7db9","Type":"ContainerStarted","Data":"55147e0d3d2d37c6565c683f7249c8dbf7a06a728cb152af8fc09be2a33b5b9a"}
Sep 10 17:18:27.757780 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:27.757470    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj"
Sep 10 17:18:27.774147 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:27.774092    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj" podStartSLOduration=2.6525236359999997 podStartE2EDuration="5.774075267s" totalImagesPullingTime="3.121551631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:18:27.77319244 +0000 UTC m=+393.189243389" watchObservedRunningTime="2026-09-10 17:18:27.774075267 +0000 UTC m=+393.190126217"
Sep 10 17:18:58.764379 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:18:58.764346    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lmsnj"
Sep 10 17:19:30.544717 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:30.544643    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"]
Sep 10 17:19:30.547139 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:30.547122    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"
Sep 10 17:19:30.549807 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:30.549788    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 17:19:30.550444 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:30.550431    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tq76h\""
Sep 10 17:19:30.550492 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:30.550456    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 17:19:30.561430 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:30.561401    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"]
Sep 10 17:19:30.649948 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:30.649914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc7g4\" (UniqueName: \"kubernetes.io/projected/c3375cb8-3885-46f9-9604-10af86d96237-kube-api-access-vc7g4\") pod \"limitador-operator-controller-manager-74495c69f8-dj4nj\" (UID: \"c3375cb8-3885-46f9-9604-10af86d96237\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"
Sep 10 17:19:30.750666 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:30.750630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc7g4\" (UniqueName: \"kubernetes.io/projected/c3375cb8-3885-46f9-9604-10af86d96237-kube-api-access-vc7g4\") pod \"limitador-operator-controller-manager-74495c69f8-dj4nj\" (UID: \"c3375cb8-3885-46f9-9604-10af86d96237\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"
Sep 10 17:19:30.772447 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:30.772415    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc7g4\" (UniqueName: \"kubernetes.io/projected/c3375cb8-3885-46f9-9604-10af86d96237-kube-api-access-vc7g4\") pod \"limitador-operator-controller-manager-74495c69f8-dj4nj\" (UID: \"c3375cb8-3885-46f9-9604-10af86d96237\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"
Sep 10 17:19:30.857154 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:30.857046    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"
Sep 10 17:19:31.136872 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:31.136846    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"]
Sep 10 17:19:31.138913 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:19:31.138884    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3375cb8_3885_46f9_9604_10af86d96237.slice/crio-b411ac7741f9389d927bf814820d1d0281f1a456b8cc83b36cf9fee4dbd21d0b WatchSource:0}: Error finding container b411ac7741f9389d927bf814820d1d0281f1a456b8cc83b36cf9fee4dbd21d0b: Status 404 returned error can't find the container with id b411ac7741f9389d927bf814820d1d0281f1a456b8cc83b36cf9fee4dbd21d0b
Sep 10 17:19:32.014258 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:32.014211    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj" event={"ID":"c3375cb8-3885-46f9-9604-10af86d96237","Type":"ContainerStarted","Data":"b411ac7741f9389d927bf814820d1d0281f1a456b8cc83b36cf9fee4dbd21d0b"}
Sep 10 17:19:35.029248 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:35.029211    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj" event={"ID":"c3375cb8-3885-46f9-9604-10af86d96237","Type":"ContainerStarted","Data":"c8543f9dd4b14acf8bfadbb780b9c0f75030797864a5d321359c29f880dac95d"}
Sep 10 17:19:35.029644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:35.029436    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"
Sep 10 17:19:35.062927 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:35.062873    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj" podStartSLOduration=1.889076136 podStartE2EDuration="5.062856477s" totalImagesPullingTime="3.173780341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:19:35.062404806 +0000 UTC m=+460.478455756" watchObservedRunningTime="2026-09-10 17:19:35.062856477 +0000 UTC m=+460.478907425"
Sep 10 17:19:37.255638 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:37.255609    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ltf7w"]
Sep 10 17:19:37.257789 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:37.257769    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ltf7w"
Sep 10 17:19:37.261321 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:37.261299    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 17:19:37.261321 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:37.261311    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-f28tm\""
Sep 10 17:19:37.282164 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:37.282134    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ltf7w"]
Sep 10 17:19:37.406274 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:37.406241    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29h9k\" (UniqueName: \"kubernetes.io/projected/c83e8cce-267b-475d-8295-19d87e6d4df0-kube-api-access-29h9k\") pod \"dns-operator-controller-manager-7b84cd7c9c-ltf7w\" (UID: \"c83e8cce-267b-475d-8295-19d87e6d4df0\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ltf7w"
Sep 10 17:19:37.507084 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:37.506986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29h9k\" (UniqueName: \"kubernetes.io/projected/c83e8cce-267b-475d-8295-19d87e6d4df0-kube-api-access-29h9k\") pod \"dns-operator-controller-manager-7b84cd7c9c-ltf7w\" (UID: \"c83e8cce-267b-475d-8295-19d87e6d4df0\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ltf7w"
Sep 10 17:19:37.527886 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:37.527846    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29h9k\" (UniqueName: \"kubernetes.io/projected/c83e8cce-267b-475d-8295-19d87e6d4df0-kube-api-access-29h9k\") pod \"dns-operator-controller-manager-7b84cd7c9c-ltf7w\" (UID: \"c83e8cce-267b-475d-8295-19d87e6d4df0\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ltf7w"
Sep 10 17:19:37.571220 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:37.571183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ltf7w"
Sep 10 17:19:37.853330 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:37.853239    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ltf7w"]
Sep 10 17:19:37.857231 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:19:37.857201    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc83e8cce_267b_475d_8295_19d87e6d4df0.slice/crio-ccf893df3950da0a5a3e61a64b5ffea4ee26af32be051cec9b5d0c104f94d8ad WatchSource:0}: Error finding container ccf893df3950da0a5a3e61a64b5ffea4ee26af32be051cec9b5d0c104f94d8ad: Status 404 returned error can't find the container with id ccf893df3950da0a5a3e61a64b5ffea4ee26af32be051cec9b5d0c104f94d8ad
Sep 10 17:19:38.042702 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:38.042668    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ltf7w" event={"ID":"c83e8cce-267b-475d-8295-19d87e6d4df0","Type":"ContainerStarted","Data":"ccf893df3950da0a5a3e61a64b5ffea4ee26af32be051cec9b5d0c104f94d8ad"}
Sep 10 17:19:40.052703 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:40.052609    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ltf7w" event={"ID":"c83e8cce-267b-475d-8295-19d87e6d4df0","Type":"ContainerStarted","Data":"e3b74c19d1df319cae343ca7414783f864ec5c906dc33da1090fc3434aab8a56"}
Sep 10 17:19:40.053077 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:40.052720    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ltf7w"
Sep 10 17:19:40.055194 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:40.055169    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bdxz5"]
Sep 10 17:19:40.057310 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:40.057296    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-bdxz5"
Sep 10 17:19:40.059648 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:40.059628    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-x5qrd\""
Sep 10 17:19:40.076748 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:40.076723    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bdxz5"]
Sep 10 17:19:40.091470 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:40.091421    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ltf7w" podStartSLOduration=1.3316651130000001 podStartE2EDuration="3.091404379s" totalImagesPullingTime="1.759739266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:19:40.090583813 +0000 UTC m=+465.506634802" watchObservedRunningTime="2026-09-10 17:19:40.091404379 +0000 UTC m=+465.507455328"
Sep 10 17:19:40.227014 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:40.226970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4cck\" (UniqueName: \"kubernetes.io/projected/d8d7bef1-77b5-422c-a068-66c8d0525e24-kube-api-access-j4cck\") pod \"authorino-operator-76b478bd78-bdxz5\" (UID: \"d8d7bef1-77b5-422c-a068-66c8d0525e24\") " pod="kuadrant-system/authorino-operator-76b478bd78-bdxz5"
Sep 10 17:19:40.327909 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:40.327813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4cck\" (UniqueName: \"kubernetes.io/projected/d8d7bef1-77b5-422c-a068-66c8d0525e24-kube-api-access-j4cck\") pod \"authorino-operator-76b478bd78-bdxz5\" (UID: \"d8d7bef1-77b5-422c-a068-66c8d0525e24\") " pod="kuadrant-system/authorino-operator-76b478bd78-bdxz5"
Sep 10 17:19:40.348675 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:40.348639    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4cck\" (UniqueName: \"kubernetes.io/projected/d8d7bef1-77b5-422c-a068-66c8d0525e24-kube-api-access-j4cck\") pod \"authorino-operator-76b478bd78-bdxz5\" (UID: \"d8d7bef1-77b5-422c-a068-66c8d0525e24\") " pod="kuadrant-system/authorino-operator-76b478bd78-bdxz5"
Sep 10 17:19:40.366537 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:40.366504    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-bdxz5"
Sep 10 17:19:40.643115 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:40.643079    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bdxz5"]
Sep 10 17:19:40.646282 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:19:40.646252    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d7bef1_77b5_422c_a068_66c8d0525e24.slice/crio-4ad80f23db44fa72bb29e4c3dda4c9633e7af5e6a1625a157e98c9187619923f WatchSource:0}: Error finding container 4ad80f23db44fa72bb29e4c3dda4c9633e7af5e6a1625a157e98c9187619923f: Status 404 returned error can't find the container with id 4ad80f23db44fa72bb29e4c3dda4c9633e7af5e6a1625a157e98c9187619923f
Sep 10 17:19:41.058279 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:41.058196    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-bdxz5" event={"ID":"d8d7bef1-77b5-422c-a068-66c8d0525e24","Type":"ContainerStarted","Data":"4ad80f23db44fa72bb29e4c3dda4c9633e7af5e6a1625a157e98c9187619923f"}
Sep 10 17:19:43.069508 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:43.069468    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-bdxz5" event={"ID":"d8d7bef1-77b5-422c-a068-66c8d0525e24","Type":"ContainerStarted","Data":"c901ab0ac85611180034ece7f5196a76c9738fa5bbd9c84bdac2a31804e2a315"}
Sep 10 17:19:43.069903 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:43.069592    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-bdxz5"
Sep 10 17:19:43.093252 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:43.093200    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-bdxz5" podStartSLOduration=1.621183205 podStartE2EDuration="3.093184503s" totalImagesPullingTime="1.472001298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:19:43.092100752 +0000 UTC m=+468.508151703" watchObservedRunningTime="2026-09-10 17:19:43.093184503 +0000 UTC m=+468.509235451"
Sep 10 17:19:46.035704 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:46.035674    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"
Sep 10 17:19:51.061201 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:51.061167    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ltf7w"
Sep 10 17:19:54.075473 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.075444    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-bdxz5"
Sep 10 17:19:54.174831 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.174801    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"]
Sep 10 17:19:54.175019 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.174995    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj" podUID="c3375cb8-3885-46f9-9604-10af86d96237" containerName="manager" containerID="cri-o://c8543f9dd4b14acf8bfadbb780b9c0f75030797864a5d321359c29f880dac95d" gracePeriod=2
Sep 10 17:19:54.192320 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.192295    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"]
Sep 10 17:19:54.193284 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:19:54.193246    2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c3375cb8-3885-46f9-9604-10af86d96237\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-dj4nj\": pods \"limitador-operator-controller-manager-74495c69f8-dj4nj\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"
Sep 10 17:19:54.212447 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.212418    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hhktr"]
Sep 10 17:19:54.212712 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.212700    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3375cb8-3885-46f9-9604-10af86d96237" containerName="manager"
Sep 10 17:19:54.212760 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.212713    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3375cb8-3885-46f9-9604-10af86d96237" containerName="manager"
Sep 10 17:19:54.212792 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.212768    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3375cb8-3885-46f9-9604-10af86d96237" containerName="manager"
Sep 10 17:19:54.214788 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.214763    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hhktr"
Sep 10 17:19:54.218112 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:19:54.218072    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-dj4nj\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="c3375cb8-3885-46f9-9604-10af86d96237" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"
Sep 10 17:19:54.226483 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.226458    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hhktr"]
Sep 10 17:19:54.345741 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.345661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq57s\" (UniqueName: \"kubernetes.io/projected/53bb30ff-b9b5-435d-8f8e-4c33bea1a3f3-kube-api-access-mq57s\") pod \"limitador-operator-controller-manager-74495c69f8-hhktr\" (UID: \"53bb30ff-b9b5-435d-8f8e-4c33bea1a3f3\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hhktr"
Sep 10 17:19:54.409550 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.409524    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"
Sep 10 17:19:54.411934 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:19:54.411908    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-dj4nj\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="c3375cb8-3885-46f9-9604-10af86d96237" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"
Sep 10 17:19:54.446435 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.446406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq57s\" (UniqueName: \"kubernetes.io/projected/53bb30ff-b9b5-435d-8f8e-4c33bea1a3f3-kube-api-access-mq57s\") pod \"limitador-operator-controller-manager-74495c69f8-hhktr\" (UID: \"53bb30ff-b9b5-435d-8f8e-4c33bea1a3f3\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hhktr"
Sep 10 17:19:54.455565 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.455542    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq57s\" (UniqueName: \"kubernetes.io/projected/53bb30ff-b9b5-435d-8f8e-4c33bea1a3f3-kube-api-access-mq57s\") pod \"limitador-operator-controller-manager-74495c69f8-hhktr\" (UID: \"53bb30ff-b9b5-435d-8f8e-4c33bea1a3f3\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hhktr"
Sep 10 17:19:54.546943 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.546912    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc7g4\" (UniqueName: \"kubernetes.io/projected/c3375cb8-3885-46f9-9604-10af86d96237-kube-api-access-vc7g4\") pod \"c3375cb8-3885-46f9-9604-10af86d96237\" (UID: \"c3375cb8-3885-46f9-9604-10af86d96237\") "
Sep 10 17:19:54.549100 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.549075    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3375cb8-3885-46f9-9604-10af86d96237-kube-api-access-vc7g4" (OuterVolumeSpecName: "kube-api-access-vc7g4") pod "c3375cb8-3885-46f9-9604-10af86d96237" (UID: "c3375cb8-3885-46f9-9604-10af86d96237"). InnerVolumeSpecName "kube-api-access-vc7g4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:19:54.555294 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.555271    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hhktr"
Sep 10 17:19:54.647645 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.647614    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc7g4\" (UniqueName: \"kubernetes.io/projected/c3375cb8-3885-46f9-9604-10af86d96237-kube-api-access-vc7g4\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:19:54.840042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:54.840006    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hhktr"]
Sep 10 17:19:54.842090 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:19:54.842040    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53bb30ff_b9b5_435d_8f8e_4c33bea1a3f3.slice/crio-f7b46b5bc5dd9397c6314be922eda290c0edd9a325203835f1cfe5c033ae2000 WatchSource:0}: Error finding container f7b46b5bc5dd9397c6314be922eda290c0edd9a325203835f1cfe5c033ae2000: Status 404 returned error can't find the container with id f7b46b5bc5dd9397c6314be922eda290c0edd9a325203835f1cfe5c033ae2000
Sep 10 17:19:55.082854 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:19:55.082802    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-dj4nj\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="c3375cb8-3885-46f9-9604-10af86d96237" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"
Sep 10 17:19:55.084906 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:55.084881    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3375cb8-3885-46f9-9604-10af86d96237" path="/var/lib/kubelet/pods/c3375cb8-3885-46f9-9604-10af86d96237/volumes"
Sep 10 17:19:55.118097 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:55.118036    2576 generic.go:356] "Generic (PLEG): container finished" podID="c3375cb8-3885-46f9-9604-10af86d96237" containerID="c8543f9dd4b14acf8bfadbb780b9c0f75030797864a5d321359c29f880dac95d" exitCode=0
Sep 10 17:19:55.118288 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:55.118103    2576 scope.go:117] "RemoveContainer" containerID="c8543f9dd4b14acf8bfadbb780b9c0f75030797864a5d321359c29f880dac95d"
Sep 10 17:19:55.118288 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:55.118127    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-dj4nj"
Sep 10 17:19:55.120439 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:55.120343    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hhktr" event={"ID":"53bb30ff-b9b5-435d-8f8e-4c33bea1a3f3","Type":"ContainerStarted","Data":"b53148ee1c90145a5ece1d046585e302898638ee2006f704c22e9514fa806452"}
Sep 10 17:19:55.120439 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:55.120402    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hhktr" event={"ID":"53bb30ff-b9b5-435d-8f8e-4c33bea1a3f3","Type":"ContainerStarted","Data":"f7b46b5bc5dd9397c6314be922eda290c0edd9a325203835f1cfe5c033ae2000"}
Sep 10 17:19:55.120891 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:55.120666    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hhktr"
Sep 10 17:19:55.127563 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:55.127525    2576 scope.go:117] "RemoveContainer" containerID="c8543f9dd4b14acf8bfadbb780b9c0f75030797864a5d321359c29f880dac95d"
Sep 10 17:19:55.127770 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:19:55.127751    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8543f9dd4b14acf8bfadbb780b9c0f75030797864a5d321359c29f880dac95d\": container with ID starting with c8543f9dd4b14acf8bfadbb780b9c0f75030797864a5d321359c29f880dac95d not found: ID does not exist" containerID="c8543f9dd4b14acf8bfadbb780b9c0f75030797864a5d321359c29f880dac95d"
Sep 10 17:19:55.127843 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:55.127783    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8543f9dd4b14acf8bfadbb780b9c0f75030797864a5d321359c29f880dac95d"} err="failed to get container status \"c8543f9dd4b14acf8bfadbb780b9c0f75030797864a5d321359c29f880dac95d\": rpc error: code = NotFound desc = could not find container \"c8543f9dd4b14acf8bfadbb780b9c0f75030797864a5d321359c29f880dac95d\": container with ID starting with c8543f9dd4b14acf8bfadbb780b9c0f75030797864a5d321359c29f880dac95d not found: ID does not exist"
Sep 10 17:19:55.152496 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:19:55.152442    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hhktr" podStartSLOduration=1.152420806 podStartE2EDuration="1.152420806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:19:55.149777916 +0000 UTC m=+480.565828864" watchObservedRunningTime="2026-09-10 17:19:55.152420806 +0000 UTC m=+480.568471756"
Sep 10 17:20:06.127773 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:06.127744    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hhktr"
Sep 10 17:20:30.660883 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:30.660852    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:20:30.662955 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:30.662939    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"
Sep 10 17:20:30.672259 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:30.672236    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 17:20:30.672917 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:30.672901    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-29zjg\""
Sep 10 17:20:30.686456 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:30.686426    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:20:30.709038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:30.709011    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba36e1d0-46f2-405b-a52a-3bb855563822-config-file\") pod \"limitador-limitador-84994f7ffc-wb7gb\" (UID: \"ba36e1d0-46f2-405b-a52a-3bb855563822\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"
Sep 10 17:20:30.709170 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:30.709042    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9szbm\" (UniqueName: \"kubernetes.io/projected/ba36e1d0-46f2-405b-a52a-3bb855563822-kube-api-access-9szbm\") pod \"limitador-limitador-84994f7ffc-wb7gb\" (UID: \"ba36e1d0-46f2-405b-a52a-3bb855563822\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"
Sep 10 17:20:30.716652 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:30.716630    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:20:30.809975 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:30.809913    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba36e1d0-46f2-405b-a52a-3bb855563822-config-file\") pod \"limitador-limitador-84994f7ffc-wb7gb\" (UID: \"ba36e1d0-46f2-405b-a52a-3bb855563822\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"
Sep 10 17:20:30.809975 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:30.809955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9szbm\" (UniqueName: \"kubernetes.io/projected/ba36e1d0-46f2-405b-a52a-3bb855563822-kube-api-access-9szbm\") pod \"limitador-limitador-84994f7ffc-wb7gb\" (UID: \"ba36e1d0-46f2-405b-a52a-3bb855563822\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"
Sep 10 17:20:30.810643 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:30.810622    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba36e1d0-46f2-405b-a52a-3bb855563822-config-file\") pod \"limitador-limitador-84994f7ffc-wb7gb\" (UID: \"ba36e1d0-46f2-405b-a52a-3bb855563822\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"
Sep 10 17:20:30.825872 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:30.825840    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9szbm\" (UniqueName: \"kubernetes.io/projected/ba36e1d0-46f2-405b-a52a-3bb855563822-kube-api-access-9szbm\") pod \"limitador-limitador-84994f7ffc-wb7gb\" (UID: \"ba36e1d0-46f2-405b-a52a-3bb855563822\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"
Sep 10 17:20:30.973335 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:30.973258    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"
Sep 10 17:20:31.255329 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:31.255236    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:20:31.271621 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:31.271595    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-wb7gb" event={"ID":"ba36e1d0-46f2-405b-a52a-3bb855563822","Type":"ContainerStarted","Data":"40ca7b0c3aae33e7faf7f7ae9e351345da6514bf6fb999df2c33abdffa1634f9"}
Sep 10 17:20:32.277894 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:32.277859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-wb7gb" event={"ID":"ba36e1d0-46f2-405b-a52a-3bb855563822","Type":"ContainerStarted","Data":"7ebdbae7678d5d40d368042219b960142febeadca5e630115797f55d2fe8884f"}
Sep 10 17:20:32.278385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:32.277995    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"
Sep 10 17:20:32.315066 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:32.315001    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-wb7gb" podStartSLOduration=1.418007158 podStartE2EDuration="2.314980935s" totalImagesPullingTime="896.973777ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:20:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:20:32.313441109 +0000 UTC m=+517.729492058" watchObservedRunningTime="2026-09-10 17:20:32.314980935 +0000 UTC m=+517.731031885"
Sep 10 17:20:43.283286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:20:43.283257    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"
Sep 10 17:21:44.887666 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:21:44.887623    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:22:02.427968 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:02.427937    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:22:13.364490 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.364456    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"]
Sep 10 17:22:13.367555 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.367539    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.370481 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.370455    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 17:22:13.371249 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.371226    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mn569\""
Sep 10 17:22:13.371377 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.371247    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 10 17:22:13.371377 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.371264    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 17:22:13.396112 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.396083    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"]
Sep 10 17:22:13.542453 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.542420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db5258a4-009c-42fc-a772-e4b185834d95-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.542453 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.542457    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db5258a4-009c-42fc-a772-e4b185834d95-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.542669 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.542490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db5258a4-009c-42fc-a772-e4b185834d95-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.542669 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.542576    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db5258a4-009c-42fc-a772-e4b185834d95-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.542669 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.542600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db5258a4-009c-42fc-a772-e4b185834d95-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.542669 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.542624    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22w6q\" (UniqueName: \"kubernetes.io/projected/db5258a4-009c-42fc-a772-e4b185834d95-kube-api-access-22w6q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.643481 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.643445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db5258a4-009c-42fc-a772-e4b185834d95-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.643649 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.643505    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db5258a4-009c-42fc-a772-e4b185834d95-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.643649 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.643534    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db5258a4-009c-42fc-a772-e4b185834d95-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.643649 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.643565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22w6q\" (UniqueName: \"kubernetes.io/projected/db5258a4-009c-42fc-a772-e4b185834d95-kube-api-access-22w6q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.643649 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.643621    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db5258a4-009c-42fc-a772-e4b185834d95-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.643800 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.643648    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db5258a4-009c-42fc-a772-e4b185834d95-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.644007 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.643981    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db5258a4-009c-42fc-a772-e4b185834d95-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.644007 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.643999    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db5258a4-009c-42fc-a772-e4b185834d95-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.644162 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.644026    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db5258a4-009c-42fc-a772-e4b185834d95-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.645821 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.645798    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db5258a4-009c-42fc-a772-e4b185834d95-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.646096 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.646079    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db5258a4-009c-42fc-a772-e4b185834d95-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.655998 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.655974    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22w6q\" (UniqueName: \"kubernetes.io/projected/db5258a4-009c-42fc-a772-e4b185834d95-kube-api-access-22w6q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-w2xch\" (UID: \"db5258a4-009c-42fc-a772-e4b185834d95\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.678008 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.677983    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:13.989946 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.989870    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"]
Sep 10 17:22:13.993075 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:22:13.993036    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5258a4_009c_42fc_a772_e4b185834d95.slice/crio-4da57d6db9e262e6a644a3600b4775a48e7abb7fc6328bd3ca1dfb32cb8effb6 WatchSource:0}: Error finding container 4da57d6db9e262e6a644a3600b4775a48e7abb7fc6328bd3ca1dfb32cb8effb6: Status 404 returned error can't find the container with id 4da57d6db9e262e6a644a3600b4775a48e7abb7fc6328bd3ca1dfb32cb8effb6
Sep 10 17:22:13.994444 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:13.994426    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 17:22:14.100136 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:14.100092    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:22:14.710338 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:14.710299    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch" event={"ID":"db5258a4-009c-42fc-a772-e4b185834d95","Type":"ContainerStarted","Data":"4da57d6db9e262e6a644a3600b4775a48e7abb7fc6328bd3ca1dfb32cb8effb6"}
Sep 10 17:22:15.715472 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:15.715432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch" event={"ID":"db5258a4-009c-42fc-a772-e4b185834d95","Type":"ContainerStarted","Data":"c09ee7132ab8f32846e610b4ba704ea34176364341a70f20fc7d5e4557c45a3c"}
Sep 10 17:22:15.753932 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:15.753851    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch" podStartSLOduration=1.7554046159999999 podStartE2EDuration="2.753834749s" totalImagesPullingTime="998.430133ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:22:15.753754356 +0000 UTC m=+621.169805306" watchObservedRunningTime="2026-09-10 17:22:15.753834749 +0000 UTC m=+621.169885698"
Sep 10 17:22:23.678486 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:23.678395    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:23.678486 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:23.678468    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:23.691496 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:23.691470    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:23.760597 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:23.760571    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-w2xch"
Sep 10 17:22:26.629857 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:26.629823    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:22:39.159173 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:39.159135    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:22:46.590891 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.590856    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"]
Sep 10 17:22:46.594195 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.594178    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.596931 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.596908    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 17:22:46.654924 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.654889    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"]
Sep 10 17:22:46.699491 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.699453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.699491 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.699494    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7qxj\" (UniqueName: \"kubernetes.io/projected/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-kube-api-access-v7qxj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.699739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.699535    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.699739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.699579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.699739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.699670    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.699739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.699714    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.800230 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.800190    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.800398 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.800245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.800398 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.800291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.800398 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.800330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7qxj\" (UniqueName: \"kubernetes.io/projected/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-kube-api-access-v7qxj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.800558 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.800400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.800558 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.800455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.800722 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.800695    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.800826 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.800800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.800948 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.800811    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.803115 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.803083    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.803325 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.803307    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.810356 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.810332    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7qxj\" (UniqueName: \"kubernetes.io/projected/2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb-kube-api-access-v7qxj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr\" (UID: \"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:46.904469 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:46.904429    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:47.212670 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:47.212593    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"]
Sep 10 17:22:47.214863 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:22:47.214837    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc3e119_aeb2_43fc_ab07_54ff8bc09bcb.slice/crio-05e02d3986c2f3f60e9ba865082c70e2236630575f04ad1a5034154197167fff WatchSource:0}: Error finding container 05e02d3986c2f3f60e9ba865082c70e2236630575f04ad1a5034154197167fff: Status 404 returned error can't find the container with id 05e02d3986c2f3f60e9ba865082c70e2236630575f04ad1a5034154197167fff
Sep 10 17:22:47.859302 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:47.859197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr" event={"ID":"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb","Type":"ContainerStarted","Data":"e11106ea7a9ed3c983139db1193bc1eb528fb5fa41019d3353a77fc8f6e6030f"}
Sep 10 17:22:47.859302 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:47.859268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr" event={"ID":"2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb","Type":"ContainerStarted","Data":"05e02d3986c2f3f60e9ba865082c70e2236630575f04ad1a5034154197167fff"}
Sep 10 17:22:48.177434 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:48.177371    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr" podStartSLOduration=1.972786335 podStartE2EDuration="2.177351535s" totalImagesPullingTime="204.5652ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:22:47.891982607 +0000 UTC m=+653.308033556" watchObservedRunningTime="2026-09-10 17:22:48.177351535 +0000 UTC m=+653.593402491"
Sep 10 17:22:48.177968 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:48.177945    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:22:56.905306 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:56.905275    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:56.905765 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:56.905346    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:56.917857 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:56.917829    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:57.912611 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:57.912580    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr"
Sep 10 17:22:57.924722 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:22:57.924692    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:23:12.628708 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:23:12.628671    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:24:27.739868 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:27.739836    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7650-4e7aa5"]
Sep 10 17:24:27.745295 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:27.744726    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7650-4e7aa5"
Sep 10 17:24:27.747748 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:27.747724    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4gkv4\""
Sep 10 17:24:27.761908 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:27.761880    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7650-4e7aa5"]
Sep 10 17:24:27.931879 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:27.931836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfzjs\" (UniqueName: \"kubernetes.io/projected/5b3798c4-7a05-47dd-b6d6-5d072b781e26-kube-api-access-cfzjs\") pod \"test-curl-7650-4e7aa5\" (UID: \"5b3798c4-7a05-47dd-b6d6-5d072b781e26\") " pod="opendatahub/test-curl-7650-4e7aa5"
Sep 10 17:24:28.033317 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:28.033218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfzjs\" (UniqueName: \"kubernetes.io/projected/5b3798c4-7a05-47dd-b6d6-5d072b781e26-kube-api-access-cfzjs\") pod \"test-curl-7650-4e7aa5\" (UID: \"5b3798c4-7a05-47dd-b6d6-5d072b781e26\") " pod="opendatahub/test-curl-7650-4e7aa5"
Sep 10 17:24:28.044562 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:28.044527    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfzjs\" (UniqueName: \"kubernetes.io/projected/5b3798c4-7a05-47dd-b6d6-5d072b781e26-kube-api-access-cfzjs\") pod \"test-curl-7650-4e7aa5\" (UID: \"5b3798c4-7a05-47dd-b6d6-5d072b781e26\") " pod="opendatahub/test-curl-7650-4e7aa5"
Sep 10 17:24:28.054442 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:28.054415    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7650-4e7aa5"
Sep 10 17:24:28.344457 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:28.344369    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7650-4e7aa5"]
Sep 10 17:24:28.347256 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:24:28.347220    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b3798c4_7a05_47dd_b6d6_5d072b781e26.slice/crio-09cd7d526beff9bf876174c8509351fe484a78538fac427bf00930a2b7437f2f WatchSource:0}: Error finding container 09cd7d526beff9bf876174c8509351fe484a78538fac427bf00930a2b7437f2f: Status 404 returned error can't find the container with id 09cd7d526beff9bf876174c8509351fe484a78538fac427bf00930a2b7437f2f
Sep 10 17:24:29.299965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:29.299926    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7650-4e7aa5" event={"ID":"5b3798c4-7a05-47dd-b6d6-5d072b781e26","Type":"ContainerStarted","Data":"09cd7d526beff9bf876174c8509351fe484a78538fac427bf00930a2b7437f2f"}
Sep 10 17:24:29.720805 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:29.720766    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:24:30.305412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:30.305371    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7650-4e7aa5" event={"ID":"5b3798c4-7a05-47dd-b6d6-5d072b781e26","Type":"ContainerStarted","Data":"d162f2111ca829507a91e10a2115bf3bef611b28a182ab8c64506ebaae1568b0"}
Sep 10 17:24:31.052895 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:31.052760    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7650-4e7aa5" podStartSLOduration=2.170692385 podStartE2EDuration="4.052740307s" totalImagesPullingTime="1.882047922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:24:30.345593468 +0000 UTC m=+755.761644417" watchObservedRunningTime="2026-09-10 17:24:31.052740307 +0000 UTC m=+756.468791253"
Sep 10 17:24:31.053685 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:31.053659    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7650-4e7aa5"]
Sep 10 17:24:31.059532 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:31.059509    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7650-4e7aa5"]
Sep 10 17:24:31.310510 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:24:31.310431    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7650-4e7aa5" container="test-curl-7650-4e7aa5"
Sep 10 17:24:32.314822 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:32.314784    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7650-4e7aa5" podUID="5b3798c4-7a05-47dd-b6d6-5d072b781e26" containerName="test-curl-7650-4e7aa5" containerID="cri-o://d162f2111ca829507a91e10a2115bf3bef611b28a182ab8c64506ebaae1568b0" gracePeriod=2
Sep 10 17:24:34.476165 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:34.476141    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7650-4e7aa5"
Sep 10 17:24:34.486487 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:34.486459    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfzjs\" (UniqueName: \"kubernetes.io/projected/5b3798c4-7a05-47dd-b6d6-5d072b781e26-kube-api-access-cfzjs\") pod \"5b3798c4-7a05-47dd-b6d6-5d072b781e26\" (UID: \"5b3798c4-7a05-47dd-b6d6-5d072b781e26\") "
Sep 10 17:24:34.488560 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:34.488530    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b3798c4-7a05-47dd-b6d6-5d072b781e26-kube-api-access-cfzjs" (OuterVolumeSpecName: "kube-api-access-cfzjs") pod "5b3798c4-7a05-47dd-b6d6-5d072b781e26" (UID: "5b3798c4-7a05-47dd-b6d6-5d072b781e26"). InnerVolumeSpecName "kube-api-access-cfzjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:24:34.587602 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:34.587522    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfzjs\" (UniqueName: \"kubernetes.io/projected/5b3798c4-7a05-47dd-b6d6-5d072b781e26-kube-api-access-cfzjs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:24:35.084570 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:35.084537    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b3798c4-7a05-47dd-b6d6-5d072b781e26" path="/var/lib/kubelet/pods/5b3798c4-7a05-47dd-b6d6-5d072b781e26/volumes"
Sep 10 17:24:35.328971 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:35.328932    2576 generic.go:356] "Generic (PLEG): container finished" podID="5b3798c4-7a05-47dd-b6d6-5d072b781e26" containerID="d162f2111ca829507a91e10a2115bf3bef611b28a182ab8c64506ebaae1568b0" exitCode=137
Sep 10 17:24:35.328971 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:35.328973    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7650-4e7aa5"
Sep 10 17:24:35.329224 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:35.328999    2576 scope.go:117] "RemoveContainer" containerID="d162f2111ca829507a91e10a2115bf3bef611b28a182ab8c64506ebaae1568b0"
Sep 10 17:24:35.336906 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:35.336890    2576 scope.go:117] "RemoveContainer" containerID="d162f2111ca829507a91e10a2115bf3bef611b28a182ab8c64506ebaae1568b0"
Sep 10 17:24:35.337176 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:24:35.337159    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d162f2111ca829507a91e10a2115bf3bef611b28a182ab8c64506ebaae1568b0\": container with ID starting with d162f2111ca829507a91e10a2115bf3bef611b28a182ab8c64506ebaae1568b0 not found: ID does not exist" containerID="d162f2111ca829507a91e10a2115bf3bef611b28a182ab8c64506ebaae1568b0"
Sep 10 17:24:35.337239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:35.337190    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d162f2111ca829507a91e10a2115bf3bef611b28a182ab8c64506ebaae1568b0"} err="failed to get container status \"d162f2111ca829507a91e10a2115bf3bef611b28a182ab8c64506ebaae1568b0\": rpc error: code = NotFound desc = could not find container \"d162f2111ca829507a91e10a2115bf3bef611b28a182ab8c64506ebaae1568b0\": container with ID starting with d162f2111ca829507a91e10a2115bf3bef611b28a182ab8c64506ebaae1568b0 not found: ID does not exist"
Sep 10 17:24:36.707303 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.707264    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"]
Sep 10 17:24:36.707691 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.707600    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b3798c4-7a05-47dd-b6d6-5d072b781e26" containerName="test-curl-7650-4e7aa5"
Sep 10 17:24:36.707691 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.707612    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b3798c4-7a05-47dd-b6d6-5d072b781e26" containerName="test-curl-7650-4e7aa5"
Sep 10 17:24:36.707691 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.707669    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b3798c4-7a05-47dd-b6d6-5d072b781e26" containerName="test-curl-7650-4e7aa5"
Sep 10 17:24:36.712401 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.712379    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.715767 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.715747    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-889898-openshift-default-dockercfg-tj7gf\""
Sep 10 17:24:36.738921 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.738888    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"]
Sep 10 17:24:36.805723 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.805689    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-workload-socket\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.805723 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.805726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-token\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.805929 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.805750    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-envoy\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.805929 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.805780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-podinfo\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.805929 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.805810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-workload-certs\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.805929 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.805828    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istiod-ca-cert\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.805929 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.805855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-data\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.805929 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.805911    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-credential-socket\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.806135 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.805941    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tbfl\" (UniqueName: \"kubernetes.io/projected/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-kube-api-access-8tbfl\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.906330 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.906303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-data\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.906507 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.906346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-credential-socket\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.906507 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.906380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tbfl\" (UniqueName: \"kubernetes.io/projected/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-kube-api-access-8tbfl\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.906507 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.906408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-workload-socket\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.906507 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.906428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-token\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.906507 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.906460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-envoy\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.906507 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.906488    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-podinfo\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.906897 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.906524    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-workload-certs\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.906897 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.906542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istiod-ca-cert\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.906897 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.906849    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-data\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.907100 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.906946    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-workload-socket\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.907167 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.907119    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-credential-socket\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.907220 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.907169    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-workload-certs\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.907351 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.907334    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istiod-ca-cert\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.909272 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.909246    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-envoy\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.909480 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.909457    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-podinfo\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.920632 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.920607    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"]
Sep 10 17:24:36.924122 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.924103    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:36.926958 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.926937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-token\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.927390 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.927370    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tbfl\" (UniqueName: \"kubernetes.io/projected/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-kube-api-access-8tbfl\") pod \"e2e-autores-889898-openshift-default-5756f89cb6-t4bmn\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") " pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:36.929501 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.929481    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-99ff0092-openshift-default-dockercfg-gxgl4\""
Sep 10 17:24:36.949791 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:36.949767    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"]
Sep 10 17:24:37.007402 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.007312    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-workload-certs\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.007402 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.007354    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-token\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.007402 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.007372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdndh\" (UniqueName: \"kubernetes.io/projected/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-kube-api-access-mdndh\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.007402 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.007394    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istiod-ca-cert\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.007683 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.007418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-envoy\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.007683 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.007437    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-credential-socket\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.007683 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.007527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-workload-socket\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.007683 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.007575    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-data\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.007683 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.007591    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-podinfo\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.022352 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.022324    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:37.108950 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.108924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-workload-certs\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.109101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.108963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-token\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.109101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.108983    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdndh\" (UniqueName: \"kubernetes.io/projected/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-kube-api-access-mdndh\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.109101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.109003    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istiod-ca-cert\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.109101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.109033    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-envoy\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.109101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.109063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-credential-socket\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.109101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.109097    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-workload-socket\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.109303 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.109131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-data\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.109303 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.109147    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-podinfo\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.110281 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.109735    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-workload-socket\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.110281 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.109799    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-credential-socket\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.110281 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.109913    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-data\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.110281 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.110016    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-workload-certs\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.110281 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.110219    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istiod-ca-cert\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.111904 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.111884    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-podinfo\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.112104 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.112086    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-envoy\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.151221 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.151192    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-token\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.169829 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.169800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdndh\" (UniqueName: \"kubernetes.io/projected/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-kube-api-access-mdndh\") pod \"e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") " pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.240868 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.240831    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:37.330275 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.330245    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"]
Sep 10 17:24:37.333270 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:24:37.333239    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d30aba_7eab_41fc_b6f7_53a4e94f8f9f.slice/crio-be42639e197d0cd470c3174f5613df55dfe24637d9529af5faed2cfe904ccc06 WatchSource:0}: Error finding container be42639e197d0cd470c3174f5613df55dfe24637d9529af5faed2cfe904ccc06: Status 404 returned error can't find the container with id be42639e197d0cd470c3174f5613df55dfe24637d9529af5faed2cfe904ccc06
Sep 10 17:24:37.340411 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.340387    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn" event={"ID":"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f","Type":"ContainerStarted","Data":"be42639e197d0cd470c3174f5613df55dfe24637d9529af5faed2cfe904ccc06"}
Sep 10 17:24:37.546352 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:37.546326    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"]
Sep 10 17:24:37.547493 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:24:37.547470    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe28fe7_67bd_458a_b0fb_9bfe1197fc04.slice/crio-8f4d71d38e8a7e4dd4324bfc541b32e278311a4bf0e5ca591883de1e4cc56587 WatchSource:0}: Error finding container 8f4d71d38e8a7e4dd4324bfc541b32e278311a4bf0e5ca591883de1e4cc56587: Status 404 returned error can't find the container with id 8f4d71d38e8a7e4dd4324bfc541b32e278311a4bf0e5ca591883de1e4cc56587
Sep 10 17:24:38.348756 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:38.348715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc" event={"ID":"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04","Type":"ContainerStarted","Data":"8f4d71d38e8a7e4dd4324bfc541b32e278311a4bf0e5ca591883de1e4cc56587"}
Sep 10 17:24:40.025758 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:40.025718    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:24:40.026075 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:40.025791    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:24:40.026075 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:40.025821    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:24:40.031672 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:40.031643    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:24:40.031737 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:40.031724    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:24:40.031784 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:40.031768    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:24:40.362900 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:40.362778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn" event={"ID":"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f","Type":"ContainerStarted","Data":"8688a32e741edfb798ff4fd406c6baaac6fc3cc1f022a89cf157b00639c81c1c"}
Sep 10 17:24:40.364777 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:40.364712    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc" event={"ID":"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04","Type":"ContainerStarted","Data":"05ae305a576088b5b23e532067711f91fec693d9200d13fc6890d0d32bd0e2fa"}
Sep 10 17:24:40.397945 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:40.397890    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn" podStartSLOduration=1.7079461729999998 podStartE2EDuration="4.397872429s" totalImagesPullingTime="2.689926256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:24:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:24:40.394624069 +0000 UTC m=+765.810675018" watchObservedRunningTime="2026-09-10 17:24:40.397872429 +0000 UTC m=+765.813923378"
Sep 10 17:24:40.434245 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:40.434196    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc" podStartSLOduration=1.952411114 podStartE2EDuration="4.434179368s" totalImagesPullingTime="2.481768254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:24:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:24:40.429215398 +0000 UTC m=+765.845266357" watchObservedRunningTime="2026-09-10 17:24:40.434179368 +0000 UTC m=+765.850230316"
Sep 10 17:24:41.023108 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:41.023047    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:41.027969 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:41.027942    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:41.241666 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:41.241629    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:41.246652 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:41.246628    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:41.369039 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:41.369015    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:41.369327 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:41.369298    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:41.369809 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:41.369789    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:24:41.369892 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:41.369859    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:24:43.028727 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:43.028689    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:24:59.656176 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:24:59.656139    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:25:00.275394 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.275356    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"]
Sep 10 17:25:00.283015 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.282986    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.285425 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.285400    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-75bd9a-openshift-default-dockercfg-n6z5w\""
Sep 10 17:25:00.301810 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.301772    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"]
Sep 10 17:25:00.420901 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.420865    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-data\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.421125 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.420914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-credential-socket\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.421125 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.421029    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zp6m\" (UniqueName: \"kubernetes.io/projected/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-kube-api-access-2zp6m\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.421125 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.421099    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-token\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.421340 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.421147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-workload-socket\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.421340 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.421229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-workload-certs\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.421340 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.421272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istiod-ca-cert\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.421340 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.421317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-envoy\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.421551 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.421343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-podinfo\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.522388 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.522330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-data\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.522595 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.522444    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-credential-socket\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.522595 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.522545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zp6m\" (UniqueName: \"kubernetes.io/projected/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-kube-api-access-2zp6m\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.522595 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.522577    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-token\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.522774 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.522629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-workload-socket\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.522774 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.522671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-workload-certs\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.522774 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.522694    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istiod-ca-cert\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.522774 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.522732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-envoy\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.522774 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.522760    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-data\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.523013 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.522798    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-credential-socket\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.523013 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.522844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-podinfo\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.523508 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.523474    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-workload-socket\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.523621 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.523548    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-workload-certs\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.529106 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.523804    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istiod-ca-cert\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.531455 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.531429    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-envoy\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.531877 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.531838    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-podinfo\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.534533 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.534503    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zp6m\" (UniqueName: \"kubernetes.io/projected/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-kube-api-access-2zp6m\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.534623 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.534549    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-token\") pod \"e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") " pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.595020 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.594977    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:00.881248 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.881211    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"]
Sep 10 17:25:00.883827 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:25:00.883796    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e45bbc0_5a25_47a4_8f46_9d9c414c6ae0.slice/crio-a9bc484f0cc24cfaf72568afec651a09a2b61f6cdbf52c58006e4f796f7e0d18 WatchSource:0}: Error finding container a9bc484f0cc24cfaf72568afec651a09a2b61f6cdbf52c58006e4f796f7e0d18: Status 404 returned error can't find the container with id a9bc484f0cc24cfaf72568afec651a09a2b61f6cdbf52c58006e4f796f7e0d18
Sep 10 17:25:00.886944 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.886911    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:00.887135 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.886981    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:00.887135 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:00.887010    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:01.469890 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:01.469844    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g" event={"ID":"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0","Type":"ContainerStarted","Data":"963ad745491507d8dbc09e9dd37f5fab63d27f5a83f42331ff5025f0b920266e"}
Sep 10 17:25:01.471145 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:01.469918    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g" event={"ID":"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0","Type":"ContainerStarted","Data":"a9bc484f0cc24cfaf72568afec651a09a2b61f6cdbf52c58006e4f796f7e0d18"}
Sep 10 17:25:01.471616 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:01.471591    2576 generic.go:356] "Generic (PLEG): container finished" podID="fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" containerID="05ae305a576088b5b23e532067711f91fec693d9200d13fc6890d0d32bd0e2fa" exitCode=0
Sep 10 17:25:01.471718 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:01.471662    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc" event={"ID":"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04","Type":"ContainerDied","Data":"05ae305a576088b5b23e532067711f91fec693d9200d13fc6890d0d32bd0e2fa"}
Sep 10 17:25:01.472019 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:01.472003    2576 scope.go:117] "RemoveContainer" containerID="05ae305a576088b5b23e532067711f91fec693d9200d13fc6890d0d32bd0e2fa"
Sep 10 17:25:01.473085 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:01.473037    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:01.473152 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:01.473124    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:01.473189 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:01.473156    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:01.491356 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:01.491300    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g" podStartSLOduration=1.491283643 podStartE2EDuration="1.491283643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:25:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:25:01.48975816 +0000 UTC m=+786.905809109" watchObservedRunningTime="2026-09-10 17:25:01.491283643 +0000 UTC m=+786.907334591"
Sep 10 17:25:01.595455 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:01.595415    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:01.600804 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:01.600776    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:02.478142 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:02.478108    2576 generic.go:356] "Generic (PLEG): container finished" podID="48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" containerID="8688a32e741edfb798ff4fd406c6baaac6fc3cc1f022a89cf157b00639c81c1c" exitCode=0
Sep 10 17:25:02.478547 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:02.478177    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn" event={"ID":"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f","Type":"ContainerDied","Data":"8688a32e741edfb798ff4fd406c6baaac6fc3cc1f022a89cf157b00639c81c1c"}
Sep 10 17:25:02.478629 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:02.478611    2576 scope.go:117] "RemoveContainer" containerID="8688a32e741edfb798ff4fd406c6baaac6fc3cc1f022a89cf157b00639c81c1c"
Sep 10 17:25:02.480190 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:02.479832    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:02.480190 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:02.479923    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:02.480190 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:02.479970    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:02.482194 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:02.481562    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc" event={"ID":"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04","Type":"ContainerStarted","Data":"130465e83bf068bf4315714d223a56874cf18e185d2935a6ad99f9f162b03091"}
Sep 10 17:25:02.482194 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:02.481829    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:02.492422 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:02.492393    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:03.241551 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:03.241511    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:25:03.241792 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:03.241771    2576 patch_prober.go:28] interesting pod/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 10 17:25:03.241839 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:03.241820    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc" podUID="fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 10 17:25:03.491873 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:03.491772    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn" event={"ID":"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f","Type":"ContainerStarted","Data":"b9e833fc81a8fdbc4c85087579d6b70c1e56b20691bf82ddd1fb745dd8b8b560"}
Sep 10 17:25:04.023323 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:04.022827    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:25:04.023545 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:04.023457    2576 patch_prober.go:28] interesting pod/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Sep 10 17:25:04.023545 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:04.023529    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn" podUID="48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Sep 10 17:25:04.241947 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:04.241915    2576 patch_prober.go:28] interesting pod/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 10 17:25:04.242226 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:04.242194    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc" podUID="fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 10 17:25:05.023317 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:05.023262    2576 patch_prober.go:28] interesting pod/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Sep 10 17:25:05.023834 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:05.023337    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn" podUID="48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Sep 10 17:25:05.242130 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:05.242091    2576 patch_prober.go:28] interesting pod/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 10 17:25:05.242304 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:05.242143    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc" podUID="fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 10 17:25:06.023579 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:06.023535    2576 patch_prober.go:28] interesting pod/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Sep 10 17:25:06.024114 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:06.023607    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn" podUID="48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Sep 10 17:25:06.241919 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:06.241863    2576 patch_prober.go:28] interesting pod/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 10 17:25:06.242161 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:06.241938    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc" podUID="fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 10 17:25:07.023858 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:07.023817    2576 patch_prober.go:28] interesting pod/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Sep 10 17:25:07.024897 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:07.024454    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn" podUID="48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Sep 10 17:25:07.242260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:07.242227    2576 patch_prober.go:28] interesting pod/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 10 17:25:07.242501 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:07.242477    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc" podUID="fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 10 17:25:08.023739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:08.023700    2576 patch_prober.go:28] interesting pod/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Sep 10 17:25:08.023923 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:08.023764    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn" podUID="48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Sep 10 17:25:08.245521 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:08.245488    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:25:08.245776 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:08.245753    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:25:08.246518 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:08.246497    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:25:09.027461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:09.027428    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:25:09.027916 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:09.027818    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:25:09.028451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:09.028431    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:25:12.640225 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:12.640192    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z"]
Sep 10 17:25:12.642757 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:12.642739    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z"
Sep 10 17:25:12.648364 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:12.648334    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4mln5\""
Sep 10 17:25:12.648481 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:12.648404    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 17:25:12.672604 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:12.672571    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z"]
Sep 10 17:25:12.738506 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:12.738470    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e284c49-04e3-45aa-866d-1b8814b084d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-99ff0092-5j89z\" (UID: \"1e284c49-04e3-45aa-866d-1b8814b084d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z"
Sep 10 17:25:12.839439 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:12.839394    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e284c49-04e3-45aa-866d-1b8814b084d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-99ff0092-5j89z\" (UID: \"1e284c49-04e3-45aa-866d-1b8814b084d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z"
Sep 10 17:25:12.840989 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:12.840639    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e284c49-04e3-45aa-866d-1b8814b084d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-99ff0092-5j89z\" (UID: \"1e284c49-04e3-45aa-866d-1b8814b084d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z"
Sep 10 17:25:12.953019 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:12.952929    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z"
Sep 10 17:25:13.257305 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:13.257228    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z"]
Sep 10 17:25:13.260304 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:25:13.260267    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e284c49_04e3_45aa_866d_1b8814b084d2.slice/crio-d29f0828e8c3ed4bd7bb23e95cf2ae53e6807947b6721a51c19424d71519e394 WatchSource:0}: Error finding container d29f0828e8c3ed4bd7bb23e95cf2ae53e6807947b6721a51c19424d71519e394: Status 404 returned error can't find the container with id d29f0828e8c3ed4bd7bb23e95cf2ae53e6807947b6721a51c19424d71519e394
Sep 10 17:25:13.550368 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:13.550283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z" event={"ID":"1e284c49-04e3-45aa-866d-1b8814b084d2","Type":"ContainerStarted","Data":"d29f0828e8c3ed4bd7bb23e95cf2ae53e6807947b6721a51c19424d71519e394"}
Sep 10 17:25:16.210438 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:16.210403    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:25:16.569493 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:16.569454    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z" event={"ID":"1e284c49-04e3-45aa-866d-1b8814b084d2","Type":"ContainerStarted","Data":"6b8e45b00e7caf6c56e36e62ab628f4ef4b079f2bf24b8b550c5e6d64fe8f6b4"}
Sep 10 17:25:16.588006 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:16.587954    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z" podStartSLOduration=2.05462292 podStartE2EDuration="4.587936829s" totalImagesPullingTime="2.533313909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:25:16.585394364 +0000 UTC m=+802.001445313" watchObservedRunningTime="2026-09-10 17:25:16.587936829 +0000 UTC m=+802.003987779"
Sep 10 17:25:17.575741 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:17.575648    2576 generic.go:356] "Generic (PLEG): container finished" podID="1e284c49-04e3-45aa-866d-1b8814b084d2" containerID="6b8e45b00e7caf6c56e36e62ab628f4ef4b079f2bf24b8b550c5e6d64fe8f6b4" exitCode=0
Sep 10 17:25:17.575741 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:17.575707    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z" event={"ID":"1e284c49-04e3-45aa-866d-1b8814b084d2","Type":"ContainerDied","Data":"6b8e45b00e7caf6c56e36e62ab628f4ef4b079f2bf24b8b550c5e6d64fe8f6b4"}
Sep 10 17:25:18.203769 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:18.203722    2576 patch_prober.go:28] interesting pod/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": read tcp 10.133.0.2:34118->10.133.0.31:15021: read: connection reset by peer" start-of-body=
Sep 10 17:25:18.203936 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:18.203795    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g" podUID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": read tcp 10.133.0.2:34118->10.133.0.31:15021: read: connection reset by peer"
Sep 10 17:25:18.582012 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:18.581924    2576 generic.go:356] "Generic (PLEG): container finished" podID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" containerID="963ad745491507d8dbc09e9dd37f5fab63d27f5a83f42331ff5025f0b920266e" exitCode=0
Sep 10 17:25:18.582451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:18.582006    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g" event={"ID":"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0","Type":"ContainerDied","Data":"963ad745491507d8dbc09e9dd37f5fab63d27f5a83f42331ff5025f0b920266e"}
Sep 10 17:25:18.582915 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:18.582547    2576 scope.go:117] "RemoveContainer" containerID="963ad745491507d8dbc09e9dd37f5fab63d27f5a83f42331ff5025f0b920266e"
Sep 10 17:25:18.583852 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:18.583807    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:18.583971 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:18.583900    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:18.583971 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:18.583950    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:18.729853 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:18.729825    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z"
Sep 10 17:25:18.793432 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:18.793405    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e284c49-04e3-45aa-866d-1b8814b084d2-maas-api-service-ca\") pod \"1e284c49-04e3-45aa-866d-1b8814b084d2\" (UID: \"1e284c49-04e3-45aa-866d-1b8814b084d2\") "
Sep 10 17:25:18.793761 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:18.793736    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e284c49-04e3-45aa-866d-1b8814b084d2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1e284c49-04e3-45aa-866d-1b8814b084d2" (UID: "1e284c49-04e3-45aa-866d-1b8814b084d2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:25:18.894107 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:18.894042    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e284c49-04e3-45aa-866d-1b8814b084d2-maas-api-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:25:19.591626 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:19.591585    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g" event={"ID":"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0","Type":"ContainerStarted","Data":"8e816ba18dd490d7acd3f04969b3102a54e246eb17c6eb666940182a41a768b5"}
Sep 10 17:25:19.593739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:19.593703    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z" event={"ID":"1e284c49-04e3-45aa-866d-1b8814b084d2","Type":"ContainerDied","Data":"d29f0828e8c3ed4bd7bb23e95cf2ae53e6807947b6721a51c19424d71519e394"}
Sep 10 17:25:19.593883 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:19.593760    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d29f0828e8c3ed4bd7bb23e95cf2ae53e6807947b6721a51c19424d71519e394"
Sep 10 17:25:19.593883 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:19.593818    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z"
Sep 10 17:25:19.595960 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:19.595930    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:19.596100 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:19.596061    2576 patch_prober.go:28] interesting pod/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 10 17:25:19.596205 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:19.596104    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g" podUID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 10 17:25:20.599657 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:20.599616    2576 patch_prober.go:28] interesting pod/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 10 17:25:20.600185 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:20.599727    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g" podUID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 10 17:25:21.595716 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:21.595669    2576 patch_prober.go:28] interesting pod/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 10 17:25:21.595927 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:21.595741    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g" podUID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 10 17:25:22.595846 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:22.595804    2576 patch_prober.go:28] interesting pod/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 10 17:25:22.596486 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:22.596454    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g" podUID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 10 17:25:23.596257 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:23.596209    2576 patch_prober.go:28] interesting pod/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 10 17:25:23.596725 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:23.596280    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g" podUID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 10 17:25:24.484472 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:24.484431    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z"]
Sep 10 17:25:24.497776 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:24.497740    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-99ff0092-5j89z"]
Sep 10 17:25:24.663229 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:24.663196    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"]
Sep 10 17:25:24.663704 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:24.663573    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc" podUID="fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" containerName="istio-proxy" containerID="cri-o://130465e83bf068bf4315714d223a56874cf18e185d2935a6ad99f9f162b03091" gracePeriod=30
Sep 10 17:25:24.666675 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:24.666429    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:24.667030 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:24.666975    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:24.668086 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:24.668065    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:25:25.085300 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.085266    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e284c49-04e3-45aa-866d-1b8814b084d2" path="/var/lib/kubelet/pods/1e284c49-04e3-45aa-866d-1b8814b084d2/volumes"
Sep 10 17:25:25.816194 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.816156    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"]
Sep 10 17:25:25.816566 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.816499    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e284c49-04e3-45aa-866d-1b8814b084d2" containerName="revoke-keys"
Sep 10 17:25:25.816566 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.816509    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e284c49-04e3-45aa-866d-1b8814b084d2" containerName="revoke-keys"
Sep 10 17:25:25.816566 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.816566    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e284c49-04e3-45aa-866d-1b8814b084d2" containerName="revoke-keys"
Sep 10 17:25:25.818576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.818557    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:25.823124 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.823096    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-53de5224-gw-openshift-default-dockercfg-5zv64\""
Sep 10 17:25:25.867717 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.867686    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"]
Sep 10 17:25:25.960772 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.960735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-workload-socket\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:25.960772 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.960767    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/445a9968-4922-4fcc-ac76-fe7891f87a25-istiod-ca-cert\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:25.960984 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.960796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-workload-certs\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:25.960984 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.960816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-data\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:25.960984 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.960924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-envoy\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:25.960984 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.960961    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-podinfo\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:25.961136 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.961014    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-token\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:25.961136 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.961043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwqr7\" (UniqueName: \"kubernetes.io/projected/445a9968-4922-4fcc-ac76-fe7891f87a25-kube-api-access-pwqr7\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:25.961136 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:25.961095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-credential-socket\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.062647 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.062608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-workload-socket\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.062856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.062660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/445a9968-4922-4fcc-ac76-fe7891f87a25-istiod-ca-cert\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.062856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.062704    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-workload-certs\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.062856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.062724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-data\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.062856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.062749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-envoy\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.062856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.062788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-podinfo\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.062856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.062837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-token\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.063218 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.062871    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwqr7\" (UniqueName: \"kubernetes.io/projected/445a9968-4922-4fcc-ac76-fe7891f87a25-kube-api-access-pwqr7\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.063218 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.062915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-credential-socket\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.063218 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.063047    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-workload-socket\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.063218 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.063159    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-workload-certs\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.063553 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.063219    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-data\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.063553 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.063393    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-credential-socket\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.063553 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.063476    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/445a9968-4922-4fcc-ac76-fe7891f87a25-istiod-ca-cert\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.065298 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.065279    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-envoy\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.065496 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.065479    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-podinfo\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.074356 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.074299    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-token\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.075647 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.075630    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwqr7\" (UniqueName: \"kubernetes.io/projected/445a9968-4922-4fcc-ac76-fe7891f87a25-kube-api-access-pwqr7\") pod \"e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") " pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.128928 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.128894    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:26.418625 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.418590    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"]
Sep 10 17:25:26.421431 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:25:26.421402    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445a9968_4922_4fcc_ac76_fe7891f87a25.slice/crio-3be843ec85da75373a14335c813dd760e493855c70141ec5e04795887adc2c74 WatchSource:0}: Error finding container 3be843ec85da75373a14335c813dd760e493855c70141ec5e04795887adc2c74: Status 404 returned error can't find the container with id 3be843ec85da75373a14335c813dd760e493855c70141ec5e04795887adc2c74
Sep 10 17:25:26.423581 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.423549    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:26.423673 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.423613    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:26.423673 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.423642    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:26.634154 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.634110    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9" event={"ID":"445a9968-4922-4fcc-ac76-fe7891f87a25","Type":"ContainerStarted","Data":"23abd07d0b7e7c1432da27c3be7bd37a3ef41706be52687eaff537aa84a23f06"}
Sep 10 17:25:26.634331 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.634166    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9" event={"ID":"445a9968-4922-4fcc-ac76-fe7891f87a25","Type":"ContainerStarted","Data":"3be843ec85da75373a14335c813dd760e493855c70141ec5e04795887adc2c74"}
Sep 10 17:25:26.690232 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:26.690126    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9" podStartSLOduration=1.69010124 podStartE2EDuration="1.69010124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:25:26.689324955 +0000 UTC m=+812.105375923" watchObservedRunningTime="2026-09-10 17:25:26.69010124 +0000 UTC m=+812.106152190"
Sep 10 17:25:27.129335 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:27.129303    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:27.134861 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:27.134835    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:27.638520 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:27.638492    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:27.639536 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:27.639517    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:29.911435 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:29.911410    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:25:30.017442 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.017367    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"]
Sep 10 17:25:30.017705 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.017692    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" containerName="istio-proxy"
Sep 10 17:25:30.017749 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.017706    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" containerName="istio-proxy"
Sep 10 17:25:30.017783 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.017767    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" containerName="istio-proxy"
Sep 10 17:25:30.017783 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.017775    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" containerName="istio-proxy"
Sep 10 17:25:30.019676 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.019660    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"
Sep 10 17:25:30.025142 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.025119    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-53de5224\""
Sep 10 17:25:30.025289 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.025272    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-53de5224-dockercfg-f8rsl\""
Sep 10 17:25:30.047595 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.047562    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"]
Sep 10 17:25:30.102300 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102270    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-workload-certs\") pod \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") "
Sep 10 17:25:30.102470 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102329    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-envoy\") pod \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") "
Sep 10 17:25:30.102470 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102357    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-podinfo\") pod \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") "
Sep 10 17:25:30.102470 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102382    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-workload-socket\") pod \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") "
Sep 10 17:25:30.102470 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102415    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-credential-socket\") pod \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") "
Sep 10 17:25:30.102470 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102446    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdndh\" (UniqueName: \"kubernetes.io/projected/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-kube-api-access-mdndh\") pod \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") "
Sep 10 17:25:30.102712 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102473    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istiod-ca-cert\") pod \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") "
Sep 10 17:25:30.102712 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102535    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-token\") pod \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") "
Sep 10 17:25:30.102712 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102588    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-data\") pod \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\" (UID: \"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04\") "
Sep 10 17:25:30.102712 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102604    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" (UID: "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:25:30.102712 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102642    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" (UID: "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:25:30.102712 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102685    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" (UID: "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:25:30.102992 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102829    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-data" (OuterVolumeSpecName: "istio-data") pod "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" (UID: "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:25:30.102992 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102905    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:25:30.102992 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102917    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" (UID: "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:25:30.102992 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102922    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:25:30.102992 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102954    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:25:30.102992 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.102974    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:25:30.104593 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.104565    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" (UID: "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:25:30.104708 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.104618    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-token" (OuterVolumeSpecName: "istio-token") pod "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" (UID: "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:25:30.104990 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.104969    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" (UID: "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:25:30.104990 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.104975    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-kube-api-access-mdndh" (OuterVolumeSpecName: "kube-api-access-mdndh") pod "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" (UID: "fbe28fe7-67bd-458a-b0fb-9bfe1197fc04"). InnerVolumeSpecName "kube-api-access-mdndh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:25:30.203482 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.203445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vzsm\" (UniqueName: \"kubernetes.io/projected/f0d44fe4-0589-406e-8c6d-8187a112de2c-kube-api-access-6vzsm\") pod \"payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt\" (UID: \"f0d44fe4-0589-406e-8c6d-8187a112de2c\") " pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"
Sep 10 17:25:30.203672 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.203511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0d44fe4-0589-406e-8c6d-8187a112de2c-plugins-config-volume\") pod \"payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt\" (UID: \"f0d44fe4-0589-406e-8c6d-8187a112de2c\") " pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"
Sep 10 17:25:30.203672 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.203580    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:25:30.203672 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.203594    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:25:30.203672 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.203644    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:25:30.203672 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.203675    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:25:30.203877 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.203691    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdndh\" (UniqueName: \"kubernetes.io/projected/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04-kube-api-access-mdndh\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:25:30.305187 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.305105    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vzsm\" (UniqueName: \"kubernetes.io/projected/f0d44fe4-0589-406e-8c6d-8187a112de2c-kube-api-access-6vzsm\") pod \"payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt\" (UID: \"f0d44fe4-0589-406e-8c6d-8187a112de2c\") " pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"
Sep 10 17:25:30.305187 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.305155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0d44fe4-0589-406e-8c6d-8187a112de2c-plugins-config-volume\") pod \"payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt\" (UID: \"f0d44fe4-0589-406e-8c6d-8187a112de2c\") " pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"
Sep 10 17:25:30.305841 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.305820    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0d44fe4-0589-406e-8c6d-8187a112de2c-plugins-config-volume\") pod \"payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt\" (UID: \"f0d44fe4-0589-406e-8c6d-8187a112de2c\") " pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"
Sep 10 17:25:30.325866 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.325839    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vzsm\" (UniqueName: \"kubernetes.io/projected/f0d44fe4-0589-406e-8c6d-8187a112de2c-kube-api-access-6vzsm\") pod \"payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt\" (UID: \"f0d44fe4-0589-406e-8c6d-8187a112de2c\") " pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"
Sep 10 17:25:30.329656 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.329633    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"
Sep 10 17:25:30.656214 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.656181    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"]
Sep 10 17:25:30.658207 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.658181    2576 generic.go:356] "Generic (PLEG): container finished" podID="fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" containerID="130465e83bf068bf4315714d223a56874cf18e185d2935a6ad99f9f162b03091" exitCode=0
Sep 10 17:25:30.658354 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.658231    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"
Sep 10 17:25:30.658354 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.658255    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc" event={"ID":"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04","Type":"ContainerDied","Data":"130465e83bf068bf4315714d223a56874cf18e185d2935a6ad99f9f162b03091"}
Sep 10 17:25:30.658354 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.658303    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc" event={"ID":"fbe28fe7-67bd-458a-b0fb-9bfe1197fc04","Type":"ContainerDied","Data":"8f4d71d38e8a7e4dd4324bfc541b32e278311a4bf0e5ca591883de1e4cc56587"}
Sep 10 17:25:30.658354 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.658328    2576 scope.go:117] "RemoveContainer" containerID="130465e83bf068bf4315714d223a56874cf18e185d2935a6ad99f9f162b03091"
Sep 10 17:25:30.667407 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.667387    2576 scope.go:117] "RemoveContainer" containerID="05ae305a576088b5b23e532067711f91fec693d9200d13fc6890d0d32bd0e2fa"
Sep 10 17:25:30.674834 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.674819    2576 scope.go:117] "RemoveContainer" containerID="130465e83bf068bf4315714d223a56874cf18e185d2935a6ad99f9f162b03091"
Sep 10 17:25:30.675104 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:25:30.675087    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"130465e83bf068bf4315714d223a56874cf18e185d2935a6ad99f9f162b03091\": container with ID starting with 130465e83bf068bf4315714d223a56874cf18e185d2935a6ad99f9f162b03091 not found: ID does not exist" containerID="130465e83bf068bf4315714d223a56874cf18e185d2935a6ad99f9f162b03091"
Sep 10 17:25:30.675153 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.675113    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"130465e83bf068bf4315714d223a56874cf18e185d2935a6ad99f9f162b03091"} err="failed to get container status \"130465e83bf068bf4315714d223a56874cf18e185d2935a6ad99f9f162b03091\": rpc error: code = NotFound desc = could not find container \"130465e83bf068bf4315714d223a56874cf18e185d2935a6ad99f9f162b03091\": container with ID starting with 130465e83bf068bf4315714d223a56874cf18e185d2935a6ad99f9f162b03091 not found: ID does not exist"
Sep 10 17:25:30.675153 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.675134    2576 scope.go:117] "RemoveContainer" containerID="05ae305a576088b5b23e532067711f91fec693d9200d13fc6890d0d32bd0e2fa"
Sep 10 17:25:30.675391 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:25:30.675374    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05ae305a576088b5b23e532067711f91fec693d9200d13fc6890d0d32bd0e2fa\": container with ID starting with 05ae305a576088b5b23e532067711f91fec693d9200d13fc6890d0d32bd0e2fa not found: ID does not exist" containerID="05ae305a576088b5b23e532067711f91fec693d9200d13fc6890d0d32bd0e2fa"
Sep 10 17:25:30.675449 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.675393    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05ae305a576088b5b23e532067711f91fec693d9200d13fc6890d0d32bd0e2fa"} err="failed to get container status \"05ae305a576088b5b23e532067711f91fec693d9200d13fc6890d0d32bd0e2fa\": rpc error: code = NotFound desc = could not find container \"05ae305a576088b5b23e532067711f91fec693d9200d13fc6890d0d32bd0e2fa\": container with ID starting with 05ae305a576088b5b23e532067711f91fec693d9200d13fc6890d0d32bd0e2fa not found: ID does not exist"
Sep 10 17:25:30.681531 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:25:30.681505    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0d44fe4_0589_406e_8c6d_8187a112de2c.slice/crio-d09401bc3b258d934352569bd96a084e4824e7b23728ca12ceca7d0a9a984ac8 WatchSource:0}: Error finding container d09401bc3b258d934352569bd96a084e4824e7b23728ca12ceca7d0a9a984ac8: Status 404 returned error can't find the container with id d09401bc3b258d934352569bd96a084e4824e7b23728ca12ceca7d0a9a984ac8
Sep 10 17:25:30.705900 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.705875    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"]
Sep 10 17:25:30.708874 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:30.708853    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-99ff0092-openshift-default-5d6ff94b78-6vpzc"]
Sep 10 17:25:31.084579 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:31.084502    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" path="/var/lib/kubelet/pods/fbe28fe7-67bd-458a-b0fb-9bfe1197fc04/volumes"
Sep 10 17:25:31.668046 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:31.668010    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt" event={"ID":"f0d44fe4-0589-406e-8c6d-8187a112de2c","Type":"ContainerStarted","Data":"d09401bc3b258d934352569bd96a084e4824e7b23728ca12ceca7d0a9a984ac8"}
Sep 10 17:25:32.264387 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:32.264352    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:25:32.674793 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:32.674747    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt" event={"ID":"f0d44fe4-0589-406e-8c6d-8187a112de2c","Type":"ContainerStarted","Data":"cad0ef2dc803e0b6f0f4e7060bfe6dbb546d09e6b601c248f86fd479af81a843"}
Sep 10 17:25:32.674965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:32.674883    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"
Sep 10 17:25:32.703364 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:32.703300    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt" podStartSLOduration=2.07120131 podStartE2EDuration="3.703284008s" totalImagesPullingTime="1.632082698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:25:32.703138751 +0000 UTC m=+818.119189700" watchObservedRunningTime="2026-09-10 17:25:32.703284008 +0000 UTC m=+818.119334958"
Sep 10 17:25:42.852159 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:42.852122    2576 patch_prober.go:28] interesting pod/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": read tcp 10.133.0.2:53562->10.133.0.33:15021: read: connection reset by peer" start-of-body=
Sep 10 17:25:42.852543 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:42.852188    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9" podUID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": read tcp 10.133.0.2:53562->10.133.0.33:15021: read: connection reset by peer"
Sep 10 17:25:43.681601 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:43.681563    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"
Sep 10 17:25:43.743846 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:43.743814    2576 generic.go:356] "Generic (PLEG): container finished" podID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerID="23abd07d0b7e7c1432da27c3be7bd37a3ef41706be52687eaff537aa84a23f06" exitCode=0
Sep 10 17:25:43.744008 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:43.743879    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9" event={"ID":"445a9968-4922-4fcc-ac76-fe7891f87a25","Type":"ContainerDied","Data":"23abd07d0b7e7c1432da27c3be7bd37a3ef41706be52687eaff537aa84a23f06"}
Sep 10 17:25:43.744282 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:43.744266    2576 scope.go:117] "RemoveContainer" containerID="23abd07d0b7e7c1432da27c3be7bd37a3ef41706be52687eaff537aa84a23f06"
Sep 10 17:25:43.745356 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:43.745325    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:43.745463 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:43.745413    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:43.745526 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:43.745463    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:25:44.750607 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:44.750572    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9" event={"ID":"445a9968-4922-4fcc-ac76-fe7891f87a25","Type":"ContainerStarted","Data":"6e6b1f578ff5ce9ad3025f9b6bf1b0f849c4dd69211ffe5c64bef4333ebe6dcf"}
Sep 10 17:25:45.129221 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:45.129185    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:45.129407 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:45.129363    2576 patch_prober.go:28] interesting pod/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 10 17:25:45.129454 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:45.129411    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9" podUID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 10 17:25:46.129732 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:46.129696    2576 patch_prober.go:28] interesting pod/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 10 17:25:46.130157 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:46.129744    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9" podUID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 10 17:25:47.129439 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:47.129404    2576 patch_prober.go:28] interesting pod/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 10 17:25:47.129611 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:47.129458    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9" podUID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 10 17:25:48.129800 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:48.129760    2576 patch_prober.go:28] interesting pod/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 10 17:25:48.130226 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:48.129817    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9" podUID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 10 17:25:49.129723 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:49.129687    2576 patch_prober.go:28] interesting pod/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 10 17:25:49.129900 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:49.129741    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9" podUID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 10 17:25:50.129813 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:50.129769    2576 patch_prober.go:28] interesting pod/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Sep 10 17:25:50.129998 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:50.129835    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9" podUID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Sep 10 17:25:51.143534 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:51.143501    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:51.143901 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:51.143860    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:51.144609 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:51.144594    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:25:53.061561 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.061530    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"]
Sep 10 17:25:53.061916 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.061868    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" containerName="istio-proxy"
Sep 10 17:25:53.061916 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.061879    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe28fe7-67bd-458a-b0fb-9bfe1197fc04" containerName="istio-proxy"
Sep 10 17:25:53.064772 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.064757    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.067905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.067886    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-171e086f-kserve-self-signed-certs\""
Sep 10 17:25:53.075824 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.075799    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"]
Sep 10 17:25:53.085461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.085434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkr9m\" (UniqueName: \"kubernetes.io/projected/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-kube-api-access-pkr9m\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.085592 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.085466    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-tmp-dir\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.085592 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.085495    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-home\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.085727 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.085593    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-model-cache\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.085727 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.085635    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-dshm\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.085727 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.085675    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-tls-certs\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.186895 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.186855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-model-cache\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.186895 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.186903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-dshm\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.187182 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.186937    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-tls-certs\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.187182 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.187003    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkr9m\" (UniqueName: \"kubernetes.io/projected/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-kube-api-access-pkr9m\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.187182 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.187036    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-tmp-dir\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.187182 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.187084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-home\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.187419 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.187389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-model-cache\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.187484 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.187437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-tmp-dir\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.187540 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.187490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-home\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.189234 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.189212    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-dshm\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.189526 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.189506    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-tls-certs\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.196782 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.196761    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkr9m\" (UniqueName: \"kubernetes.io/projected/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-kube-api-access-pkr9m\") pod \"e2e-conflict-a-171e086f-kserve-85577b75b7-778z9\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") " pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.332898 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.332809    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc"]
Sep 10 17:25:53.336359 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.336336    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc"
Sep 10 17:25:53.338628 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.338608    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 17:25:53.338746 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.338636    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4mln5\""
Sep 10 17:25:53.346037 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.346015    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc"]
Sep 10 17:25:53.374849 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.374824    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:25:53.388732 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.388689    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91360d9a-cfa8-43eb-a658-9a74576235d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc\" (UID: \"91360d9a-cfa8-43eb-a658-9a74576235d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc"
Sep 10 17:25:53.489958 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.489920    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91360d9a-cfa8-43eb-a658-9a74576235d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc\" (UID: \"91360d9a-cfa8-43eb-a658-9a74576235d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc"
Sep 10 17:25:53.490546 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.490527    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91360d9a-cfa8-43eb-a658-9a74576235d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc\" (UID: \"91360d9a-cfa8-43eb-a658-9a74576235d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc"
Sep 10 17:25:53.648020 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.647983    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc"
Sep 10 17:25:53.662337 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.662314    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"]
Sep 10 17:25:53.664723 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:25:53.664700    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4bc021d_d697_4a45_8f1d_b81c88d3b8a5.slice/crio-01d24f4f6ecd373e99c6a32fc7dd2fb7d7124ab5239a59207d6b169f9c8a931f WatchSource:0}: Error finding container 01d24f4f6ecd373e99c6a32fc7dd2fb7d7124ab5239a59207d6b169f9c8a931f: Status 404 returned error can't find the container with id 01d24f4f6ecd373e99c6a32fc7dd2fb7d7124ab5239a59207d6b169f9c8a931f
Sep 10 17:25:53.797757 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.797725    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9" event={"ID":"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5","Type":"ContainerStarted","Data":"9132b0d9fdf41fbcc2085b893b35fd79686134494fcb50b189eef3b25b4e5f86"}
Sep 10 17:25:53.797918 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.797766    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9" event={"ID":"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5","Type":"ContainerStarted","Data":"01d24f4f6ecd373e99c6a32fc7dd2fb7d7124ab5239a59207d6b169f9c8a931f"}
Sep 10 17:25:53.818823 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.818768    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9" podStartSLOduration=0.818748964 podStartE2EDuration="818.748964ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:25:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:25:53.817103573 +0000 UTC m=+839.233154524" watchObservedRunningTime="2026-09-10 17:25:53.818748964 +0000 UTC m=+839.234799912"
Sep 10 17:25:53.924139 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:53.924110    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc"]
Sep 10 17:25:54.804482 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:54.804450    2576 generic.go:356] "Generic (PLEG): container finished" podID="91360d9a-cfa8-43eb-a658-9a74576235d9" containerID="55d2c8b14668936b2f51754ecda08c24e7863d053e57055a6f07361187113488" exitCode=0
Sep 10 17:25:54.804875 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:54.804543    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc" event={"ID":"91360d9a-cfa8-43eb-a658-9a74576235d9","Type":"ContainerDied","Data":"55d2c8b14668936b2f51754ecda08c24e7863d053e57055a6f07361187113488"}
Sep 10 17:25:54.804875 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:54.804626    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc" event={"ID":"91360d9a-cfa8-43eb-a658-9a74576235d9","Type":"ContainerStarted","Data":"1679f743fd7c520c828fc6a95641862aa00d95644db978f361aa34626a2983de"}
Sep 10 17:25:55.943199 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:55.943173    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc"
Sep 10 17:25:56.012959 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:56.012920    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91360d9a-cfa8-43eb-a658-9a74576235d9-maas-api-service-ca\") pod \"91360d9a-cfa8-43eb-a658-9a74576235d9\" (UID: \"91360d9a-cfa8-43eb-a658-9a74576235d9\") "
Sep 10 17:25:56.013303 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:56.013280    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91360d9a-cfa8-43eb-a658-9a74576235d9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "91360d9a-cfa8-43eb-a658-9a74576235d9" (UID: "91360d9a-cfa8-43eb-a658-9a74576235d9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:25:56.113691 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:56.113603    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91360d9a-cfa8-43eb-a658-9a74576235d9-maas-api-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:25:56.815393 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:56.815360    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc" event={"ID":"91360d9a-cfa8-43eb-a658-9a74576235d9","Type":"ContainerDied","Data":"1679f743fd7c520c828fc6a95641862aa00d95644db978f361aa34626a2983de"}
Sep 10 17:25:56.815393 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:56.815381    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc"
Sep 10 17:25:56.815601 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:56.815408    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1679f743fd7c520c828fc6a95641862aa00d95644db978f361aa34626a2983de"
Sep 10 17:25:59.407658 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:59.407621    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:25:59.747231 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:59.747156    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"]
Sep 10 17:25:59.747446 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:25:59.747400    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt" podUID="f0d44fe4-0589-406e-8c6d-8187a112de2c" containerName="payload-processing" containerID="cri-o://cad0ef2dc803e0b6f0f4e7060bfe6dbb546d09e6b601c248f86fd479af81a843" gracePeriod=30
Sep 10 17:26:00.014272 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.014199    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"
Sep 10 17:26:00.131974 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.131937    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc"]
Sep 10 17:26:00.134815 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.134788    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-53de5224-rvpfc"]
Sep 10 17:26:00.159813 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.159778    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0d44fe4-0589-406e-8c6d-8187a112de2c-plugins-config-volume\") pod \"f0d44fe4-0589-406e-8c6d-8187a112de2c\" (UID: \"f0d44fe4-0589-406e-8c6d-8187a112de2c\") "
Sep 10 17:26:00.159813 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.159817    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vzsm\" (UniqueName: \"kubernetes.io/projected/f0d44fe4-0589-406e-8c6d-8187a112de2c-kube-api-access-6vzsm\") pod \"f0d44fe4-0589-406e-8c6d-8187a112de2c\" (UID: \"f0d44fe4-0589-406e-8c6d-8187a112de2c\") "
Sep 10 17:26:00.160249 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.160229    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0d44fe4-0589-406e-8c6d-8187a112de2c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f0d44fe4-0589-406e-8c6d-8187a112de2c" (UID: "f0d44fe4-0589-406e-8c6d-8187a112de2c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:26:00.161965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.161939    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0d44fe4-0589-406e-8c6d-8187a112de2c-kube-api-access-6vzsm" (OuterVolumeSpecName: "kube-api-access-6vzsm") pod "f0d44fe4-0589-406e-8c6d-8187a112de2c" (UID: "f0d44fe4-0589-406e-8c6d-8187a112de2c"). InnerVolumeSpecName "kube-api-access-6vzsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:26:00.260681 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.260647    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0d44fe4-0589-406e-8c6d-8187a112de2c-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:00.260681 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.260674    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vzsm\" (UniqueName: \"kubernetes.io/projected/f0d44fe4-0589-406e-8c6d-8187a112de2c-kube-api-access-6vzsm\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:00.385954 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.385921    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"]
Sep 10 17:26:00.386153 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.386132    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9" podUID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerName="istio-proxy" containerID="cri-o://6e6b1f578ff5ce9ad3025f9b6bf1b0f849c4dd69211ffe5c64bef4333ebe6dcf" gracePeriod=30
Sep 10 17:26:00.836853 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.836766    2576 generic.go:356] "Generic (PLEG): container finished" podID="f0d44fe4-0589-406e-8c6d-8187a112de2c" containerID="cad0ef2dc803e0b6f0f4e7060bfe6dbb546d09e6b601c248f86fd479af81a843" exitCode=0
Sep 10 17:26:00.836853 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.836823    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"
Sep 10 17:26:00.837354 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.836851    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt" event={"ID":"f0d44fe4-0589-406e-8c6d-8187a112de2c","Type":"ContainerDied","Data":"cad0ef2dc803e0b6f0f4e7060bfe6dbb546d09e6b601c248f86fd479af81a843"}
Sep 10 17:26:00.837354 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.836911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt" event={"ID":"f0d44fe4-0589-406e-8c6d-8187a112de2c","Type":"ContainerDied","Data":"d09401bc3b258d934352569bd96a084e4824e7b23728ca12ceca7d0a9a984ac8"}
Sep 10 17:26:00.837354 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.836938    2576 scope.go:117] "RemoveContainer" containerID="cad0ef2dc803e0b6f0f4e7060bfe6dbb546d09e6b601c248f86fd479af81a843"
Sep 10 17:26:00.845719 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.845697    2576 scope.go:117] "RemoveContainer" containerID="cad0ef2dc803e0b6f0f4e7060bfe6dbb546d09e6b601c248f86fd479af81a843"
Sep 10 17:26:00.845999 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:26:00.845976    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad0ef2dc803e0b6f0f4e7060bfe6dbb546d09e6b601c248f86fd479af81a843\": container with ID starting with cad0ef2dc803e0b6f0f4e7060bfe6dbb546d09e6b601c248f86fd479af81a843 not found: ID does not exist" containerID="cad0ef2dc803e0b6f0f4e7060bfe6dbb546d09e6b601c248f86fd479af81a843"
Sep 10 17:26:00.846062 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.846013    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad0ef2dc803e0b6f0f4e7060bfe6dbb546d09e6b601c248f86fd479af81a843"} err="failed to get container status \"cad0ef2dc803e0b6f0f4e7060bfe6dbb546d09e6b601c248f86fd479af81a843\": rpc error: code = NotFound desc = could not find container \"cad0ef2dc803e0b6f0f4e7060bfe6dbb546d09e6b601c248f86fd479af81a843\": container with ID starting with cad0ef2dc803e0b6f0f4e7060bfe6dbb546d09e6b601c248f86fd479af81a843 not found: ID does not exist"
Sep 10 17:26:00.865588 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.865548    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"]
Sep 10 17:26:00.872776 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:00.872751    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-53de5224-ddc49db46-7hplt"]
Sep 10 17:26:01.084554 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.084522    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91360d9a-cfa8-43eb-a658-9a74576235d9" path="/var/lib/kubelet/pods/91360d9a-cfa8-43eb-a658-9a74576235d9/volumes"
Sep 10 17:26:01.084911 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.084898    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0d44fe4-0589-406e-8c6d-8187a112de2c" path="/var/lib/kubelet/pods/f0d44fe4-0589-406e-8c6d-8187a112de2c/volumes"
Sep 10 17:26:01.147807 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.147775    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"]
Sep 10 17:26:01.148136 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.148123    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91360d9a-cfa8-43eb-a658-9a74576235d9" containerName="revoke-keys"
Sep 10 17:26:01.148194 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.148137    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="91360d9a-cfa8-43eb-a658-9a74576235d9" containerName="revoke-keys"
Sep 10 17:26:01.148194 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.148151    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0d44fe4-0589-406e-8c6d-8187a112de2c" containerName="payload-processing"
Sep 10 17:26:01.148194 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.148156    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0d44fe4-0589-406e-8c6d-8187a112de2c" containerName="payload-processing"
Sep 10 17:26:01.148290 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.148222    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0d44fe4-0589-406e-8c6d-8187a112de2c" containerName="payload-processing"
Sep 10 17:26:01.148290 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.148229    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="91360d9a-cfa8-43eb-a658-9a74576235d9" containerName="revoke-keys"
Sep 10 17:26:01.152415 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.152395    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.155027 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.155004    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4240652e-openshift-default-dockercfg-px4lm\""
Sep 10 17:26:01.172643 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.172618    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"]
Sep 10 17:26:01.269867 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.269835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-workload-socket\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.270135 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.269874    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-podinfo\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.270135 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.269910    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-credential-socket\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.270135 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.269925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-data\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.270135 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.269971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istiod-ca-cert\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.270135 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.270025    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjr2t\" (UniqueName: \"kubernetes.io/projected/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-kube-api-access-rjr2t\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.270135 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.270111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-workload-certs\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.270135 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.270130    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-token\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.270372 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.270189    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-envoy\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.371017 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.370978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-workload-certs\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.371017 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.371018    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-token\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.371280 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.371185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-envoy\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.371280 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.371254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-workload-socket\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.371402 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.371286    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-podinfo\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.371402 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.371346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-credential-socket\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.371402 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.371393    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-data\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.371551 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.371400    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-workload-certs\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.371551 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.371430    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istiod-ca-cert\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.371551 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.371482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjr2t\" (UniqueName: \"kubernetes.io/projected/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-kube-api-access-rjr2t\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.371696 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.371616    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-workload-socket\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.371696 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.371635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-data\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.371790 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.371728    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-credential-socket\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.372143 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.372122    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istiod-ca-cert\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.373363 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.373344    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-envoy\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.373732 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.373713    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-podinfo\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.379272 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.379248    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-token\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.381416 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.381383    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjr2t\" (UniqueName: \"kubernetes.io/projected/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-kube-api-access-rjr2t\") pod \"e2e-ait-4240652e-openshift-default-599fb7b648-t6bct\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") " pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.462782 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.462695    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:01.742516 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.742489    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"]
Sep 10 17:26:01.744745 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:26:01.744717    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ddb7a0_3f46_45f3_9256_bdcabca6d666.slice/crio-387643a9e96ff156d8400f90115ef681d4f9d7bc9fc3e6b0e4a6c9cb83d1e4fc WatchSource:0}: Error finding container 387643a9e96ff156d8400f90115ef681d4f9d7bc9fc3e6b0e4a6c9cb83d1e4fc: Status 404 returned error can't find the container with id 387643a9e96ff156d8400f90115ef681d4f9d7bc9fc3e6b0e4a6c9cb83d1e4fc
Sep 10 17:26:01.747267 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.747235    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:26:01.747373 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.747301    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:26:01.747373 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.747328    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:26:01.844903 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.844854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct" event={"ID":"f4ddb7a0-3f46-45f3-9256-bdcabca6d666","Type":"ContainerStarted","Data":"ab8a659f5e268f5036d478766e3bc472f02f8deec840a7bf002e7b352fcaf132"}
Sep 10 17:26:01.845376 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.844925    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct" event={"ID":"f4ddb7a0-3f46-45f3-9256-bdcabca6d666","Type":"ContainerStarted","Data":"387643a9e96ff156d8400f90115ef681d4f9d7bc9fc3e6b0e4a6c9cb83d1e4fc"}
Sep 10 17:26:01.877587 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:01.877528    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct" podStartSLOduration=0.877507035 podStartE2EDuration="877.507035ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:26:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:01.874763248 +0000 UTC m=+847.290814192" watchObservedRunningTime="2026-09-10 17:26:01.877507035 +0000 UTC m=+847.293557986"
Sep 10 17:26:02.463624 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:02.463584    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:02.468715 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:02.468689    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:02.850948 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:02.850860    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:02.851980 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:02.851963    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:03.375629 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:03.375591    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:26:03.375813 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:03.375648    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:26:03.388135 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:03.388106    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:26:03.866714 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:03.866627    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:26:05.299719 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.299680    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"]
Sep 10 17:26:05.303106 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.303088    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"
Sep 10 17:26:05.305537 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.305520    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4240652e\""
Sep 10 17:26:05.313398 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.313374    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"]
Sep 10 17:26:05.414639 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.414604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkrv2\" (UniqueName: \"kubernetes.io/projected/a23b6ceb-2fb8-4111-b469-de6b606aca9a-kube-api-access-xkrv2\") pod \"payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649\" (UID: \"a23b6ceb-2fb8-4111-b469-de6b606aca9a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"
Sep 10 17:26:05.414769 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.414747    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a23b6ceb-2fb8-4111-b469-de6b606aca9a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649\" (UID: \"a23b6ceb-2fb8-4111-b469-de6b606aca9a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"
Sep 10 17:26:05.449605 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.449556    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"]
Sep 10 17:26:05.453491 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.453470    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"
Sep 10 17:26:05.456511 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.456490    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-4240652e-dockercfg-4wmrp\""
Sep 10 17:26:05.464390 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.464367    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"]
Sep 10 17:26:05.515990 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.515960    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkrv2\" (UniqueName: \"kubernetes.io/projected/a23b6ceb-2fb8-4111-b469-de6b606aca9a-kube-api-access-xkrv2\") pod \"payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649\" (UID: \"a23b6ceb-2fb8-4111-b469-de6b606aca9a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"
Sep 10 17:26:05.516162 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.516027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d463296d-8190-4f11-bb56-416e65394b24-plugins-config-volume\") pod \"payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d\" (UID: \"d463296d-8190-4f11-bb56-416e65394b24\") " pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"
Sep 10 17:26:05.516162 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.516087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmn6v\" (UniqueName: \"kubernetes.io/projected/d463296d-8190-4f11-bb56-416e65394b24-kube-api-access-wmn6v\") pod \"payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d\" (UID: \"d463296d-8190-4f11-bb56-416e65394b24\") " pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"
Sep 10 17:26:05.516311 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.516283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a23b6ceb-2fb8-4111-b469-de6b606aca9a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649\" (UID: \"a23b6ceb-2fb8-4111-b469-de6b606aca9a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"
Sep 10 17:26:05.517344 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.517319    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a23b6ceb-2fb8-4111-b469-de6b606aca9a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649\" (UID: \"a23b6ceb-2fb8-4111-b469-de6b606aca9a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"
Sep 10 17:26:05.524979 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.524954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkrv2\" (UniqueName: \"kubernetes.io/projected/a23b6ceb-2fb8-4111-b469-de6b606aca9a-kube-api-access-xkrv2\") pod \"payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649\" (UID: \"a23b6ceb-2fb8-4111-b469-de6b606aca9a\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"
Sep 10 17:26:05.614322 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.614280    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"
Sep 10 17:26:05.617122 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.617093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d463296d-8190-4f11-bb56-416e65394b24-plugins-config-volume\") pod \"payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d\" (UID: \"d463296d-8190-4f11-bb56-416e65394b24\") " pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"
Sep 10 17:26:05.617122 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.617124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmn6v\" (UniqueName: \"kubernetes.io/projected/d463296d-8190-4f11-bb56-416e65394b24-kube-api-access-wmn6v\") pod \"payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d\" (UID: \"d463296d-8190-4f11-bb56-416e65394b24\") " pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"
Sep 10 17:26:05.617990 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.617951    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d463296d-8190-4f11-bb56-416e65394b24-plugins-config-volume\") pod \"payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d\" (UID: \"d463296d-8190-4f11-bb56-416e65394b24\") " pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"
Sep 10 17:26:05.627542 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.627516    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmn6v\" (UniqueName: \"kubernetes.io/projected/d463296d-8190-4f11-bb56-416e65394b24-kube-api-access-wmn6v\") pod \"payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d\" (UID: \"d463296d-8190-4f11-bb56-416e65394b24\") " pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"
Sep 10 17:26:05.646890 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.646859    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:26:05.718281 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.718249    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-envoy\") pod \"445a9968-4922-4fcc-ac76-fe7891f87a25\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") "
Sep 10 17:26:05.718281 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.718288    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-podinfo\") pod \"445a9968-4922-4fcc-ac76-fe7891f87a25\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") "
Sep 10 17:26:05.718528 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.718304    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-credential-socket\") pod \"445a9968-4922-4fcc-ac76-fe7891f87a25\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") "
Sep 10 17:26:05.718528 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.718329    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-data\") pod \"445a9968-4922-4fcc-ac76-fe7891f87a25\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") "
Sep 10 17:26:05.718528 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.718374    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwqr7\" (UniqueName: \"kubernetes.io/projected/445a9968-4922-4fcc-ac76-fe7891f87a25-kube-api-access-pwqr7\") pod \"445a9968-4922-4fcc-ac76-fe7891f87a25\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") "
Sep 10 17:26:05.718528 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.718402    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-workload-socket\") pod \"445a9968-4922-4fcc-ac76-fe7891f87a25\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") "
Sep 10 17:26:05.718528 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.718467    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-workload-certs\") pod \"445a9968-4922-4fcc-ac76-fe7891f87a25\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") "
Sep 10 17:26:05.718528 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.718494    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-token\") pod \"445a9968-4922-4fcc-ac76-fe7891f87a25\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") "
Sep 10 17:26:05.718528 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.718529    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/445a9968-4922-4fcc-ac76-fe7891f87a25-istiod-ca-cert\") pod \"445a9968-4922-4fcc-ac76-fe7891f87a25\" (UID: \"445a9968-4922-4fcc-ac76-fe7891f87a25\") "
Sep 10 17:26:05.718825 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.718635    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "445a9968-4922-4fcc-ac76-fe7891f87a25" (UID: "445a9968-4922-4fcc-ac76-fe7891f87a25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:26:05.718825 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.718688    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-data" (OuterVolumeSpecName: "istio-data") pod "445a9968-4922-4fcc-ac76-fe7891f87a25" (UID: "445a9968-4922-4fcc-ac76-fe7891f87a25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:26:05.718903 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.718834    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "445a9968-4922-4fcc-ac76-fe7891f87a25" (UID: "445a9968-4922-4fcc-ac76-fe7891f87a25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:26:05.718989 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.718970    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:05.719046 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.718995    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:05.719046 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.718999    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/445a9968-4922-4fcc-ac76-fe7891f87a25-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "445a9968-4922-4fcc-ac76-fe7891f87a25" (UID: "445a9968-4922-4fcc-ac76-fe7891f87a25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:26:05.719046 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.719012    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:05.719178 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.719107    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "445a9968-4922-4fcc-ac76-fe7891f87a25" (UID: "445a9968-4922-4fcc-ac76-fe7891f87a25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:26:05.721164 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.721139    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "445a9968-4922-4fcc-ac76-fe7891f87a25" (UID: "445a9968-4922-4fcc-ac76-fe7891f87a25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:26:05.721281 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.721265    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/445a9968-4922-4fcc-ac76-fe7891f87a25-kube-api-access-pwqr7" (OuterVolumeSpecName: "kube-api-access-pwqr7") pod "445a9968-4922-4fcc-ac76-fe7891f87a25" (UID: "445a9968-4922-4fcc-ac76-fe7891f87a25"). InnerVolumeSpecName "kube-api-access-pwqr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:26:05.721835 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.721801    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "445a9968-4922-4fcc-ac76-fe7891f87a25" (UID: "445a9968-4922-4fcc-ac76-fe7891f87a25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:26:05.721835 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.721801    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-token" (OuterVolumeSpecName: "istio-token") pod "445a9968-4922-4fcc-ac76-fe7891f87a25" (UID: "445a9968-4922-4fcc-ac76-fe7891f87a25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:26:05.764287 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.764243    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"
Sep 10 17:26:05.820517 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.819901    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:05.820517 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.819938    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:05.820517 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.819954    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwqr7\" (UniqueName: \"kubernetes.io/projected/445a9968-4922-4fcc-ac76-fe7891f87a25-kube-api-access-pwqr7\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:05.820517 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.819971    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/445a9968-4922-4fcc-ac76-fe7891f87a25-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:05.820517 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.819984    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/445a9968-4922-4fcc-ac76-fe7891f87a25-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:05.820517 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.819997    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/445a9968-4922-4fcc-ac76-fe7891f87a25-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:05.872246 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.872213    2576 generic.go:356] "Generic (PLEG): container finished" podID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerID="6e6b1f578ff5ce9ad3025f9b6bf1b0f849c4dd69211ffe5c64bef4333ebe6dcf" exitCode=0
Sep 10 17:26:05.872440 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.872283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9" event={"ID":"445a9968-4922-4fcc-ac76-fe7891f87a25","Type":"ContainerDied","Data":"6e6b1f578ff5ce9ad3025f9b6bf1b0f849c4dd69211ffe5c64bef4333ebe6dcf"}
Sep 10 17:26:05.872440 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.872285    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"
Sep 10 17:26:05.872440 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.872356    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9" event={"ID":"445a9968-4922-4fcc-ac76-fe7891f87a25","Type":"ContainerDied","Data":"3be843ec85da75373a14335c813dd760e493855c70141ec5e04795887adc2c74"}
Sep 10 17:26:05.872440 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.872382    2576 scope.go:117] "RemoveContainer" containerID="6e6b1f578ff5ce9ad3025f9b6bf1b0f849c4dd69211ffe5c64bef4333ebe6dcf"
Sep 10 17:26:05.881786 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.881759    2576 scope.go:117] "RemoveContainer" containerID="23abd07d0b7e7c1432da27c3be7bd37a3ef41706be52687eaff537aa84a23f06"
Sep 10 17:26:05.890446 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.890428    2576 scope.go:117] "RemoveContainer" containerID="6e6b1f578ff5ce9ad3025f9b6bf1b0f849c4dd69211ffe5c64bef4333ebe6dcf"
Sep 10 17:26:05.890736 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:26:05.890715    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e6b1f578ff5ce9ad3025f9b6bf1b0f849c4dd69211ffe5c64bef4333ebe6dcf\": container with ID starting with 6e6b1f578ff5ce9ad3025f9b6bf1b0f849c4dd69211ffe5c64bef4333ebe6dcf not found: ID does not exist" containerID="6e6b1f578ff5ce9ad3025f9b6bf1b0f849c4dd69211ffe5c64bef4333ebe6dcf"
Sep 10 17:26:05.890806 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.890745    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e6b1f578ff5ce9ad3025f9b6bf1b0f849c4dd69211ffe5c64bef4333ebe6dcf"} err="failed to get container status \"6e6b1f578ff5ce9ad3025f9b6bf1b0f849c4dd69211ffe5c64bef4333ebe6dcf\": rpc error: code = NotFound desc = could not find container \"6e6b1f578ff5ce9ad3025f9b6bf1b0f849c4dd69211ffe5c64bef4333ebe6dcf\": container with ID starting with 6e6b1f578ff5ce9ad3025f9b6bf1b0f849c4dd69211ffe5c64bef4333ebe6dcf not found: ID does not exist"
Sep 10 17:26:05.890806 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.890765    2576 scope.go:117] "RemoveContainer" containerID="23abd07d0b7e7c1432da27c3be7bd37a3ef41706be52687eaff537aa84a23f06"
Sep 10 17:26:05.891124 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:26:05.891045    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23abd07d0b7e7c1432da27c3be7bd37a3ef41706be52687eaff537aa84a23f06\": container with ID starting with 23abd07d0b7e7c1432da27c3be7bd37a3ef41706be52687eaff537aa84a23f06 not found: ID does not exist" containerID="23abd07d0b7e7c1432da27c3be7bd37a3ef41706be52687eaff537aa84a23f06"
Sep 10 17:26:05.891124 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.891095    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23abd07d0b7e7c1432da27c3be7bd37a3ef41706be52687eaff537aa84a23f06"} err="failed to get container status \"23abd07d0b7e7c1432da27c3be7bd37a3ef41706be52687eaff537aa84a23f06\": rpc error: code = NotFound desc = could not find container \"23abd07d0b7e7c1432da27c3be7bd37a3ef41706be52687eaff537aa84a23f06\": container with ID starting with 23abd07d0b7e7c1432da27c3be7bd37a3ef41706be52687eaff537aa84a23f06 not found: ID does not exist"
Sep 10 17:26:05.893964 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.893948    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"]
Sep 10 17:26:05.895585 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:26:05.895560    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23b6ceb_2fb8_4111_b469_de6b606aca9a.slice/crio-0d63e5d2f5a1c5d6049249247c6e5b1cb3abc8330de50b8ec658211d42742cd4 WatchSource:0}: Error finding container 0d63e5d2f5a1c5d6049249247c6e5b1cb3abc8330de50b8ec658211d42742cd4: Status 404 returned error can't find the container with id 0d63e5d2f5a1c5d6049249247c6e5b1cb3abc8330de50b8ec658211d42742cd4
Sep 10 17:26:05.900142 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.900118    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"]
Sep 10 17:26:05.907252 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:05.907234    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-53de5224-gw-openshift-default-6b574fbf48-ft2l9"]
Sep 10 17:26:06.039624 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:06.039534    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"]
Sep 10 17:26:06.041709 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:26:06.041685    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd463296d_8190_4f11_bb56_416e65394b24.slice/crio-cb8667e6db9c2e3dd58990baa858551fc0b6d0e369d435c6e7cc795da99800cd WatchSource:0}: Error finding container cb8667e6db9c2e3dd58990baa858551fc0b6d0e369d435c6e7cc795da99800cd: Status 404 returned error can't find the container with id cb8667e6db9c2e3dd58990baa858551fc0b6d0e369d435c6e7cc795da99800cd
Sep 10 17:26:06.882267 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:06.882226    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d" event={"ID":"d463296d-8190-4f11-bb56-416e65394b24","Type":"ContainerStarted","Data":"a3ae0c95f109a7265e488e45694f26cc04db6de2c172f75b21b8b9153aff81e2"}
Sep 10 17:26:06.882669 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:06.882294    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d" event={"ID":"d463296d-8190-4f11-bb56-416e65394b24","Type":"ContainerStarted","Data":"cb8667e6db9c2e3dd58990baa858551fc0b6d0e369d435c6e7cc795da99800cd"}
Sep 10 17:26:06.882669 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:06.882333    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"
Sep 10 17:26:06.884251 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:06.884226    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649" event={"ID":"a23b6ceb-2fb8-4111-b469-de6b606aca9a","Type":"ContainerStarted","Data":"2aab1017653d12a2c298273093398a13d82c7269def71bd32fc49534fc525309"}
Sep 10 17:26:06.884392 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:06.884268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649" event={"ID":"a23b6ceb-2fb8-4111-b469-de6b606aca9a","Type":"ContainerStarted","Data":"0d63e5d2f5a1c5d6049249247c6e5b1cb3abc8330de50b8ec658211d42742cd4"}
Sep 10 17:26:06.884392 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:06.884377    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"
Sep 10 17:26:06.904601 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:06.904546    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d" podStartSLOduration=1.9045247220000001 podStartE2EDuration="1.904524722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:26:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:06.901707405 +0000 UTC m=+852.317758355" watchObservedRunningTime="2026-09-10 17:26:06.904524722 +0000 UTC m=+852.320575668"
Sep 10 17:26:06.922660 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:06.922604    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649" podStartSLOduration=1.922587797 podStartE2EDuration="1.922587797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:26:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:06.920476932 +0000 UTC m=+852.336527885" watchObservedRunningTime="2026-09-10 17:26:06.922587797 +0000 UTC m=+852.338638745"
Sep 10 17:26:07.086914 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:07.086879    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="445a9968-4922-4fcc-ac76-fe7891f87a25" path="/var/lib/kubelet/pods/445a9968-4922-4fcc-ac76-fe7891f87a25/volumes"
Sep 10 17:26:09.235897 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:09.235863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:26:17.892756 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:17.892724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"
Sep 10 17:26:17.893122 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:17.892802    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"
Sep 10 17:26:18.569901 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:18.569868    2576 patch_prober.go:28] interesting pod/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": read tcp 10.133.0.2:52196->10.133.0.37:15021: read: connection reset by peer" start-of-body=
Sep 10 17:26:18.570077 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:18.569959    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct" podUID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": read tcp 10.133.0.2:52196->10.133.0.37:15021: read: connection reset by peer"
Sep 10 17:26:18.952238 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:18.952203    2576 generic.go:356] "Generic (PLEG): container finished" podID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerID="ab8a659f5e268f5036d478766e3bc472f02f8deec840a7bf002e7b352fcaf132" exitCode=0
Sep 10 17:26:18.952729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:18.952287    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct" event={"ID":"f4ddb7a0-3f46-45f3-9256-bdcabca6d666","Type":"ContainerDied","Data":"ab8a659f5e268f5036d478766e3bc472f02f8deec840a7bf002e7b352fcaf132"}
Sep 10 17:26:18.952815 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:18.952796    2576 scope.go:117] "RemoveContainer" containerID="ab8a659f5e268f5036d478766e3bc472f02f8deec840a7bf002e7b352fcaf132"
Sep 10 17:26:18.953846 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:18.953823    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:26:18.953901 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:18.953887    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:26:18.953935 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:18.953919    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:26:19.959366 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:19.959326    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct" event={"ID":"f4ddb7a0-3f46-45f3-9256-bdcabca6d666","Type":"ContainerStarted","Data":"db72f8781b589414fb3a6d129eb2693ae0c30b4c0ba714777f26f79df9a783aa"}
Sep 10 17:26:20.463226 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:20.463190    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:20.463447 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:20.463424    2576 patch_prober.go:28] interesting pod/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 10 17:26:20.463506 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:20.463486    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct" podUID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 10 17:26:21.463316 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:21.463279    2576 patch_prober.go:28] interesting pod/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 10 17:26:21.463721 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:21.463339    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct" podUID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 10 17:26:22.463746 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:22.463703    2576 patch_prober.go:28] interesting pod/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 10 17:26:22.464164 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:22.463767    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct" podUID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 10 17:26:23.463630 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:23.463592    2576 patch_prober.go:28] interesting pod/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 10 17:26:23.463808 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:23.463652    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct" podUID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 10 17:26:24.463086 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:24.463031    2576 patch_prober.go:28] interesting pod/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 10 17:26:24.463255 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:24.463108    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct" podUID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 10 17:26:25.467819 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:25.467788    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:25.468254 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:25.468075    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:25.468724 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:25.468707    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:27.971880 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:27.971838    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:26:29.000969 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.000935    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh"]
Sep 10 17:26:29.001389 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.001348    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerName="istio-proxy"
Sep 10 17:26:29.001389 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.001361    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerName="istio-proxy"
Sep 10 17:26:29.001389 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.001374    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerName="istio-proxy"
Sep 10 17:26:29.001389 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.001381    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerName="istio-proxy"
Sep 10 17:26:29.001596 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.001468    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerName="istio-proxy"
Sep 10 17:26:29.001596 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.001478    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="445a9968-4922-4fcc-ac76-fe7891f87a25" containerName="istio-proxy"
Sep 10 17:26:29.003741 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.003717    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh"
Sep 10 17:26:29.008109 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.008087    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 17:26:29.008239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.008095    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4mln5\""
Sep 10 17:26:29.018174 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.018146    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh"]
Sep 10 17:26:29.048927 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.048892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/241c6c04-e9a9-46fd-893d-b54dfc48a7df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4240652e-7bpmh\" (UID: \"241c6c04-e9a9-46fd-893d-b54dfc48a7df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh"
Sep 10 17:26:29.149761 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.149716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/241c6c04-e9a9-46fd-893d-b54dfc48a7df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4240652e-7bpmh\" (UID: \"241c6c04-e9a9-46fd-893d-b54dfc48a7df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh"
Sep 10 17:26:29.150541 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.150508    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/241c6c04-e9a9-46fd-893d-b54dfc48a7df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4240652e-7bpmh\" (UID: \"241c6c04-e9a9-46fd-893d-b54dfc48a7df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh"
Sep 10 17:26:29.314603 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.314510    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh"
Sep 10 17:26:29.586658 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:29.586586    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh"]
Sep 10 17:26:29.589977 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:26:29.589951    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241c6c04_e9a9_46fd_893d_b54dfc48a7df.slice/crio-1e42d167c20a384ff1cea8772c81c8eed21c996f2eae34d9b77c135ac84456cf WatchSource:0}: Error finding container 1e42d167c20a384ff1cea8772c81c8eed21c996f2eae34d9b77c135ac84456cf: Status 404 returned error can't find the container with id 1e42d167c20a384ff1cea8772c81c8eed21c996f2eae34d9b77c135ac84456cf
Sep 10 17:26:30.014861 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:30.014824    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh" event={"ID":"241c6c04-e9a9-46fd-893d-b54dfc48a7df","Type":"ContainerStarted","Data":"3eef8977dbc6d076886d064f00a7ec838b325bc0209b494a8c15892a2a8add02"}
Sep 10 17:26:30.015374 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:30.014883    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh" event={"ID":"241c6c04-e9a9-46fd-893d-b54dfc48a7df","Type":"ContainerStarted","Data":"1e42d167c20a384ff1cea8772c81c8eed21c996f2eae34d9b77c135ac84456cf"}
Sep 10 17:26:30.034303 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:30.034251    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh" podStartSLOduration=2.034234673 podStartE2EDuration="2.034234673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:26:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:30.03318289 +0000 UTC m=+875.449233839" watchObservedRunningTime="2026-09-10 17:26:30.034234673 +0000 UTC m=+875.450285621"
Sep 10 17:26:31.021511 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:31.021474    2576 generic.go:356] "Generic (PLEG): container finished" podID="241c6c04-e9a9-46fd-893d-b54dfc48a7df" containerID="3eef8977dbc6d076886d064f00a7ec838b325bc0209b494a8c15892a2a8add02" exitCode=0
Sep 10 17:26:31.021968 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:31.021541    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh" event={"ID":"241c6c04-e9a9-46fd-893d-b54dfc48a7df","Type":"ContainerDied","Data":"3eef8977dbc6d076886d064f00a7ec838b325bc0209b494a8c15892a2a8add02"}
Sep 10 17:26:32.156565 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:32.156539    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh"
Sep 10 17:26:32.279251 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:32.279165    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/241c6c04-e9a9-46fd-893d-b54dfc48a7df-maas-api-service-ca\") pod \"241c6c04-e9a9-46fd-893d-b54dfc48a7df\" (UID: \"241c6c04-e9a9-46fd-893d-b54dfc48a7df\") "
Sep 10 17:26:32.279559 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:32.279538    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/241c6c04-e9a9-46fd-893d-b54dfc48a7df-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "241c6c04-e9a9-46fd-893d-b54dfc48a7df" (UID: "241c6c04-e9a9-46fd-893d-b54dfc48a7df"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:26:32.380485 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:32.380432    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/241c6c04-e9a9-46fd-893d-b54dfc48a7df-maas-api-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:33.032201 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:33.032164    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh" event={"ID":"241c6c04-e9a9-46fd-893d-b54dfc48a7df","Type":"ContainerDied","Data":"1e42d167c20a384ff1cea8772c81c8eed21c996f2eae34d9b77c135ac84456cf"}
Sep 10 17:26:33.032201 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:33.032195    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh"
Sep 10 17:26:33.032418 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:33.032224    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e42d167c20a384ff1cea8772c81c8eed21c996f2eae34d9b77c135ac84456cf"
Sep 10 17:26:35.266125 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.266091    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"]
Sep 10 17:26:35.266912 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.266855    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d" podUID="d463296d-8190-4f11-bb56-416e65394b24" containerName="payload-processing" containerID="cri-o://a3ae0c95f109a7265e488e45694f26cc04db6de2c172f75b21b8b9153aff81e2" gracePeriod=30
Sep 10 17:26:35.283204 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.283171    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"]
Sep 10 17:26:35.283392 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.283372    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649" podUID="a23b6ceb-2fb8-4111-b469-de6b606aca9a" containerName="payload-pre-processing" containerID="cri-o://2aab1017653d12a2c298273093398a13d82c7269def71bd32fc49534fc525309" gracePeriod=30
Sep 10 17:26:35.550226 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.550203    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"
Sep 10 17:26:35.553315 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.553295    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"
Sep 10 17:26:35.560324 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.560301    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh"]
Sep 10 17:26:35.564469 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.564445    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4240652e-7bpmh"]
Sep 10 17:26:35.613082 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.612804    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d463296d-8190-4f11-bb56-416e65394b24-plugins-config-volume\") pod \"d463296d-8190-4f11-bb56-416e65394b24\" (UID: \"d463296d-8190-4f11-bb56-416e65394b24\") "
Sep 10 17:26:35.614625 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.613501    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a23b6ceb-2fb8-4111-b469-de6b606aca9a-plugins-config-volume\") pod \"a23b6ceb-2fb8-4111-b469-de6b606aca9a\" (UID: \"a23b6ceb-2fb8-4111-b469-de6b606aca9a\") "
Sep 10 17:26:35.614625 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.613677    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkrv2\" (UniqueName: \"kubernetes.io/projected/a23b6ceb-2fb8-4111-b469-de6b606aca9a-kube-api-access-xkrv2\") pod \"a23b6ceb-2fb8-4111-b469-de6b606aca9a\" (UID: \"a23b6ceb-2fb8-4111-b469-de6b606aca9a\") "
Sep 10 17:26:35.614625 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.613749    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmn6v\" (UniqueName: \"kubernetes.io/projected/d463296d-8190-4f11-bb56-416e65394b24-kube-api-access-wmn6v\") pod \"d463296d-8190-4f11-bb56-416e65394b24\" (UID: \"d463296d-8190-4f11-bb56-416e65394b24\") "
Sep 10 17:26:35.616418 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.615778    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a23b6ceb-2fb8-4111-b469-de6b606aca9a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a23b6ceb-2fb8-4111-b469-de6b606aca9a" (UID: "a23b6ceb-2fb8-4111-b469-de6b606aca9a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:26:35.616418 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.616313    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d463296d-8190-4f11-bb56-416e65394b24-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d463296d-8190-4f11-bb56-416e65394b24" (UID: "d463296d-8190-4f11-bb56-416e65394b24"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:26:35.619100 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.619066    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d463296d-8190-4f11-bb56-416e65394b24-kube-api-access-wmn6v" (OuterVolumeSpecName: "kube-api-access-wmn6v") pod "d463296d-8190-4f11-bb56-416e65394b24" (UID: "d463296d-8190-4f11-bb56-416e65394b24"). InnerVolumeSpecName "kube-api-access-wmn6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:26:35.619339 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.619305    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a23b6ceb-2fb8-4111-b469-de6b606aca9a-kube-api-access-xkrv2" (OuterVolumeSpecName: "kube-api-access-xkrv2") pod "a23b6ceb-2fb8-4111-b469-de6b606aca9a" (UID: "a23b6ceb-2fb8-4111-b469-de6b606aca9a"). InnerVolumeSpecName "kube-api-access-xkrv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:26:35.716248 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.716208    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a23b6ceb-2fb8-4111-b469-de6b606aca9a-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:35.716248 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.716241    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkrv2\" (UniqueName: \"kubernetes.io/projected/a23b6ceb-2fb8-4111-b469-de6b606aca9a-kube-api-access-xkrv2\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:35.716248 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.716251    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmn6v\" (UniqueName: \"kubernetes.io/projected/d463296d-8190-4f11-bb56-416e65394b24-kube-api-access-wmn6v\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:35.716491 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:35.716262    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d463296d-8190-4f11-bb56-416e65394b24-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:36.048122 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.048086    2576 generic.go:356] "Generic (PLEG): container finished" podID="d463296d-8190-4f11-bb56-416e65394b24" containerID="a3ae0c95f109a7265e488e45694f26cc04db6de2c172f75b21b8b9153aff81e2" exitCode=0
Sep 10 17:26:36.048122 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.048117    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"
Sep 10 17:26:36.048387 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.048156    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d" event={"ID":"d463296d-8190-4f11-bb56-416e65394b24","Type":"ContainerDied","Data":"a3ae0c95f109a7265e488e45694f26cc04db6de2c172f75b21b8b9153aff81e2"}
Sep 10 17:26:36.048387 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.048207    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d" event={"ID":"d463296d-8190-4f11-bb56-416e65394b24","Type":"ContainerDied","Data":"cb8667e6db9c2e3dd58990baa858551fc0b6d0e369d435c6e7cc795da99800cd"}
Sep 10 17:26:36.048387 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.048226    2576 scope.go:117] "RemoveContainer" containerID="a3ae0c95f109a7265e488e45694f26cc04db6de2c172f75b21b8b9153aff81e2"
Sep 10 17:26:36.049591 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.049565    2576 generic.go:356] "Generic (PLEG): container finished" podID="a23b6ceb-2fb8-4111-b469-de6b606aca9a" containerID="2aab1017653d12a2c298273093398a13d82c7269def71bd32fc49534fc525309" exitCode=0
Sep 10 17:26:36.049695 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.049604    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"
Sep 10 17:26:36.049695 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.049618    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649" event={"ID":"a23b6ceb-2fb8-4111-b469-de6b606aca9a","Type":"ContainerDied","Data":"2aab1017653d12a2c298273093398a13d82c7269def71bd32fc49534fc525309"}
Sep 10 17:26:36.049695 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.049651    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649" event={"ID":"a23b6ceb-2fb8-4111-b469-de6b606aca9a","Type":"ContainerDied","Data":"0d63e5d2f5a1c5d6049249247c6e5b1cb3abc8330de50b8ec658211d42742cd4"}
Sep 10 17:26:36.057559 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.057540    2576 scope.go:117] "RemoveContainer" containerID="a3ae0c95f109a7265e488e45694f26cc04db6de2c172f75b21b8b9153aff81e2"
Sep 10 17:26:36.057839 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:26:36.057823    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3ae0c95f109a7265e488e45694f26cc04db6de2c172f75b21b8b9153aff81e2\": container with ID starting with a3ae0c95f109a7265e488e45694f26cc04db6de2c172f75b21b8b9153aff81e2 not found: ID does not exist" containerID="a3ae0c95f109a7265e488e45694f26cc04db6de2c172f75b21b8b9153aff81e2"
Sep 10 17:26:36.057886 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.057846    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3ae0c95f109a7265e488e45694f26cc04db6de2c172f75b21b8b9153aff81e2"} err="failed to get container status \"a3ae0c95f109a7265e488e45694f26cc04db6de2c172f75b21b8b9153aff81e2\": rpc error: code = NotFound desc = could not find container \"a3ae0c95f109a7265e488e45694f26cc04db6de2c172f75b21b8b9153aff81e2\": container with ID starting with a3ae0c95f109a7265e488e45694f26cc04db6de2c172f75b21b8b9153aff81e2 not found: ID does not exist"
Sep 10 17:26:36.057886 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.057862    2576 scope.go:117] "RemoveContainer" containerID="2aab1017653d12a2c298273093398a13d82c7269def71bd32fc49534fc525309"
Sep 10 17:26:36.066138 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.066120    2576 scope.go:117] "RemoveContainer" containerID="2aab1017653d12a2c298273093398a13d82c7269def71bd32fc49534fc525309"
Sep 10 17:26:36.066404 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:26:36.066384    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aab1017653d12a2c298273093398a13d82c7269def71bd32fc49534fc525309\": container with ID starting with 2aab1017653d12a2c298273093398a13d82c7269def71bd32fc49534fc525309 not found: ID does not exist" containerID="2aab1017653d12a2c298273093398a13d82c7269def71bd32fc49534fc525309"
Sep 10 17:26:36.066446 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.066412    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aab1017653d12a2c298273093398a13d82c7269def71bd32fc49534fc525309"} err="failed to get container status \"2aab1017653d12a2c298273093398a13d82c7269def71bd32fc49534fc525309\": rpc error: code = NotFound desc = could not find container \"2aab1017653d12a2c298273093398a13d82c7269def71bd32fc49534fc525309\": container with ID starting with 2aab1017653d12a2c298273093398a13d82c7269def71bd32fc49534fc525309 not found: ID does not exist"
Sep 10 17:26:36.074181 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.074158    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"]
Sep 10 17:26:36.078958 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.078935    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4240652e-58c8469586-fw649"]
Sep 10 17:26:36.094659 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.094631    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"]
Sep 10 17:26:36.102396 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.102371    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4240652e-69fd8ccc47-g4f7d"]
Sep 10 17:26:36.709040 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.709008    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"]
Sep 10 17:26:36.709426 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:36.709269    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct" podUID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerName="istio-proxy" containerID="cri-o://db72f8781b589414fb3a6d129eb2693ae0c30b4c0ba714777f26f79df9a783aa" gracePeriod=30
Sep 10 17:26:37.084481 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.084396    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="241c6c04-e9a9-46fd-893d-b54dfc48a7df" path="/var/lib/kubelet/pods/241c6c04-e9a9-46fd-893d-b54dfc48a7df/volumes"
Sep 10 17:26:37.084848 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.084827    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a23b6ceb-2fb8-4111-b469-de6b606aca9a" path="/var/lib/kubelet/pods/a23b6ceb-2fb8-4111-b469-de6b606aca9a/volumes"
Sep 10 17:26:37.085249 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.085231    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d463296d-8190-4f11-bb56-416e65394b24" path="/var/lib/kubelet/pods/d463296d-8190-4f11-bb56-416e65394b24/volumes"
Sep 10 17:26:37.488263 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.488231    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"]
Sep 10 17:26:37.488591 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.488579    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="241c6c04-e9a9-46fd-893d-b54dfc48a7df" containerName="revoke-keys"
Sep 10 17:26:37.488641 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.488593    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="241c6c04-e9a9-46fd-893d-b54dfc48a7df" containerName="revoke-keys"
Sep 10 17:26:37.488641 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.488608    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d463296d-8190-4f11-bb56-416e65394b24" containerName="payload-processing"
Sep 10 17:26:37.488641 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.488614    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d463296d-8190-4f11-bb56-416e65394b24" containerName="payload-processing"
Sep 10 17:26:37.488641 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.488628    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a23b6ceb-2fb8-4111-b469-de6b606aca9a" containerName="payload-pre-processing"
Sep 10 17:26:37.488641 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.488633    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a23b6ceb-2fb8-4111-b469-de6b606aca9a" containerName="payload-pre-processing"
Sep 10 17:26:37.488806 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.488686    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d463296d-8190-4f11-bb56-416e65394b24" containerName="payload-processing"
Sep 10 17:26:37.488806 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.488693    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="241c6c04-e9a9-46fd-893d-b54dfc48a7df" containerName="revoke-keys"
Sep 10 17:26:37.488806 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.488701    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a23b6ceb-2fb8-4111-b469-de6b606aca9a" containerName="payload-pre-processing"
Sep 10 17:26:37.491902 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.491879    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.494330 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.494308    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f4c26bd5-openshift-default-dockercfg-nkzkz\""
Sep 10 17:26:37.514907 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.514874    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"]
Sep 10 17:26:37.537566 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.537086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2970deea-7788-4f11-a8b0-ab8df696cdb2-istiod-ca-cert\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.537566 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.537134    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-workload-certs\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.537566 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.537163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-data\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.537566 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.537213    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-credential-socket\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.537566 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.537315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k5dr\" (UniqueName: \"kubernetes.io/projected/2970deea-7788-4f11-a8b0-ab8df696cdb2-kube-api-access-5k5dr\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.537566 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.537364    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-workload-socket\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.537566 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.537388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-envoy\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.537566 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.537410    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-podinfo\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.537566 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.537438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-token\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.638661 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.638625    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2970deea-7788-4f11-a8b0-ab8df696cdb2-istiod-ca-cert\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.638661 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.638663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-workload-certs\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.638905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.638680    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-data\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.638905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.638710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-credential-socket\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.638905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.638785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k5dr\" (UniqueName: \"kubernetes.io/projected/2970deea-7788-4f11-a8b0-ab8df696cdb2-kube-api-access-5k5dr\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.638905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.638827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-workload-socket\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.638905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.638849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-envoy\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.638905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.638873    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-podinfo\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.638905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.638899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-token\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.639305 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.639154    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-workload-certs\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.639514 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.639486    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2970deea-7788-4f11-a8b0-ab8df696cdb2-istiod-ca-cert\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.639653 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.639562    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-credential-socket\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.639653 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.639594    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-workload-socket\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.639765 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.639738    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-data\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.641443 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.641421    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-envoy\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.641599 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.641574    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-podinfo\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.658015 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.657977    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k5dr\" (UniqueName: \"kubernetes.io/projected/2970deea-7788-4f11-a8b0-ab8df696cdb2-kube-api-access-5k5dr\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.664131 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.664103    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-token\") pod \"e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") " pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:37.801942 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:37.801841    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:38.082833 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:38.082808    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"]
Sep 10 17:26:38.085356 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:26:38.085328    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2970deea_7788_4f11_a8b0_ab8df696cdb2.slice/crio-38cdb13596081c512d3f55b205ec0a68b170879b03560f536a7404a85e97872e WatchSource:0}: Error finding container 38cdb13596081c512d3f55b205ec0a68b170879b03560f536a7404a85e97872e: Status 404 returned error can't find the container with id 38cdb13596081c512d3f55b205ec0a68b170879b03560f536a7404a85e97872e
Sep 10 17:26:38.087495 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:38.087462    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:26:38.087586 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:38.087522    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:26:38.087586 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:38.087551    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:26:39.068682 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:39.068647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748" event={"ID":"2970deea-7788-4f11-a8b0-ab8df696cdb2","Type":"ContainerStarted","Data":"aa97db89c957b289c0bfd04b2b0b94fff61434a1fcf104d1d01235db4969dfac"}
Sep 10 17:26:39.069088 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:39.068703    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748" event={"ID":"2970deea-7788-4f11-a8b0-ab8df696cdb2","Type":"ContainerStarted","Data":"38cdb13596081c512d3f55b205ec0a68b170879b03560f536a7404a85e97872e"}
Sep 10 17:26:39.094554 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:39.094503    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748" podStartSLOduration=2.094488254 podStartE2EDuration="2.094488254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:26:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:39.094075351 +0000 UTC m=+884.510126296" watchObservedRunningTime="2026-09-10 17:26:39.094488254 +0000 UTC m=+884.510539202"
Sep 10 17:26:39.802236 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:39.802194    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:39.807133 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:39.807106    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:40.075575 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:40.075497    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:40.076690 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:40.076672    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:26:40.470466 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:40.470428    2576 patch_prober.go:28] interesting pod/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 10 17:26:40.470616 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:40.470491    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct" podUID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 17:26:41.969410 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:41.969385    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:42.080514 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.080415    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-envoy\") pod \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") "
Sep 10 17:26:42.080514 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.080467    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istiod-ca-cert\") pod \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") "
Sep 10 17:26:42.080742 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.080537    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-data\") pod \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") "
Sep 10 17:26:42.080742 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.080566    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjr2t\" (UniqueName: \"kubernetes.io/projected/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-kube-api-access-rjr2t\") pod \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") "
Sep 10 17:26:42.080742 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.080602    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-workload-socket\") pod \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") "
Sep 10 17:26:42.080742 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.080672    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-credential-socket\") pod \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") "
Sep 10 17:26:42.080742 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.080706    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-workload-certs\") pod \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") "
Sep 10 17:26:42.080742 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.080742    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-podinfo\") pod \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") "
Sep 10 17:26:42.081043 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.080764    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-token\") pod \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\" (UID: \"f4ddb7a0-3f46-45f3-9256-bdcabca6d666\") "
Sep 10 17:26:42.081043 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.080823    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4ddb7a0-3f46-45f3-9256-bdcabca6d666" (UID: "f4ddb7a0-3f46-45f3-9256-bdcabca6d666"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:26:42.081317 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.080974    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4ddb7a0-3f46-45f3-9256-bdcabca6d666" (UID: "f4ddb7a0-3f46-45f3-9256-bdcabca6d666"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:26:42.081317 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.081033    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:42.081317 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.081213    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4ddb7a0-3f46-45f3-9256-bdcabca6d666" (UID: "f4ddb7a0-3f46-45f3-9256-bdcabca6d666"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:26:42.082231 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.082191    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4ddb7a0-3f46-45f3-9256-bdcabca6d666" (UID: "f4ddb7a0-3f46-45f3-9256-bdcabca6d666"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:26:42.082231 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.082205    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4ddb7a0-3f46-45f3-9256-bdcabca6d666" (UID: "f4ddb7a0-3f46-45f3-9256-bdcabca6d666"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:26:42.083338 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.083306    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-kube-api-access-rjr2t" (OuterVolumeSpecName: "kube-api-access-rjr2t") pod "f4ddb7a0-3f46-45f3-9256-bdcabca6d666" (UID: "f4ddb7a0-3f46-45f3-9256-bdcabca6d666"). InnerVolumeSpecName "kube-api-access-rjr2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:26:42.083455 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.083337    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4ddb7a0-3f46-45f3-9256-bdcabca6d666" (UID: "f4ddb7a0-3f46-45f3-9256-bdcabca6d666"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:26:42.083666 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.083643    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4ddb7a0-3f46-45f3-9256-bdcabca6d666" (UID: "f4ddb7a0-3f46-45f3-9256-bdcabca6d666"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:26:42.083999 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.083980    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4ddb7a0-3f46-45f3-9256-bdcabca6d666" (UID: "f4ddb7a0-3f46-45f3-9256-bdcabca6d666"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:26:42.092268 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.092241    2576 generic.go:356] "Generic (PLEG): container finished" podID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerID="db72f8781b589414fb3a6d129eb2693ae0c30b4c0ba714777f26f79df9a783aa" exitCode=0
Sep 10 17:26:42.092396 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.092287    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"
Sep 10 17:26:42.092396 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.092322    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct" event={"ID":"f4ddb7a0-3f46-45f3-9256-bdcabca6d666","Type":"ContainerDied","Data":"db72f8781b589414fb3a6d129eb2693ae0c30b4c0ba714777f26f79df9a783aa"}
Sep 10 17:26:42.092396 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.092379    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct" event={"ID":"f4ddb7a0-3f46-45f3-9256-bdcabca6d666","Type":"ContainerDied","Data":"387643a9e96ff156d8400f90115ef681d4f9d7bc9fc3e6b0e4a6c9cb83d1e4fc"}
Sep 10 17:26:42.092512 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.092402    2576 scope.go:117] "RemoveContainer" containerID="db72f8781b589414fb3a6d129eb2693ae0c30b4c0ba714777f26f79df9a783aa"
Sep 10 17:26:42.101603 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.101585    2576 scope.go:117] "RemoveContainer" containerID="ab8a659f5e268f5036d478766e3bc472f02f8deec840a7bf002e7b352fcaf132"
Sep 10 17:26:42.109735 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.109714    2576 scope.go:117] "RemoveContainer" containerID="db72f8781b589414fb3a6d129eb2693ae0c30b4c0ba714777f26f79df9a783aa"
Sep 10 17:26:42.110018 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:26:42.109997    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db72f8781b589414fb3a6d129eb2693ae0c30b4c0ba714777f26f79df9a783aa\": container with ID starting with db72f8781b589414fb3a6d129eb2693ae0c30b4c0ba714777f26f79df9a783aa not found: ID does not exist" containerID="db72f8781b589414fb3a6d129eb2693ae0c30b4c0ba714777f26f79df9a783aa"
Sep 10 17:26:42.110110 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.110029    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db72f8781b589414fb3a6d129eb2693ae0c30b4c0ba714777f26f79df9a783aa"} err="failed to get container status \"db72f8781b589414fb3a6d129eb2693ae0c30b4c0ba714777f26f79df9a783aa\": rpc error: code = NotFound desc = could not find container \"db72f8781b589414fb3a6d129eb2693ae0c30b4c0ba714777f26f79df9a783aa\": container with ID starting with db72f8781b589414fb3a6d129eb2693ae0c30b4c0ba714777f26f79df9a783aa not found: ID does not exist"
Sep 10 17:26:42.110110 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.110045    2576 scope.go:117] "RemoveContainer" containerID="ab8a659f5e268f5036d478766e3bc472f02f8deec840a7bf002e7b352fcaf132"
Sep 10 17:26:42.110340 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:26:42.110322    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab8a659f5e268f5036d478766e3bc472f02f8deec840a7bf002e7b352fcaf132\": container with ID starting with ab8a659f5e268f5036d478766e3bc472f02f8deec840a7bf002e7b352fcaf132 not found: ID does not exist" containerID="ab8a659f5e268f5036d478766e3bc472f02f8deec840a7bf002e7b352fcaf132"
Sep 10 17:26:42.110397 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.110351    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab8a659f5e268f5036d478766e3bc472f02f8deec840a7bf002e7b352fcaf132"} err="failed to get container status \"ab8a659f5e268f5036d478766e3bc472f02f8deec840a7bf002e7b352fcaf132\": rpc error: code = NotFound desc = could not find container \"ab8a659f5e268f5036d478766e3bc472f02f8deec840a7bf002e7b352fcaf132\": container with ID starting with ab8a659f5e268f5036d478766e3bc472f02f8deec840a7bf002e7b352fcaf132 not found: ID does not exist"
Sep 10 17:26:42.117610 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.117588    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"]
Sep 10 17:26:42.120161 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.120136    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4240652e-openshift-default-599fb7b648-t6bct"]
Sep 10 17:26:42.182383 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.182353    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:42.182383 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.182379    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:42.182383 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.182389    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjr2t\" (UniqueName: \"kubernetes.io/projected/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-kube-api-access-rjr2t\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:42.182603 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.182399    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:42.182603 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.182410    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:42.182603 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.182419    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:42.182603 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.182427    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:42.182603 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.182435    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4ddb7a0-3f46-45f3-9256-bdcabca6d666-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:42.758416 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.758335    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"]
Sep 10 17:26:42.758708 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.758695    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerName="istio-proxy"
Sep 10 17:26:42.758749 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.758709    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerName="istio-proxy"
Sep 10 17:26:42.758749 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.758729    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerName="istio-proxy"
Sep 10 17:26:42.758749 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.758735    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerName="istio-proxy"
Sep 10 17:26:42.759040 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.758788    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerName="istio-proxy"
Sep 10 17:26:42.761846 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.761829    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"
Sep 10 17:26:42.765211 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.765193    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-f4c26bd5-dockercfg-szw84\""
Sep 10 17:26:42.765280 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.765193    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-f4c26bd5\""
Sep 10 17:26:42.779220 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.779196    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"]
Sep 10 17:26:42.825769 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.825730    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"]
Sep 10 17:26:42.826239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.826218    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" containerName="istio-proxy"
Sep 10 17:26:42.828381 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.828361    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"
Sep 10 17:26:42.846120 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.846091    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"]
Sep 10 17:26:42.887887 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.887857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knxbk\" (UniqueName: \"kubernetes.io/projected/af095b6d-1ef6-4f79-bfe0-07288bc378cc-kube-api-access-knxbk\") pod \"payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg\" (UID: \"af095b6d-1ef6-4f79-bfe0-07288bc378cc\") " pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"
Sep 10 17:26:42.887887 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.887898    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af095b6d-1ef6-4f79-bfe0-07288bc378cc-plugins-config-volume\") pod \"payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg\" (UID: \"af095b6d-1ef6-4f79-bfe0-07288bc378cc\") " pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"
Sep 10 17:26:42.888140 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.887923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzdgl\" (UniqueName: \"kubernetes.io/projected/5b7b9f11-03fb-466d-934d-b7ec1ef52f35-kube-api-access-lzdgl\") pod \"payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j\" (UID: \"5b7b9f11-03fb-466d-934d-b7ec1ef52f35\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"
Sep 10 17:26:42.888140 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.888008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7b9f11-03fb-466d-934d-b7ec1ef52f35-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j\" (UID: \"5b7b9f11-03fb-466d-934d-b7ec1ef52f35\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"
Sep 10 17:26:42.988733 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.988702    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af095b6d-1ef6-4f79-bfe0-07288bc378cc-plugins-config-volume\") pod \"payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg\" (UID: \"af095b6d-1ef6-4f79-bfe0-07288bc378cc\") " pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"
Sep 10 17:26:42.989180 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.988740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzdgl\" (UniqueName: \"kubernetes.io/projected/5b7b9f11-03fb-466d-934d-b7ec1ef52f35-kube-api-access-lzdgl\") pod \"payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j\" (UID: \"5b7b9f11-03fb-466d-934d-b7ec1ef52f35\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"
Sep 10 17:26:42.989180 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.988865    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7b9f11-03fb-466d-934d-b7ec1ef52f35-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j\" (UID: \"5b7b9f11-03fb-466d-934d-b7ec1ef52f35\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"
Sep 10 17:26:42.989180 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.988993    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knxbk\" (UniqueName: \"kubernetes.io/projected/af095b6d-1ef6-4f79-bfe0-07288bc378cc-kube-api-access-knxbk\") pod \"payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg\" (UID: \"af095b6d-1ef6-4f79-bfe0-07288bc378cc\") " pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"
Sep 10 17:26:42.989558 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.989541    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7b9f11-03fb-466d-934d-b7ec1ef52f35-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j\" (UID: \"5b7b9f11-03fb-466d-934d-b7ec1ef52f35\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"
Sep 10 17:26:42.989614 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.989597    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af095b6d-1ef6-4f79-bfe0-07288bc378cc-plugins-config-volume\") pod \"payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg\" (UID: \"af095b6d-1ef6-4f79-bfe0-07288bc378cc\") " pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"
Sep 10 17:26:42.997987 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.997961    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzdgl\" (UniqueName: \"kubernetes.io/projected/5b7b9f11-03fb-466d-934d-b7ec1ef52f35-kube-api-access-lzdgl\") pod \"payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j\" (UID: \"5b7b9f11-03fb-466d-934d-b7ec1ef52f35\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"
Sep 10 17:26:42.998342 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:42.998323    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knxbk\" (UniqueName: \"kubernetes.io/projected/af095b6d-1ef6-4f79-bfe0-07288bc378cc-kube-api-access-knxbk\") pod \"payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg\" (UID: \"af095b6d-1ef6-4f79-bfe0-07288bc378cc\") " pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"
Sep 10 17:26:43.072422 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:43.072331    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"
Sep 10 17:26:43.089958 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:43.089923    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4ddb7a0-3f46-45f3-9256-bdcabca6d666" path="/var/lib/kubelet/pods/f4ddb7a0-3f46-45f3-9256-bdcabca6d666/volumes"
Sep 10 17:26:43.141684 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:43.141655    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"
Sep 10 17:26:43.360586 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:43.360495    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"]
Sep 10 17:26:43.363385 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:26:43.363346    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7b9f11_03fb_466d_934d_b7ec1ef52f35.slice/crio-5cc7f0fe392d0a6c36336a82c86356415b3c3b040438d974bd3a58015aa42536 WatchSource:0}: Error finding container 5cc7f0fe392d0a6c36336a82c86356415b3c3b040438d974bd3a58015aa42536: Status 404 returned error can't find the container with id 5cc7f0fe392d0a6c36336a82c86356415b3c3b040438d974bd3a58015aa42536
Sep 10 17:26:43.429099 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:43.429075    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"]
Sep 10 17:26:43.431893 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:26:43.431871    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf095b6d_1ef6_4f79_bfe0_07288bc378cc.slice/crio-ebe7dcf1806cb28c177c6f9f1f5911ebc6313a852365bbd996da70a80d7b8804 WatchSource:0}: Error finding container ebe7dcf1806cb28c177c6f9f1f5911ebc6313a852365bbd996da70a80d7b8804: Status 404 returned error can't find the container with id ebe7dcf1806cb28c177c6f9f1f5911ebc6313a852365bbd996da70a80d7b8804
Sep 10 17:26:44.105748 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:44.105712    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j" event={"ID":"5b7b9f11-03fb-466d-934d-b7ec1ef52f35","Type":"ContainerStarted","Data":"f18e8003d04c43eff964eca1e24cdb78f6ee41d14f54e413699c3b417e428948"}
Sep 10 17:26:44.106236 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:44.105770    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j" event={"ID":"5b7b9f11-03fb-466d-934d-b7ec1ef52f35","Type":"ContainerStarted","Data":"5cc7f0fe392d0a6c36336a82c86356415b3c3b040438d974bd3a58015aa42536"}
Sep 10 17:26:44.106236 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:44.105819    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"
Sep 10 17:26:44.107595 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:44.107571    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg" event={"ID":"af095b6d-1ef6-4f79-bfe0-07288bc378cc","Type":"ContainerStarted","Data":"b5f5cccd3508b9d563bc48017e13b7c60fb984380fa4d4ba9a43911475abfbc1"}
Sep 10 17:26:44.107707 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:44.107618    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg" event={"ID":"af095b6d-1ef6-4f79-bfe0-07288bc378cc","Type":"ContainerStarted","Data":"ebe7dcf1806cb28c177c6f9f1f5911ebc6313a852365bbd996da70a80d7b8804"}
Sep 10 17:26:44.107707 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:44.107646    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"
Sep 10 17:26:44.126598 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:44.126549    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j" podStartSLOduration=2.126529758 podStartE2EDuration="2.126529758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:26:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:44.125627032 +0000 UTC m=+889.541677984" watchObservedRunningTime="2026-09-10 17:26:44.126529758 +0000 UTC m=+889.542580711"
Sep 10 17:26:44.146773 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:44.146720    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg" podStartSLOduration=2.146700837 podStartE2EDuration="2.146700837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:26:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:26:44.146487323 +0000 UTC m=+889.562538276" watchObservedRunningTime="2026-09-10 17:26:44.146700837 +0000 UTC m=+889.562751787"
Sep 10 17:26:45.688026 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:45.687987    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-889898-wdnch"]
Sep 10 17:26:45.690807 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:45.690789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-889898-wdnch"
Sep 10 17:26:45.694520 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:45.694498    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 17:26:45.694621 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:45.694571    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4mln5\""
Sep 10 17:26:45.702157 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:45.702133    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-889898-wdnch"]
Sep 10 17:26:45.821929 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:45.821893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c998d7b7-4223-493d-abeb-93459fe8636e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-889898-wdnch\" (UID: \"c998d7b7-4223-493d-abeb-93459fe8636e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-889898-wdnch"
Sep 10 17:26:45.922906 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:45.922866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c998d7b7-4223-493d-abeb-93459fe8636e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-889898-wdnch\" (UID: \"c998d7b7-4223-493d-abeb-93459fe8636e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-889898-wdnch"
Sep 10 17:26:45.923608 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:45.923588    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c998d7b7-4223-493d-abeb-93459fe8636e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-889898-wdnch\" (UID: \"c998d7b7-4223-493d-abeb-93459fe8636e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-889898-wdnch"
Sep 10 17:26:46.001920 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:46.001832    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-889898-wdnch"
Sep 10 17:26:46.276459 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:46.276433    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-889898-wdnch"]
Sep 10 17:26:46.278702 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:26:46.278673    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc998d7b7_4223_493d_abeb_93459fe8636e.slice/crio-e12b6dc65e2ca5c2f98e32a69272a46ca76b067e35e566df6a8291442245a9f3 WatchSource:0}: Error finding container e12b6dc65e2ca5c2f98e32a69272a46ca76b067e35e566df6a8291442245a9f3: Status 404 returned error can't find the container with id e12b6dc65e2ca5c2f98e32a69272a46ca76b067e35e566df6a8291442245a9f3
Sep 10 17:26:47.126863 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:47.126832    2576 generic.go:356] "Generic (PLEG): container finished" podID="c998d7b7-4223-493d-abeb-93459fe8636e" containerID="7fbb4c7f9e5fd62302a2f35c7c56b09516d8b23be05bcf13cc692d177812888c" exitCode=0
Sep 10 17:26:47.127264 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:47.126905    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-889898-wdnch" event={"ID":"c998d7b7-4223-493d-abeb-93459fe8636e","Type":"ContainerDied","Data":"7fbb4c7f9e5fd62302a2f35c7c56b09516d8b23be05bcf13cc692d177812888c"}
Sep 10 17:26:47.127264 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:47.126948    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-889898-wdnch" event={"ID":"c998d7b7-4223-493d-abeb-93459fe8636e","Type":"ContainerStarted","Data":"e12b6dc65e2ca5c2f98e32a69272a46ca76b067e35e566df6a8291442245a9f3"}
Sep 10 17:26:47.176353 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:47.176315    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:26:48.265662 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:48.265633    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-889898-wdnch"
Sep 10 17:26:48.343808 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:48.343778    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c998d7b7-4223-493d-abeb-93459fe8636e-maas-api-service-ca\") pod \"c998d7b7-4223-493d-abeb-93459fe8636e\" (UID: \"c998d7b7-4223-493d-abeb-93459fe8636e\") "
Sep 10 17:26:48.344227 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:48.344199    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c998d7b7-4223-493d-abeb-93459fe8636e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c998d7b7-4223-493d-abeb-93459fe8636e" (UID: "c998d7b7-4223-493d-abeb-93459fe8636e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:26:48.445451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:48.445358    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c998d7b7-4223-493d-abeb-93459fe8636e-maas-api-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:26:49.140161 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:49.140131    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-889898-wdnch"
Sep 10 17:26:49.140161 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:49.140152    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-889898-wdnch" event={"ID":"c998d7b7-4223-493d-abeb-93459fe8636e","Type":"ContainerDied","Data":"e12b6dc65e2ca5c2f98e32a69272a46ca76b067e35e566df6a8291442245a9f3"}
Sep 10 17:26:49.140371 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:49.140207    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e12b6dc65e2ca5c2f98e32a69272a46ca76b067e35e566df6a8291442245a9f3"
Sep 10 17:26:55.115237 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:55.115205    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"
Sep 10 17:26:55.115717 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:55.115289    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"
Sep 10 17:26:56.850933 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:56.850887    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-889898-wdnch"]
Sep 10 17:26:56.856079 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:56.856028    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-889898-wdnch"]
Sep 10 17:26:57.085193 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:57.085162    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c998d7b7-4223-493d-abeb-93459fe8636e" path="/var/lib/kubelet/pods/c998d7b7-4223-493d-abeb-93459fe8636e/volumes"
Sep 10 17:26:59.194889 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:59.194857    2576 generic.go:356] "Generic (PLEG): container finished" podID="2970deea-7788-4f11-a8b0-ab8df696cdb2" containerID="aa97db89c957b289c0bfd04b2b0b94fff61434a1fcf104d1d01235db4969dfac" exitCode=0
Sep 10 17:26:59.195342 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:59.194940    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748" event={"ID":"2970deea-7788-4f11-a8b0-ab8df696cdb2","Type":"ContainerDied","Data":"aa97db89c957b289c0bfd04b2b0b94fff61434a1fcf104d1d01235db4969dfac"}
Sep 10 17:26:59.195398 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:59.195380    2576 scope.go:117] "RemoveContainer" containerID="aa97db89c957b289c0bfd04b2b0b94fff61434a1fcf104d1d01235db4969dfac"
Sep 10 17:26:59.196502 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:59.196476    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:26:59.196568 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:59.196544    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:26:59.196607 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:26:59.196576    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:27:00.204783 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:00.204741    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748" event={"ID":"2970deea-7788-4f11-a8b0-ab8df696cdb2","Type":"ContainerStarted","Data":"933d1f725a7e6ae7a2ee910c3fa5ee67e15c177712fa5c245452c8bf8a5df971"}
Sep 10 17:27:00.802445 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:00.802407    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:27:00.802806 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:00.802776    2576 patch_prober.go:28] interesting pod/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 10 17:27:00.803018 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:00.802992    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748" podUID="2970deea-7788-4f11-a8b0-ab8df696cdb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 10 17:27:01.803074 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:01.803008    2576 patch_prober.go:28] interesting pod/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 10 17:27:01.803579 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:01.803152    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748" podUID="2970deea-7788-4f11-a8b0-ab8df696cdb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 10 17:27:02.802471 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:02.802431    2576 patch_prober.go:28] interesting pod/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 10 17:27:02.802874 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:02.802842    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748" podUID="2970deea-7788-4f11-a8b0-ab8df696cdb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 10 17:27:03.416473 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:03.416439    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:27:03.803004 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:03.802904    2576 patch_prober.go:28] interesting pod/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 10 17:27:03.803291 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:03.803258    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748" podUID="2970deea-7788-4f11-a8b0-ab8df696cdb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 10 17:27:04.802611 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:04.802573    2576 patch_prober.go:28] interesting pod/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 10 17:27:04.803867 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:04.803457    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748" podUID="2970deea-7788-4f11-a8b0-ab8df696cdb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 10 17:27:05.296763 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.296723    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q"]
Sep 10 17:27:05.297162 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.297145    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c998d7b7-4223-493d-abeb-93459fe8636e" containerName="revoke-keys"
Sep 10 17:27:05.297217 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.297165    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c998d7b7-4223-493d-abeb-93459fe8636e" containerName="revoke-keys"
Sep 10 17:27:05.297253 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.297237    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c998d7b7-4223-493d-abeb-93459fe8636e" containerName="revoke-keys"
Sep 10 17:27:05.299385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.299360    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q"
Sep 10 17:27:05.301907 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.301886    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 17:27:05.302026 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.301888    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4mln5\""
Sep 10 17:27:05.308843 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.308815    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q"]
Sep 10 17:27:05.312559 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.312531    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/766b4aa5-b899-43a1-9de4-1370f264bf96-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q\" (UID: \"766b4aa5-b899-43a1-9de4-1370f264bf96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q"
Sep 10 17:27:05.413739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.413706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/766b4aa5-b899-43a1-9de4-1370f264bf96-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q\" (UID: \"766b4aa5-b899-43a1-9de4-1370f264bf96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q"
Sep 10 17:27:05.414360 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.414338    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/766b4aa5-b899-43a1-9de4-1370f264bf96-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q\" (UID: \"766b4aa5-b899-43a1-9de4-1370f264bf96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q"
Sep 10 17:27:05.612506 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.612405    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q"
Sep 10 17:27:05.806878 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.806846    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:27:05.807257 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.807165    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:27:05.807818 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.807802    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:27:05.886600 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:05.886576    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q"]
Sep 10 17:27:05.888966 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:27:05.888937    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod766b4aa5_b899_43a1_9de4_1370f264bf96.slice/crio-05f49959e9d80de02c05093a6b351da5edc9ea8312cf3ec6d66391301514a8e7 WatchSource:0}: Error finding container 05f49959e9d80de02c05093a6b351da5edc9ea8312cf3ec6d66391301514a8e7: Status 404 returned error can't find the container with id 05f49959e9d80de02c05093a6b351da5edc9ea8312cf3ec6d66391301514a8e7
Sep 10 17:27:06.244246 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:06.244146    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q" event={"ID":"766b4aa5-b899-43a1-9de4-1370f264bf96","Type":"ContainerStarted","Data":"85415dd2ac4360e49999f82a8eab005bb55f9e60174db3c700f26300cbbac67d"}
Sep 10 17:27:06.244246 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:06.244203    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q" event={"ID":"766b4aa5-b899-43a1-9de4-1370f264bf96","Type":"ContainerStarted","Data":"05f49959e9d80de02c05093a6b351da5edc9ea8312cf3ec6d66391301514a8e7"}
Sep 10 17:27:06.267508 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:06.267459    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q" podStartSLOduration=1.267444755 podStartE2EDuration="1.267444755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:27:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:27:06.265324429 +0000 UTC m=+911.681375379" watchObservedRunningTime="2026-09-10 17:27:06.267444755 +0000 UTC m=+911.683495703"
Sep 10 17:27:07.250670 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:07.250635    2576 generic.go:356] "Generic (PLEG): container finished" podID="766b4aa5-b899-43a1-9de4-1370f264bf96" containerID="85415dd2ac4360e49999f82a8eab005bb55f9e60174db3c700f26300cbbac67d" exitCode=0
Sep 10 17:27:07.251126 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:07.250699    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q" event={"ID":"766b4aa5-b899-43a1-9de4-1370f264bf96","Type":"ContainerDied","Data":"85415dd2ac4360e49999f82a8eab005bb55f9e60174db3c700f26300cbbac67d"}
Sep 10 17:27:08.386022 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:08.385997    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q"
Sep 10 17:27:08.439596 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:08.439559    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/766b4aa5-b899-43a1-9de4-1370f264bf96-maas-api-service-ca\") pod \"766b4aa5-b899-43a1-9de4-1370f264bf96\" (UID: \"766b4aa5-b899-43a1-9de4-1370f264bf96\") "
Sep 10 17:27:08.439979 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:08.439954    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/766b4aa5-b899-43a1-9de4-1370f264bf96-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "766b4aa5-b899-43a1-9de4-1370f264bf96" (UID: "766b4aa5-b899-43a1-9de4-1370f264bf96"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:27:08.540886 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:08.540797    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/766b4aa5-b899-43a1-9de4-1370f264bf96-maas-api-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:09.262744 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:09.262714    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q"
Sep 10 17:27:09.262922 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:09.262714    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q" event={"ID":"766b4aa5-b899-43a1-9de4-1370f264bf96","Type":"ContainerDied","Data":"05f49959e9d80de02c05093a6b351da5edc9ea8312cf3ec6d66391301514a8e7"}
Sep 10 17:27:09.262922 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:09.262867    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05f49959e9d80de02c05093a6b351da5edc9ea8312cf3ec6d66391301514a8e7"
Sep 10 17:27:12.741435 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:12.741402    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"]
Sep 10 17:27:12.741903 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:12.741624    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg" podUID="af095b6d-1ef6-4f79-bfe0-07288bc378cc" containerName="payload-processing" containerID="cri-o://b5f5cccd3508b9d563bc48017e13b7c60fb984380fa4d4ba9a43911475abfbc1" gracePeriod=30
Sep 10 17:27:12.755785 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:12.755752    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"]
Sep 10 17:27:12.756069 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:12.756006    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j" podUID="5b7b9f11-03fb-466d-934d-b7ec1ef52f35" containerName="payload-pre-processing" containerID="cri-o://f18e8003d04c43eff964eca1e24cdb78f6ee41d14f54e413699c3b417e428948" gracePeriod=30
Sep 10 17:27:12.948119 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:12.948088    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q"]
Sep 10 17:27:12.955813 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:12.955783    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f4c26bd5-ntd6q"]
Sep 10 17:27:13.023521 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.023496    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"
Sep 10 17:27:13.026357 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.026334    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"
Sep 10 17:27:13.082090 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.079978    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knxbk\" (UniqueName: \"kubernetes.io/projected/af095b6d-1ef6-4f79-bfe0-07288bc378cc-kube-api-access-knxbk\") pod \"af095b6d-1ef6-4f79-bfe0-07288bc378cc\" (UID: \"af095b6d-1ef6-4f79-bfe0-07288bc378cc\") "
Sep 10 17:27:13.082090 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.080144    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7b9f11-03fb-466d-934d-b7ec1ef52f35-plugins-config-volume\") pod \"5b7b9f11-03fb-466d-934d-b7ec1ef52f35\" (UID: \"5b7b9f11-03fb-466d-934d-b7ec1ef52f35\") "
Sep 10 17:27:13.082090 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.080205    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af095b6d-1ef6-4f79-bfe0-07288bc378cc-plugins-config-volume\") pod \"af095b6d-1ef6-4f79-bfe0-07288bc378cc\" (UID: \"af095b6d-1ef6-4f79-bfe0-07288bc378cc\") "
Sep 10 17:27:13.082090 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.080236    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzdgl\" (UniqueName: \"kubernetes.io/projected/5b7b9f11-03fb-466d-934d-b7ec1ef52f35-kube-api-access-lzdgl\") pod \"5b7b9f11-03fb-466d-934d-b7ec1ef52f35\" (UID: \"5b7b9f11-03fb-466d-934d-b7ec1ef52f35\") "
Sep 10 17:27:13.082090 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.080771    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af095b6d-1ef6-4f79-bfe0-07288bc378cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "af095b6d-1ef6-4f79-bfe0-07288bc378cc" (UID: "af095b6d-1ef6-4f79-bfe0-07288bc378cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:27:13.082090 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.080747    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b7b9f11-03fb-466d-934d-b7ec1ef52f35-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5b7b9f11-03fb-466d-934d-b7ec1ef52f35" (UID: "5b7b9f11-03fb-466d-934d-b7ec1ef52f35"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:27:13.084514 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.084470    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b7b9f11-03fb-466d-934d-b7ec1ef52f35-kube-api-access-lzdgl" (OuterVolumeSpecName: "kube-api-access-lzdgl") pod "5b7b9f11-03fb-466d-934d-b7ec1ef52f35" (UID: "5b7b9f11-03fb-466d-934d-b7ec1ef52f35"). InnerVolumeSpecName "kube-api-access-lzdgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:27:13.085655 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.085633    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af095b6d-1ef6-4f79-bfe0-07288bc378cc-kube-api-access-knxbk" (OuterVolumeSpecName: "kube-api-access-knxbk") pod "af095b6d-1ef6-4f79-bfe0-07288bc378cc" (UID: "af095b6d-1ef6-4f79-bfe0-07288bc378cc"). InnerVolumeSpecName "kube-api-access-knxbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:27:13.086988 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.086965    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="766b4aa5-b899-43a1-9de4-1370f264bf96" path="/var/lib/kubelet/pods/766b4aa5-b899-43a1-9de4-1370f264bf96/volumes"
Sep 10 17:27:13.109565 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.109535    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"]
Sep 10 17:27:13.109819 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.109787    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748" podUID="2970deea-7788-4f11-a8b0-ab8df696cdb2" containerName="istio-proxy" containerID="cri-o://933d1f725a7e6ae7a2ee910c3fa5ee67e15c177712fa5c245452c8bf8a5df971" gracePeriod=30
Sep 10 17:27:13.181481 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.181443    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knxbk\" (UniqueName: \"kubernetes.io/projected/af095b6d-1ef6-4f79-bfe0-07288bc378cc-kube-api-access-knxbk\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:13.181481 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.181477    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7b9f11-03fb-466d-934d-b7ec1ef52f35-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:13.181481 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.181486    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af095b6d-1ef6-4f79-bfe0-07288bc378cc-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:13.181723 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.181494    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzdgl\" (UniqueName: \"kubernetes.io/projected/5b7b9f11-03fb-466d-934d-b7ec1ef52f35-kube-api-access-lzdgl\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:13.285201 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.285114    2576 generic.go:356] "Generic (PLEG): container finished" podID="5b7b9f11-03fb-466d-934d-b7ec1ef52f35" containerID="f18e8003d04c43eff964eca1e24cdb78f6ee41d14f54e413699c3b417e428948" exitCode=0
Sep 10 17:27:13.285201 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.285157    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"
Sep 10 17:27:13.285413 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.285198    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j" event={"ID":"5b7b9f11-03fb-466d-934d-b7ec1ef52f35","Type":"ContainerDied","Data":"f18e8003d04c43eff964eca1e24cdb78f6ee41d14f54e413699c3b417e428948"}
Sep 10 17:27:13.285413 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.285257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j" event={"ID":"5b7b9f11-03fb-466d-934d-b7ec1ef52f35","Type":"ContainerDied","Data":"5cc7f0fe392d0a6c36336a82c86356415b3c3b040438d974bd3a58015aa42536"}
Sep 10 17:27:13.285413 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.285288    2576 scope.go:117] "RemoveContainer" containerID="f18e8003d04c43eff964eca1e24cdb78f6ee41d14f54e413699c3b417e428948"
Sep 10 17:27:13.286580 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.286556    2576 generic.go:356] "Generic (PLEG): container finished" podID="af095b6d-1ef6-4f79-bfe0-07288bc378cc" containerID="b5f5cccd3508b9d563bc48017e13b7c60fb984380fa4d4ba9a43911475abfbc1" exitCode=0
Sep 10 17:27:13.286681 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.286596    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"
Sep 10 17:27:13.286681 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.286639    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg" event={"ID":"af095b6d-1ef6-4f79-bfe0-07288bc378cc","Type":"ContainerDied","Data":"b5f5cccd3508b9d563bc48017e13b7c60fb984380fa4d4ba9a43911475abfbc1"}
Sep 10 17:27:13.286751 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.286695    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg" event={"ID":"af095b6d-1ef6-4f79-bfe0-07288bc378cc","Type":"ContainerDied","Data":"ebe7dcf1806cb28c177c6f9f1f5911ebc6313a852365bbd996da70a80d7b8804"}
Sep 10 17:27:13.294096 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.293943    2576 scope.go:117] "RemoveContainer" containerID="f18e8003d04c43eff964eca1e24cdb78f6ee41d14f54e413699c3b417e428948"
Sep 10 17:27:13.294252 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:27:13.294232    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f18e8003d04c43eff964eca1e24cdb78f6ee41d14f54e413699c3b417e428948\": container with ID starting with f18e8003d04c43eff964eca1e24cdb78f6ee41d14f54e413699c3b417e428948 not found: ID does not exist" containerID="f18e8003d04c43eff964eca1e24cdb78f6ee41d14f54e413699c3b417e428948"
Sep 10 17:27:13.294320 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.294267    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f18e8003d04c43eff964eca1e24cdb78f6ee41d14f54e413699c3b417e428948"} err="failed to get container status \"f18e8003d04c43eff964eca1e24cdb78f6ee41d14f54e413699c3b417e428948\": rpc error: code = NotFound desc = could not find container \"f18e8003d04c43eff964eca1e24cdb78f6ee41d14f54e413699c3b417e428948\": container with ID starting with f18e8003d04c43eff964eca1e24cdb78f6ee41d14f54e413699c3b417e428948 not found: ID does not exist"
Sep 10 17:27:13.294320 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.294293    2576 scope.go:117] "RemoveContainer" containerID="b5f5cccd3508b9d563bc48017e13b7c60fb984380fa4d4ba9a43911475abfbc1"
Sep 10 17:27:13.302589 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.302574    2576 scope.go:117] "RemoveContainer" containerID="b5f5cccd3508b9d563bc48017e13b7c60fb984380fa4d4ba9a43911475abfbc1"
Sep 10 17:27:13.302884 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:27:13.302866    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5f5cccd3508b9d563bc48017e13b7c60fb984380fa4d4ba9a43911475abfbc1\": container with ID starting with b5f5cccd3508b9d563bc48017e13b7c60fb984380fa4d4ba9a43911475abfbc1 not found: ID does not exist" containerID="b5f5cccd3508b9d563bc48017e13b7c60fb984380fa4d4ba9a43911475abfbc1"
Sep 10 17:27:13.302937 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.302891    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5f5cccd3508b9d563bc48017e13b7c60fb984380fa4d4ba9a43911475abfbc1"} err="failed to get container status \"b5f5cccd3508b9d563bc48017e13b7c60fb984380fa4d4ba9a43911475abfbc1\": rpc error: code = NotFound desc = could not find container \"b5f5cccd3508b9d563bc48017e13b7c60fb984380fa4d4ba9a43911475abfbc1\": container with ID starting with b5f5cccd3508b9d563bc48017e13b7c60fb984380fa4d4ba9a43911475abfbc1 not found: ID does not exist"
Sep 10 17:27:13.303682 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.303665    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"]
Sep 10 17:27:13.312874 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.312851    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-f4c26bd5-65545dc546-s5z2j"]
Sep 10 17:27:13.328188 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.328159    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"]
Sep 10 17:27:13.335540 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:13.332441    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f4c26bd5-5b89645db5-ml8rg"]
Sep 10 17:27:15.083928 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:15.083892    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b7b9f11-03fb-466d-934d-b7ec1ef52f35" path="/var/lib/kubelet/pods/5b7b9f11-03fb-466d-934d-b7ec1ef52f35/volumes"
Sep 10 17:27:15.084320 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:15.084267    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af095b6d-1ef6-4f79-bfe0-07288bc378cc" path="/var/lib/kubelet/pods/af095b6d-1ef6-4f79-bfe0-07288bc378cc/volumes"
Sep 10 17:27:16.209551 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:16.209513    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:27:18.314929 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.314894    2576 generic.go:356] "Generic (PLEG): container finished" podID="2970deea-7788-4f11-a8b0-ab8df696cdb2" containerID="933d1f725a7e6ae7a2ee910c3fa5ee67e15c177712fa5c245452c8bf8a5df971" exitCode=0
Sep 10 17:27:18.315459 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.314967    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748" event={"ID":"2970deea-7788-4f11-a8b0-ab8df696cdb2","Type":"ContainerDied","Data":"933d1f725a7e6ae7a2ee910c3fa5ee67e15c177712fa5c245452c8bf8a5df971"}
Sep 10 17:27:18.315459 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.315073    2576 scope.go:117] "RemoveContainer" containerID="aa97db89c957b289c0bfd04b2b0b94fff61434a1fcf104d1d01235db4969dfac"
Sep 10 17:27:18.372663 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.372600    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:27:18.429639 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.429607    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-token\") pod \"2970deea-7788-4f11-a8b0-ab8df696cdb2\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") "
Sep 10 17:27:18.429820 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.429655    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k5dr\" (UniqueName: \"kubernetes.io/projected/2970deea-7788-4f11-a8b0-ab8df696cdb2-kube-api-access-5k5dr\") pod \"2970deea-7788-4f11-a8b0-ab8df696cdb2\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") "
Sep 10 17:27:18.429820 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.429697    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-workload-certs\") pod \"2970deea-7788-4f11-a8b0-ab8df696cdb2\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") "
Sep 10 17:27:18.429952 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.429857    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-data\") pod \"2970deea-7788-4f11-a8b0-ab8df696cdb2\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") "
Sep 10 17:27:18.429952 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.429891    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-credential-socket\") pod \"2970deea-7788-4f11-a8b0-ab8df696cdb2\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") "
Sep 10 17:27:18.430093 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.429960    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2970deea-7788-4f11-a8b0-ab8df696cdb2" (UID: "2970deea-7788-4f11-a8b0-ab8df696cdb2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:27:18.430093 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.429978    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-envoy\") pod \"2970deea-7788-4f11-a8b0-ab8df696cdb2\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") "
Sep 10 17:27:18.430093 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.430025    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-podinfo\") pod \"2970deea-7788-4f11-a8b0-ab8df696cdb2\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") "
Sep 10 17:27:18.430093 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.430072    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-workload-socket\") pod \"2970deea-7788-4f11-a8b0-ab8df696cdb2\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") "
Sep 10 17:27:18.430319 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.430117    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2970deea-7788-4f11-a8b0-ab8df696cdb2-istiod-ca-cert\") pod \"2970deea-7788-4f11-a8b0-ab8df696cdb2\" (UID: \"2970deea-7788-4f11-a8b0-ab8df696cdb2\") "
Sep 10 17:27:18.430319 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.430148    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-data" (OuterVolumeSpecName: "istio-data") pod "2970deea-7788-4f11-a8b0-ab8df696cdb2" (UID: "2970deea-7788-4f11-a8b0-ab8df696cdb2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:27:18.430319 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.430243    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2970deea-7788-4f11-a8b0-ab8df696cdb2" (UID: "2970deea-7788-4f11-a8b0-ab8df696cdb2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:27:18.430319 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.430315    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2970deea-7788-4f11-a8b0-ab8df696cdb2" (UID: "2970deea-7788-4f11-a8b0-ab8df696cdb2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:27:18.430543 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.430465    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:18.430543 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.430483    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:18.430543 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.430489    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2970deea-7788-4f11-a8b0-ab8df696cdb2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2970deea-7788-4f11-a8b0-ab8df696cdb2" (UID: "2970deea-7788-4f11-a8b0-ab8df696cdb2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:27:18.430543 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.430497    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:18.430543 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.430540    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:18.431964 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.431940    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-token" (OuterVolumeSpecName: "istio-token") pod "2970deea-7788-4f11-a8b0-ab8df696cdb2" (UID: "2970deea-7788-4f11-a8b0-ab8df696cdb2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:27:18.432184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.432162    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2970deea-7788-4f11-a8b0-ab8df696cdb2" (UID: "2970deea-7788-4f11-a8b0-ab8df696cdb2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:27:18.432258 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.432225    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2970deea-7788-4f11-a8b0-ab8df696cdb2" (UID: "2970deea-7788-4f11-a8b0-ab8df696cdb2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:27:18.432303 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.432292    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2970deea-7788-4f11-a8b0-ab8df696cdb2-kube-api-access-5k5dr" (OuterVolumeSpecName: "kube-api-access-5k5dr") pod "2970deea-7788-4f11-a8b0-ab8df696cdb2" (UID: "2970deea-7788-4f11-a8b0-ab8df696cdb2"). InnerVolumeSpecName "kube-api-access-5k5dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:27:18.500357 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.500325    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"]
Sep 10 17:27:18.531313 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.531279    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:18.531313 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.531307    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:18.531313 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.531319    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2970deea-7788-4f11-a8b0-ab8df696cdb2-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:18.531562 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.531332    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2970deea-7788-4f11-a8b0-ab8df696cdb2-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:18.531562 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:18.531345    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k5dr\" (UniqueName: \"kubernetes.io/projected/2970deea-7788-4f11-a8b0-ab8df696cdb2-kube-api-access-5k5dr\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:19.321782 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:19.321753    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"
Sep 10 17:27:19.322220 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:19.321796    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748" event={"ID":"2970deea-7788-4f11-a8b0-ab8df696cdb2","Type":"ContainerDied","Data":"38cdb13596081c512d3f55b205ec0a68b170879b03560f536a7404a85e97872e"}
Sep 10 17:27:19.322220 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:19.321855    2576 scope.go:117] "RemoveContainer" containerID="933d1f725a7e6ae7a2ee910c3fa5ee67e15c177712fa5c245452c8bf8a5df971"
Sep 10 17:27:19.343625 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:19.343536    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"]
Sep 10 17:27:19.347993 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:19.347971    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f4c26bd5-openshift-default-dc88c9976-j2748"]
Sep 10 17:27:21.084127 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:21.084097    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2970deea-7788-4f11-a8b0-ab8df696cdb2" path="/var/lib/kubelet/pods/2970deea-7788-4f11-a8b0-ab8df696cdb2/volumes"
Sep 10 17:27:31.711285 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:31.711250    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:27:33.520034 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.519987    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9" podUID="c4bc021d-d697-4a45-8f1d-b81c88d3b8a5" containerName="main" containerID="cri-o://9132b0d9fdf41fbcc2085b893b35fd79686134494fcb50b189eef3b25b4e5f86" gracePeriod=45
Sep 10 17:27:33.768480 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.768457    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:27:33.866694 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.866604    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkr9m\" (UniqueName: \"kubernetes.io/projected/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-kube-api-access-pkr9m\") pod \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") "
Sep 10 17:27:33.866694 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.866648    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-dshm\") pod \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") "
Sep 10 17:27:33.866694 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.866670    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-model-cache\") pod \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") "
Sep 10 17:27:33.866975 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.866707    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-home\") pod \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") "
Sep 10 17:27:33.866975 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.866808    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-tmp-dir\") pod \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") "
Sep 10 17:27:33.866975 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.866890    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-tls-certs\") pod \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\" (UID: \"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5\") "
Sep 10 17:27:33.866975 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.866960    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-model-cache" (OuterVolumeSpecName: "model-cache") pod "c4bc021d-d697-4a45-8f1d-b81c88d3b8a5" (UID: "c4bc021d-d697-4a45-8f1d-b81c88d3b8a5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:27:33.867207 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.866975    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-home" (OuterVolumeSpecName: "home") pod "c4bc021d-d697-4a45-8f1d-b81c88d3b8a5" (UID: "c4bc021d-d697-4a45-8f1d-b81c88d3b8a5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:27:33.867207 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.867120    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c4bc021d-d697-4a45-8f1d-b81c88d3b8a5" (UID: "c4bc021d-d697-4a45-8f1d-b81c88d3b8a5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:27:33.867298 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.867217    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-model-cache\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:33.867298 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.867237    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-home\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:33.867298 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.867251    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-tmp-dir\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:33.869100 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.869080    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c4bc021d-d697-4a45-8f1d-b81c88d3b8a5" (UID: "c4bc021d-d697-4a45-8f1d-b81c88d3b8a5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:27:33.869330 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.869315    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-kube-api-access-pkr9m" (OuterVolumeSpecName: "kube-api-access-pkr9m") pod "c4bc021d-d697-4a45-8f1d-b81c88d3b8a5" (UID: "c4bc021d-d697-4a45-8f1d-b81c88d3b8a5"). InnerVolumeSpecName "kube-api-access-pkr9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:27:33.869379 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.869331    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-dshm" (OuterVolumeSpecName: "dshm") pod "c4bc021d-d697-4a45-8f1d-b81c88d3b8a5" (UID: "c4bc021d-d697-4a45-8f1d-b81c88d3b8a5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:27:33.968394 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.968355    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-tls-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:33.968394 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.968388    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkr9m\" (UniqueName: \"kubernetes.io/projected/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-kube-api-access-pkr9m\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:33.968394 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:33.968404    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5-dshm\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:34.397644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:34.397611    2576 generic.go:356] "Generic (PLEG): container finished" podID="c4bc021d-d697-4a45-8f1d-b81c88d3b8a5" containerID="9132b0d9fdf41fbcc2085b893b35fd79686134494fcb50b189eef3b25b4e5f86" exitCode=0
Sep 10 17:27:34.397855 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:34.397660    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"
Sep 10 17:27:34.397855 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:34.397690    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9" event={"ID":"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5","Type":"ContainerDied","Data":"9132b0d9fdf41fbcc2085b893b35fd79686134494fcb50b189eef3b25b4e5f86"}
Sep 10 17:27:34.397855 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:34.397729    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9" event={"ID":"c4bc021d-d697-4a45-8f1d-b81c88d3b8a5","Type":"ContainerDied","Data":"01d24f4f6ecd373e99c6a32fc7dd2fb7d7124ab5239a59207d6b169f9c8a931f"}
Sep 10 17:27:34.397855 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:34.397748    2576 scope.go:117] "RemoveContainer" containerID="9132b0d9fdf41fbcc2085b893b35fd79686134494fcb50b189eef3b25b4e5f86"
Sep 10 17:27:34.406873 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:34.406855    2576 scope.go:117] "RemoveContainer" containerID="9132b0d9fdf41fbcc2085b893b35fd79686134494fcb50b189eef3b25b4e5f86"
Sep 10 17:27:34.407170 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:27:34.407150    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9132b0d9fdf41fbcc2085b893b35fd79686134494fcb50b189eef3b25b4e5f86\": container with ID starting with 9132b0d9fdf41fbcc2085b893b35fd79686134494fcb50b189eef3b25b4e5f86 not found: ID does not exist" containerID="9132b0d9fdf41fbcc2085b893b35fd79686134494fcb50b189eef3b25b4e5f86"
Sep 10 17:27:34.407253 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:34.407181    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9132b0d9fdf41fbcc2085b893b35fd79686134494fcb50b189eef3b25b4e5f86"} err="failed to get container status \"9132b0d9fdf41fbcc2085b893b35fd79686134494fcb50b189eef3b25b4e5f86\": rpc error: code = NotFound desc = could not find container \"9132b0d9fdf41fbcc2085b893b35fd79686134494fcb50b189eef3b25b4e5f86\": container with ID starting with 9132b0d9fdf41fbcc2085b893b35fd79686134494fcb50b189eef3b25b4e5f86 not found: ID does not exist"
Sep 10 17:27:34.420136 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:34.420100    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"]
Sep 10 17:27:34.429594 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:34.429568    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-171e086f-kserve-85577b75b7-778z9"]
Sep 10 17:27:35.084532 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:35.084499    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4bc021d-d697-4a45-8f1d-b81c88d3b8a5" path="/var/lib/kubelet/pods/c4bc021d-d697-4a45-8f1d-b81c88d3b8a5/volumes"
Sep 10 17:27:36.081201 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081170    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"]
Sep 10 17:27:36.081513 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081501    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2970deea-7788-4f11-a8b0-ab8df696cdb2" containerName="istio-proxy"
Sep 10 17:27:36.081577 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081514    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2970deea-7788-4f11-a8b0-ab8df696cdb2" containerName="istio-proxy"
Sep 10 17:27:36.081577 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081525    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b7b9f11-03fb-466d-934d-b7ec1ef52f35" containerName="payload-pre-processing"
Sep 10 17:27:36.081577 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081532    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b7b9f11-03fb-466d-934d-b7ec1ef52f35" containerName="payload-pre-processing"
Sep 10 17:27:36.081577 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081541    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4bc021d-d697-4a45-8f1d-b81c88d3b8a5" containerName="main"
Sep 10 17:27:36.081577 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081546    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4bc021d-d697-4a45-8f1d-b81c88d3b8a5" containerName="main"
Sep 10 17:27:36.081577 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081553    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2970deea-7788-4f11-a8b0-ab8df696cdb2" containerName="istio-proxy"
Sep 10 17:27:36.081577 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081557    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2970deea-7788-4f11-a8b0-ab8df696cdb2" containerName="istio-proxy"
Sep 10 17:27:36.081577 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081562    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af095b6d-1ef6-4f79-bfe0-07288bc378cc" containerName="payload-processing"
Sep 10 17:27:36.081577 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081568    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="af095b6d-1ef6-4f79-bfe0-07288bc378cc" containerName="payload-processing"
Sep 10 17:27:36.081577 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081579    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="766b4aa5-b899-43a1-9de4-1370f264bf96" containerName="revoke-keys"
Sep 10 17:27:36.081911 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081585    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="766b4aa5-b899-43a1-9de4-1370f264bf96" containerName="revoke-keys"
Sep 10 17:27:36.081911 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081645    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2970deea-7788-4f11-a8b0-ab8df696cdb2" containerName="istio-proxy"
Sep 10 17:27:36.081911 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081652    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b7b9f11-03fb-466d-934d-b7ec1ef52f35" containerName="payload-pre-processing"
Sep 10 17:27:36.081911 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081659    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="af095b6d-1ef6-4f79-bfe0-07288bc378cc" containerName="payload-processing"
Sep 10 17:27:36.081911 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081666    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="766b4aa5-b899-43a1-9de4-1370f264bf96" containerName="revoke-keys"
Sep 10 17:27:36.081911 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081672    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4bc021d-d697-4a45-8f1d-b81c88d3b8a5" containerName="main"
Sep 10 17:27:36.081911 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.081676    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2970deea-7788-4f11-a8b0-ab8df696cdb2" containerName="istio-proxy"
Sep 10 17:27:36.085674 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.085655    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.096203 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.096179    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-75bd9a\"/\"kube-root-ca.crt\""
Sep 10 17:27:36.096331 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.096289    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-75bd9a\"/\"default-dockercfg-jwd6h\""
Sep 10 17:27:36.096404 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.096347    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-75bd9a\"/\"openshift-service-ca.crt\""
Sep 10 17:27:36.096459 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.096348    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-75bd9a\"/\"test-model-75bd9a-kserve-self-signed-certs\""
Sep 10 17:27:36.110346 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.110317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"]
Sep 10 17:27:36.186100 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.186037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-model-cache\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.186100 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.186096    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt25p\" (UniqueName: \"kubernetes.io/projected/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-kube-api-access-pt25p\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.186304 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.186184    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-home\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.186304 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.186215    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-tls-certs\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.186304 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.186263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-dshm\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.186304 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.186297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-tmp-dir\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.287198 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.287159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-home\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.287198 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.287196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-tls-certs\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.287461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.287227    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-dshm\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.287461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.287252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-tmp-dir\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.287461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.287300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-model-cache\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.287461 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.287344    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt25p\" (UniqueName: \"kubernetes.io/projected/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-kube-api-access-pt25p\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.287680 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.287644    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-home\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.287725 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.287705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-tmp-dir\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.287764 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.287738    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-model-cache\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.289544 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.289522    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-dshm\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.289788 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.289772    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-tls-certs\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.299267 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.299245    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt25p\" (UniqueName: \"kubernetes.io/projected/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-kube-api-access-pt25p\") pod \"test-model-75bd9a-kserve-6d55d79cc-dhhq2\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") " pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.394724 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.394688    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:36.679629 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:36.679551    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"]
Sep 10 17:27:36.685487 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:27:36.685459    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c4a9cdf_e0d5_48df_87c5_5deb320a5df1.slice/crio-eb5f8057ff513543fefd95db1e96f74a5ceb0707f2aa47352faeb73c5693437a WatchSource:0}: Error finding container eb5f8057ff513543fefd95db1e96f74a5ceb0707f2aa47352faeb73c5693437a: Status 404 returned error can't find the container with id eb5f8057ff513543fefd95db1e96f74a5ceb0707f2aa47352faeb73c5693437a
Sep 10 17:27:37.418191 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:37.418156    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2" event={"ID":"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1","Type":"ContainerStarted","Data":"3030368998d692d112b0c8ba9b6b48dc95ca15280b69b468ed497f6ba09676cc"}
Sep 10 17:27:37.418601 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:37.418203    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2" event={"ID":"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1","Type":"ContainerStarted","Data":"eb5f8057ff513543fefd95db1e96f74a5ceb0707f2aa47352faeb73c5693437a"}
Sep 10 17:27:37.465684 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:37.465626    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2" podStartSLOduration=1.465608797 podStartE2EDuration="1.465608797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:27:37.464720395 +0000 UTC m=+942.880771345" watchObservedRunningTime="2026-09-10 17:27:37.465608797 +0000 UTC m=+942.881659796"
Sep 10 17:27:41.527573 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:41.527535    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"]
Sep 10 17:27:41.527974 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:41.527775    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn" podUID="48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" containerName="istio-proxy" containerID="cri-o://b9e833fc81a8fdbc4c85087579d6b70c1e56b20691bf82ddd1fb745dd8b8b560" gracePeriod=30
Sep 10 17:27:42.347949 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.347912    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"]
Sep 10 17:27:42.351485 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.351462    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.359284 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.359264    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-4b53b5-openshift-default-dockercfg-j6bkn\""
Sep 10 17:27:42.373899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.373872    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"]
Sep 10 17:27:42.443494 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.443462    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-workload-socket\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.443675 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.443512    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-credential-socket\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.443675 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.443552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-data\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.443675 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.443609    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-token\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.443675 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.443629    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-envoy\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.443675 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.443646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istiod-ca-cert\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.443846 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.443674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86288\" (UniqueName: \"kubernetes.io/projected/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-kube-api-access-86288\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.443846 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.443701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-workload-certs\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.443846 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.443751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-podinfo\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.544404 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.544360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-podinfo\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.544404 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.544404    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-workload-socket\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.544899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.544533    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-credential-socket\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.544899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.544585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-data\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.544899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.544666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-token\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.544899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.544697    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-envoy\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.544899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.544726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istiod-ca-cert\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.544899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.544751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86288\" (UniqueName: \"kubernetes.io/projected/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-kube-api-access-86288\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.544899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.544771    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-workload-socket\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.544899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.544860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-credential-socket\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.545329 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.544924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-workload-certs\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.545329 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.544949    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-data\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.545403 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.545326    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-workload-certs\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.545403 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.545370    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istiod-ca-cert\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.546909 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.546886    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-envoy\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.546998 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.546931    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-podinfo\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.557416 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.557390    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86288\" (UniqueName: \"kubernetes.io/projected/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-kube-api-access-86288\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.557517 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.557438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-token\") pod \"e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") " pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.661355 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.661321    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:42.945693 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.945613    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"]
Sep 10 17:27:42.948984 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:27:42.948955    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b6272ab_a9ee_46aa_bfa0_c18c50b6adb8.slice/crio-95629069a437ed92049b52a1689c76dcc28b85bb4d302d5dd6189a3830acef54 WatchSource:0}: Error finding container 95629069a437ed92049b52a1689c76dcc28b85bb4d302d5dd6189a3830acef54: Status 404 returned error can't find the container with id 95629069a437ed92049b52a1689c76dcc28b85bb4d302d5dd6189a3830acef54
Sep 10 17:27:42.951029 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.951003    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:27:42.951095 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.951086    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:27:42.951139 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:42.951112    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:27:43.449908 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:43.449870    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc" event={"ID":"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8","Type":"ContainerStarted","Data":"43a81406589287809f94ccdf831b3d7068915e125ecb2163e0ac5ad2b0322375"}
Sep 10 17:27:43.450136 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:43.449928    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc" event={"ID":"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8","Type":"ContainerStarted","Data":"95629069a437ed92049b52a1689c76dcc28b85bb4d302d5dd6189a3830acef54"}
Sep 10 17:27:43.475110 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:43.475036    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc" podStartSLOduration=1.475017973 podStartE2EDuration="1.475017973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:27:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:27:43.473001466 +0000 UTC m=+948.889052415" watchObservedRunningTime="2026-09-10 17:27:43.475017973 +0000 UTC m=+948.891068993"
Sep 10 17:27:43.661832 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:43.661801    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:44.667489 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:44.667461    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:44.745002 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:44.744968    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:27:45.461111 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:45.461078    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:45.461975 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:45.461957    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:27:46.395761 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.395723    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:46.396264 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.395785    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:46.408318 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.408290    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:46.476889 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.476861    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:27:46.772916 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.772891    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:27:46.882631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.882600    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-envoy\") pod \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") "
Sep 10 17:27:46.882788 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.882638    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-workload-certs\") pod \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") "
Sep 10 17:27:46.882788 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.882677    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-data\") pod \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") "
Sep 10 17:27:46.882788 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.882697    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-token\") pod \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") "
Sep 10 17:27:46.882788 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.882729    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-podinfo\") pod \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") "
Sep 10 17:27:46.882788 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.882769    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istiod-ca-cert\") pod \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") "
Sep 10 17:27:46.883094 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.882961    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-data" (OuterVolumeSpecName: "istio-data") pod "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" (UID: "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:27:46.883094 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.883017    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-credential-socket\") pod \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") "
Sep 10 17:27:46.883094 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.883041    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" (UID: "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:27:46.883267 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.883114    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-workload-socket\") pod \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") "
Sep 10 17:27:46.883267 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.883149    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tbfl\" (UniqueName: \"kubernetes.io/projected/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-kube-api-access-8tbfl\") pod \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\" (UID: \"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f\") "
Sep 10 17:27:46.883267 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.883171    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" (UID: "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:27:46.883430 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.883259    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" (UID: "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:27:46.883430 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.883397    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" (UID: "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:27:46.883568 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.883548    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:46.883619 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.883572    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:46.883619 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.883586    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:46.883619 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.883597    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:46.883619 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.883609    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:46.885087 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.885038    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-token" (OuterVolumeSpecName: "istio-token") pod "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" (UID: "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:27:46.885215 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.885089    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-kube-api-access-8tbfl" (OuterVolumeSpecName: "kube-api-access-8tbfl") pod "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" (UID: "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f"). InnerVolumeSpecName "kube-api-access-8tbfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:27:46.885215 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.885102    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" (UID: "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:27:46.885502 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.885487    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" (UID: "48d30aba-7eab-41fc-b6f7-53a4e94f8f9f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:27:46.985107 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.985002    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:46.985107 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.985033    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:46.985107 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.985043    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tbfl\" (UniqueName: \"kubernetes.io/projected/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-kube-api-access-8tbfl\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:46.985107 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:46.985079    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:27:47.472833 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:47.472796    2576 generic.go:356] "Generic (PLEG): container finished" podID="48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" containerID="b9e833fc81a8fdbc4c85087579d6b70c1e56b20691bf82ddd1fb745dd8b8b560" exitCode=0
Sep 10 17:27:47.473351 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:47.472841    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"
Sep 10 17:27:47.473351 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:47.472881    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn" event={"ID":"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f","Type":"ContainerDied","Data":"b9e833fc81a8fdbc4c85087579d6b70c1e56b20691bf82ddd1fb745dd8b8b560"}
Sep 10 17:27:47.473351 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:47.472941    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn" event={"ID":"48d30aba-7eab-41fc-b6f7-53a4e94f8f9f","Type":"ContainerDied","Data":"be42639e197d0cd470c3174f5613df55dfe24637d9529af5faed2cfe904ccc06"}
Sep 10 17:27:47.473351 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:47.472966    2576 scope.go:117] "RemoveContainer" containerID="b9e833fc81a8fdbc4c85087579d6b70c1e56b20691bf82ddd1fb745dd8b8b560"
Sep 10 17:27:47.482320 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:47.482299    2576 scope.go:117] "RemoveContainer" containerID="8688a32e741edfb798ff4fd406c6baaac6fc3cc1f022a89cf157b00639c81c1c"
Sep 10 17:27:47.490479 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:47.490456    2576 scope.go:117] "RemoveContainer" containerID="b9e833fc81a8fdbc4c85087579d6b70c1e56b20691bf82ddd1fb745dd8b8b560"
Sep 10 17:27:47.490745 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:27:47.490725    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9e833fc81a8fdbc4c85087579d6b70c1e56b20691bf82ddd1fb745dd8b8b560\": container with ID starting with b9e833fc81a8fdbc4c85087579d6b70c1e56b20691bf82ddd1fb745dd8b8b560 not found: ID does not exist" containerID="b9e833fc81a8fdbc4c85087579d6b70c1e56b20691bf82ddd1fb745dd8b8b560"
Sep 10 17:27:47.490817 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:47.490760    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9e833fc81a8fdbc4c85087579d6b70c1e56b20691bf82ddd1fb745dd8b8b560"} err="failed to get container status \"b9e833fc81a8fdbc4c85087579d6b70c1e56b20691bf82ddd1fb745dd8b8b560\": rpc error: code = NotFound desc = could not find container \"b9e833fc81a8fdbc4c85087579d6b70c1e56b20691bf82ddd1fb745dd8b8b560\": container with ID starting with b9e833fc81a8fdbc4c85087579d6b70c1e56b20691bf82ddd1fb745dd8b8b560 not found: ID does not exist"
Sep 10 17:27:47.490817 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:47.490788    2576 scope.go:117] "RemoveContainer" containerID="8688a32e741edfb798ff4fd406c6baaac6fc3cc1f022a89cf157b00639c81c1c"
Sep 10 17:27:47.491076 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:27:47.491041    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8688a32e741edfb798ff4fd406c6baaac6fc3cc1f022a89cf157b00639c81c1c\": container with ID starting with 8688a32e741edfb798ff4fd406c6baaac6fc3cc1f022a89cf157b00639c81c1c not found: ID does not exist" containerID="8688a32e741edfb798ff4fd406c6baaac6fc3cc1f022a89cf157b00639c81c1c"
Sep 10 17:27:47.491123 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:47.491085    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8688a32e741edfb798ff4fd406c6baaac6fc3cc1f022a89cf157b00639c81c1c"} err="failed to get container status \"8688a32e741edfb798ff4fd406c6baaac6fc3cc1f022a89cf157b00639c81c1c\": rpc error: code = NotFound desc = could not find container \"8688a32e741edfb798ff4fd406c6baaac6fc3cc1f022a89cf157b00639c81c1c\": container with ID starting with 8688a32e741edfb798ff4fd406c6baaac6fc3cc1f022a89cf157b00639c81c1c not found: ID does not exist"
Sep 10 17:27:47.517298 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:47.517268    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"]
Sep 10 17:27:47.527632 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:47.527592    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-889898-openshift-default-5756f89cb6-t4bmn"]
Sep 10 17:27:48.402662 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.402627    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"]
Sep 10 17:27:48.403042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.403024    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" containerName="istio-proxy"
Sep 10 17:27:48.403174 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.403045    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" containerName="istio-proxy"
Sep 10 17:27:48.403174 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.403092    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" containerName="istio-proxy"
Sep 10 17:27:48.403174 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.403102    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" containerName="istio-proxy"
Sep 10 17:27:48.403337 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.403196    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" containerName="istio-proxy"
Sep 10 17:27:48.403337 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.403211    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" containerName="istio-proxy"
Sep 10 17:27:48.407508 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.407488    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"
Sep 10 17:27:48.425215 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.425190    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-4b53b5\""
Sep 10 17:27:48.425321 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.425241    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-4b53b5-dockercfg-9dgcd\""
Sep 10 17:27:48.446707 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.446678    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"]
Sep 10 17:27:48.497889 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.497854    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc578af2-e082-4a26-9047-780861988616-plugins-config-volume\") pod \"payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh\" (UID: \"cc578af2-e082-4a26-9047-780861988616\") " pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"
Sep 10 17:27:48.497889 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.497892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rqll\" (UniqueName: \"kubernetes.io/projected/cc578af2-e082-4a26-9047-780861988616-kube-api-access-6rqll\") pod \"payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh\" (UID: \"cc578af2-e082-4a26-9047-780861988616\") " pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"
Sep 10 17:27:48.599211 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.599177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc578af2-e082-4a26-9047-780861988616-plugins-config-volume\") pod \"payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh\" (UID: \"cc578af2-e082-4a26-9047-780861988616\") " pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"
Sep 10 17:27:48.599399 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.599216    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rqll\" (UniqueName: \"kubernetes.io/projected/cc578af2-e082-4a26-9047-780861988616-kube-api-access-6rqll\") pod \"payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh\" (UID: \"cc578af2-e082-4a26-9047-780861988616\") " pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"
Sep 10 17:27:48.599976 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.599955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc578af2-e082-4a26-9047-780861988616-plugins-config-volume\") pod \"payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh\" (UID: \"cc578af2-e082-4a26-9047-780861988616\") " pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"
Sep 10 17:27:48.612458 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.612434    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rqll\" (UniqueName: \"kubernetes.io/projected/cc578af2-e082-4a26-9047-780861988616-kube-api-access-6rqll\") pod \"payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh\" (UID: \"cc578af2-e082-4a26-9047-780861988616\") " pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"
Sep 10 17:27:48.716596 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.716488    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"
Sep 10 17:27:48.996717 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:48.996631    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"]
Sep 10 17:27:48.999432 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:27:48.999401    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc578af2_e082_4a26_9047_780861988616.slice/crio-e3e2e0ac476b2872d1ecabb432cf1c52a39f7ae959af750f8fd2631c382e7c07 WatchSource:0}: Error finding container e3e2e0ac476b2872d1ecabb432cf1c52a39f7ae959af750f8fd2631c382e7c07: Status 404 returned error can't find the container with id e3e2e0ac476b2872d1ecabb432cf1c52a39f7ae959af750f8fd2631c382e7c07
Sep 10 17:27:49.086139 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:49.086109    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48d30aba-7eab-41fc-b6f7-53a4e94f8f9f" path="/var/lib/kubelet/pods/48d30aba-7eab-41fc-b6f7-53a4e94f8f9f/volumes"
Sep 10 17:27:49.486610 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:49.486573    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh" event={"ID":"cc578af2-e082-4a26-9047-780861988616","Type":"ContainerStarted","Data":"7bcc61d07f505c801aced43294954e0301d7a495bbf2bd2a0dfeaa7b334686b3"}
Sep 10 17:27:49.486864 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:49.486634    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh" event={"ID":"cc578af2-e082-4a26-9047-780861988616","Type":"ContainerStarted","Data":"e3e2e0ac476b2872d1ecabb432cf1c52a39f7ae959af750f8fd2631c382e7c07"}
Sep 10 17:27:49.486864 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:49.486668    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"
Sep 10 17:27:49.531478 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:27:49.531423    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh" podStartSLOduration=1.5314049170000001 podStartE2EDuration="1.531404917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:27:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:27:49.521824311 +0000 UTC m=+954.937875260" watchObservedRunningTime="2026-09-10 17:27:49.531404917 +0000 UTC m=+954.947455866"
Sep 10 17:28:00.493264 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:00.493222    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"
Sep 10 17:28:02.519239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:02.519205    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:28:05.568216 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:05.568182    2576 generic.go:356] "Generic (PLEG): container finished" podID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" containerID="43a81406589287809f94ccdf831b3d7068915e125ecb2163e0ac5ad2b0322375" exitCode=0
Sep 10 17:28:05.568643 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:05.568232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc" event={"ID":"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8","Type":"ContainerDied","Data":"43a81406589287809f94ccdf831b3d7068915e125ecb2163e0ac5ad2b0322375"}
Sep 10 17:28:05.568643 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:05.568613    2576 scope.go:117] "RemoveContainer" containerID="43a81406589287809f94ccdf831b3d7068915e125ecb2163e0ac5ad2b0322375"
Sep 10 17:28:05.569644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:05.569618    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:28:05.569714 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:05.569683    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:28:05.569752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:05.569716    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:28:06.575146 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:06.575109    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc" event={"ID":"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8","Type":"ContainerStarted","Data":"854faab232a66c3995f056db5ceecd11db23089a609032c43c863a74e900742f"}
Sep 10 17:28:06.661761 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:06.661726    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:28:06.662098 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:06.662071    2576 patch_prober.go:28] interesting pod/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 17:28:06.662161 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:06.662129    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc" podUID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 17:28:07.662337 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:07.662304    2576 patch_prober.go:28] interesting pod/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 17:28:07.662705 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:07.662358    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc" podUID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 17:28:08.662529 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:08.662493    2576 patch_prober.go:28] interesting pod/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 17:28:08.662914 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:08.662546    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc" podUID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 17:28:09.661981 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:09.661943    2576 patch_prober.go:28] interesting pod/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 17:28:09.662184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:09.662000    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc" podUID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 17:28:10.662089 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:10.662027    2576 patch_prober.go:28] interesting pod/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 17:28:10.662476 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:10.662111    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc" podUID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 17:28:11.662425 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:11.662387    2576 patch_prober.go:28] interesting pod/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 10 17:28:11.662818 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:11.662459    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc" podUID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 10 17:28:12.666577 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:12.666542    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:28:12.667021 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:12.666854    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:28:12.667507 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:12.667488    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:28:16.315861 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:16.315826    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:28:24.458650 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.458558    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"]
Sep 10 17:28:24.461408 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.461384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.464624 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.464597    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-4b53b5\"/\"kube-root-ca.crt\""
Sep 10 17:28:24.465378 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.465354    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-4b53b5\"/\"explicit-model-4b53b5-kserve-self-signed-certs\""
Sep 10 17:28:24.465511 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.465388    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-4b53b5\"/\"default-dockercfg-q2zfq\""
Sep 10 17:28:24.465578 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.465399    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-4b53b5\"/\"openshift-service-ca.crt\""
Sep 10 17:28:24.482892 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.482865    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"]
Sep 10 17:28:24.529491 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.529455    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-home\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.529491 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.529489    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c81a68ea-b06b-4374-af45-a524c50ac773-tls-certs\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.529736 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.529514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-model-cache\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.529736 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.529672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-tmp-dir\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.529736 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.529705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-dshm\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.529736 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.529731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55qgj\" (UniqueName: \"kubernetes.io/projected/c81a68ea-b06b-4374-af45-a524c50ac773-kube-api-access-55qgj\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.630877 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.630838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-dshm\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.630877 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.630883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55qgj\" (UniqueName: \"kubernetes.io/projected/c81a68ea-b06b-4374-af45-a524c50ac773-kube-api-access-55qgj\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.631163 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.630924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-home\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.631163 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.630938    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c81a68ea-b06b-4374-af45-a524c50ac773-tls-certs\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.631163 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.630958    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-model-cache\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.631163 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.631024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-tmp-dir\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.631432 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.631405    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-model-cache\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.631520 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.631417    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-home\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.631520 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.631482    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-tmp-dir\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.633260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.633237    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-dshm\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.633418 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.633403    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c81a68ea-b06b-4374-af45-a524c50ac773-tls-certs\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.642474 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.642441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55qgj\" (UniqueName: \"kubernetes.io/projected/c81a68ea-b06b-4374-af45-a524c50ac773-kube-api-access-55qgj\") pod \"explicit-model-4b53b5-kserve-67488954c5-6z45l\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") " pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:24.772536 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:24.772440    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:25.052203 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:25.052124    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"]
Sep 10 17:28:25.055036 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:28:25.055010    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc81a68ea_b06b_4374_af45_a524c50ac773.slice/crio-aa04b19f475925e79f57bbb3ed939612fd3868230b6e9feff0ccd56d4134fbd8 WatchSource:0}: Error finding container aa04b19f475925e79f57bbb3ed939612fd3868230b6e9feff0ccd56d4134fbd8: Status 404 returned error can't find the container with id aa04b19f475925e79f57bbb3ed939612fd3868230b6e9feff0ccd56d4134fbd8
Sep 10 17:28:25.691256 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:25.691222    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l" event={"ID":"c81a68ea-b06b-4374-af45-a524c50ac773","Type":"ContainerStarted","Data":"b07b309b53239266bb5e989f6c744811ad0f61003b0f44ccf1f8a671acc5e485"}
Sep 10 17:28:25.691256 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:25.691263    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l" event={"ID":"c81a68ea-b06b-4374-af45-a524c50ac773","Type":"ContainerStarted","Data":"aa04b19f475925e79f57bbb3ed939612fd3868230b6e9feff0ccd56d4134fbd8"}
Sep 10 17:28:25.722920 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:25.722866    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l" podStartSLOduration=1.722850372 podStartE2EDuration="1.722850372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:28:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:28:25.72116314 +0000 UTC m=+991.137214090" watchObservedRunningTime="2026-09-10 17:28:25.722850372 +0000 UTC m=+991.138901320"
Sep 10 17:28:25.817798 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:25.817764    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:28:34.772781 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:34.772739    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:34.773261 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:34.772802    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:34.786024 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:34.785997    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:35.752550 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:35.752517    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:41.059991 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:41.059956    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"]
Sep 10 17:28:41.236100 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:41.236067    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk"]
Sep 10 17:28:41.239497 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:41.239479    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk"
Sep 10 17:28:41.245063 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:41.245032    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 17:28:41.245193 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:41.245086    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4mln5\""
Sep 10 17:28:41.265386 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:41.265359    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk"]
Sep 10 17:28:41.376824 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:41.376784    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86fa97c0-48ae-4969-bd94-712456e8fd88-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk\" (UID: \"86fa97c0-48ae-4969-bd94-712456e8fd88\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk"
Sep 10 17:28:41.477274 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:41.477235    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86fa97c0-48ae-4969-bd94-712456e8fd88-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk\" (UID: \"86fa97c0-48ae-4969-bd94-712456e8fd88\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk"
Sep 10 17:28:41.477884 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:41.477862    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86fa97c0-48ae-4969-bd94-712456e8fd88-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk\" (UID: \"86fa97c0-48ae-4969-bd94-712456e8fd88\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk"
Sep 10 17:28:41.550266 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:41.550214    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk"
Sep 10 17:28:41.838924 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:41.838840    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk"]
Sep 10 17:28:41.841815 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:28:41.841789    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86fa97c0_48ae_4969_bd94_712456e8fd88.slice/crio-cd69129b17976f0d462e97b5216e49524bcea454fb756febb055f6901141db1b WatchSource:0}: Error finding container cd69129b17976f0d462e97b5216e49524bcea454fb756febb055f6901141db1b: Status 404 returned error can't find the container with id cd69129b17976f0d462e97b5216e49524bcea454fb756febb055f6901141db1b
Sep 10 17:28:42.776105 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:42.776046    2576 generic.go:356] "Generic (PLEG): container finished" podID="86fa97c0-48ae-4969-bd94-712456e8fd88" containerID="24176120ef4b2c6ec1457060915e1643977a5230887a403176c664b2168378e9" exitCode=0
Sep 10 17:28:42.776105 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:42.776087    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk" event={"ID":"86fa97c0-48ae-4969-bd94-712456e8fd88","Type":"ContainerDied","Data":"24176120ef4b2c6ec1457060915e1643977a5230887a403176c664b2168378e9"}
Sep 10 17:28:42.776526 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:42.776174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk" event={"ID":"86fa97c0-48ae-4969-bd94-712456e8fd88","Type":"ContainerStarted","Data":"cd69129b17976f0d462e97b5216e49524bcea454fb756febb055f6901141db1b"}
Sep 10 17:28:43.912397 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:43.912371    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk"
Sep 10 17:28:43.999124 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:43.999092    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86fa97c0-48ae-4969-bd94-712456e8fd88-maas-api-service-ca\") pod \"86fa97c0-48ae-4969-bd94-712456e8fd88\" (UID: \"86fa97c0-48ae-4969-bd94-712456e8fd88\") "
Sep 10 17:28:43.999507 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:43.999480    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86fa97c0-48ae-4969-bd94-712456e8fd88-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "86fa97c0-48ae-4969-bd94-712456e8fd88" (UID: "86fa97c0-48ae-4969-bd94-712456e8fd88"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:28:44.099716 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:44.099640    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86fa97c0-48ae-4969-bd94-712456e8fd88-maas-api-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:28:44.129388 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:44.129346    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:28:44.787981 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:44.787944    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk" event={"ID":"86fa97c0-48ae-4969-bd94-712456e8fd88","Type":"ContainerDied","Data":"cd69129b17976f0d462e97b5216e49524bcea454fb756febb055f6901141db1b"}
Sep 10 17:28:44.788189 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:44.787996    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd69129b17976f0d462e97b5216e49524bcea454fb756febb055f6901141db1b"
Sep 10 17:28:44.788189 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:44.787961    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk"
Sep 10 17:28:50.957327 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:50.957297    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"]
Sep 10 17:28:51.065648 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:51.065616    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc"]
Sep 10 17:28:51.066000 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:51.065983    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86fa97c0-48ae-4969-bd94-712456e8fd88" containerName="revoke-keys"
Sep 10 17:28:51.066000 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:51.066000    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="86fa97c0-48ae-4969-bd94-712456e8fd88" containerName="revoke-keys"
Sep 10 17:28:51.066175 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:51.066078    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="86fa97c0-48ae-4969-bd94-712456e8fd88" containerName="revoke-keys"
Sep 10 17:28:51.069216 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:51.069194    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc"
Sep 10 17:28:51.071926 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:51.071904    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4mln5\""
Sep 10 17:28:51.072145 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:51.072131    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 17:28:51.087101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:51.087071    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc"]
Sep 10 17:28:51.161134 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:51.161098    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7311b05e-e192-4f28-a878-01fafd91c8dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc\" (UID: \"7311b05e-e192-4f28-a878-01fafd91c8dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc"
Sep 10 17:28:51.262623 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:51.262529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7311b05e-e192-4f28-a878-01fafd91c8dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc\" (UID: \"7311b05e-e192-4f28-a878-01fafd91c8dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc"
Sep 10 17:28:51.263469 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:51.263437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7311b05e-e192-4f28-a878-01fafd91c8dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc\" (UID: \"7311b05e-e192-4f28-a878-01fafd91c8dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc"
Sep 10 17:28:51.380580 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:51.380547    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc"
Sep 10 17:28:51.664783 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:51.664750    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc"]
Sep 10 17:28:51.667845 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:28:51.667818    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7311b05e_e192_4f28_a878_01fafd91c8dc.slice/crio-d761ec0c85d598700b71c81ed9db886e5c4b7228e15c42568ddef4715188ff54 WatchSource:0}: Error finding container d761ec0c85d598700b71c81ed9db886e5c4b7228e15c42568ddef4715188ff54: Status 404 returned error can't find the container with id d761ec0c85d598700b71c81ed9db886e5c4b7228e15c42568ddef4715188ff54
Sep 10 17:28:51.822070 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:51.822014    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc" event={"ID":"7311b05e-e192-4f28-a878-01fafd91c8dc","Type":"ContainerStarted","Data":"d761ec0c85d598700b71c81ed9db886e5c4b7228e15c42568ddef4715188ff54"}
Sep 10 17:28:52.160396 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.160365    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"]
Sep 10 17:28:52.160786 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.160552    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh" podUID="cc578af2-e082-4a26-9047-780861988616" containerName="payload-processing" containerID="cri-o://7bcc61d07f505c801aced43294954e0301d7a495bbf2bd2a0dfeaa7b334686b3" gracePeriod=30
Sep 10 17:28:52.394624 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.394595    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"
Sep 10 17:28:52.558537 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.558452    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk"]
Sep 10 17:28:52.562768 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.562742    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-4b53b5-czwqk"]
Sep 10 17:28:52.573265 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.573234    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rqll\" (UniqueName: \"kubernetes.io/projected/cc578af2-e082-4a26-9047-780861988616-kube-api-access-6rqll\") pod \"cc578af2-e082-4a26-9047-780861988616\" (UID: \"cc578af2-e082-4a26-9047-780861988616\") "
Sep 10 17:28:52.573434 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.573344    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc578af2-e082-4a26-9047-780861988616-plugins-config-volume\") pod \"cc578af2-e082-4a26-9047-780861988616\" (UID: \"cc578af2-e082-4a26-9047-780861988616\") "
Sep 10 17:28:52.573727 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.573701    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc578af2-e082-4a26-9047-780861988616-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc578af2-e082-4a26-9047-780861988616" (UID: "cc578af2-e082-4a26-9047-780861988616"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:28:52.575333 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.575309    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc578af2-e082-4a26-9047-780861988616-kube-api-access-6rqll" (OuterVolumeSpecName: "kube-api-access-6rqll") pod "cc578af2-e082-4a26-9047-780861988616" (UID: "cc578af2-e082-4a26-9047-780861988616"). InnerVolumeSpecName "kube-api-access-6rqll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:28:52.674348 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.674297    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc578af2-e082-4a26-9047-780861988616-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:28:52.674348 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.674341    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rqll\" (UniqueName: \"kubernetes.io/projected/cc578af2-e082-4a26-9047-780861988616-kube-api-access-6rqll\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:28:52.828122 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.828008    2576 generic.go:356] "Generic (PLEG): container finished" podID="cc578af2-e082-4a26-9047-780861988616" containerID="7bcc61d07f505c801aced43294954e0301d7a495bbf2bd2a0dfeaa7b334686b3" exitCode=0
Sep 10 17:28:52.828122 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.828088    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"
Sep 10 17:28:52.828122 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.828101    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh" event={"ID":"cc578af2-e082-4a26-9047-780861988616","Type":"ContainerDied","Data":"7bcc61d07f505c801aced43294954e0301d7a495bbf2bd2a0dfeaa7b334686b3"}
Sep 10 17:28:52.828361 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.828169    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh" event={"ID":"cc578af2-e082-4a26-9047-780861988616","Type":"ContainerDied","Data":"e3e2e0ac476b2872d1ecabb432cf1c52a39f7ae959af750f8fd2631c382e7c07"}
Sep 10 17:28:52.828361 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.828208    2576 scope.go:117] "RemoveContainer" containerID="7bcc61d07f505c801aced43294954e0301d7a495bbf2bd2a0dfeaa7b334686b3"
Sep 10 17:28:52.829734 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.829712    2576 generic.go:356] "Generic (PLEG): container finished" podID="7311b05e-e192-4f28-a878-01fafd91c8dc" containerID="3033fae770e8f038d9efc688f07f0f11779b2639d0c42e48de58ed40a0bc661a" exitCode=0
Sep 10 17:28:52.829847 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.829788    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc" event={"ID":"7311b05e-e192-4f28-a878-01fafd91c8dc","Type":"ContainerDied","Data":"3033fae770e8f038d9efc688f07f0f11779b2639d0c42e48de58ed40a0bc661a"}
Sep 10 17:28:52.842760 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.842739    2576 scope.go:117] "RemoveContainer" containerID="7bcc61d07f505c801aced43294954e0301d7a495bbf2bd2a0dfeaa7b334686b3"
Sep 10 17:28:52.843105 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:28:52.843085    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bcc61d07f505c801aced43294954e0301d7a495bbf2bd2a0dfeaa7b334686b3\": container with ID starting with 7bcc61d07f505c801aced43294954e0301d7a495bbf2bd2a0dfeaa7b334686b3 not found: ID does not exist" containerID="7bcc61d07f505c801aced43294954e0301d7a495bbf2bd2a0dfeaa7b334686b3"
Sep 10 17:28:52.843167 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.843115    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bcc61d07f505c801aced43294954e0301d7a495bbf2bd2a0dfeaa7b334686b3"} err="failed to get container status \"7bcc61d07f505c801aced43294954e0301d7a495bbf2bd2a0dfeaa7b334686b3\": rpc error: code = NotFound desc = could not find container \"7bcc61d07f505c801aced43294954e0301d7a495bbf2bd2a0dfeaa7b334686b3\": container with ID starting with 7bcc61d07f505c801aced43294954e0301d7a495bbf2bd2a0dfeaa7b334686b3 not found: ID does not exist"
Sep 10 17:28:52.876749 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.876718    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"]
Sep 10 17:28:52.882230 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:52.882201    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4b53b5-b695cf79c-k42lh"]
Sep 10 17:28:53.084511 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:53.084415    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86fa97c0-48ae-4969-bd94-712456e8fd88" path="/var/lib/kubelet/pods/86fa97c0-48ae-4969-bd94-712456e8fd88/volumes"
Sep 10 17:28:53.084820 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:53.084803    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc578af2-e082-4a26-9047-780861988616" path="/var/lib/kubelet/pods/cc578af2-e082-4a26-9047-780861988616/volumes"
Sep 10 17:28:53.969207 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:53.969182    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc"
Sep 10 17:28:54.087761 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:54.087663    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7311b05e-e192-4f28-a878-01fafd91c8dc-maas-api-service-ca\") pod \"7311b05e-e192-4f28-a878-01fafd91c8dc\" (UID: \"7311b05e-e192-4f28-a878-01fafd91c8dc\") "
Sep 10 17:28:54.088084 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:54.088046    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7311b05e-e192-4f28-a878-01fafd91c8dc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7311b05e-e192-4f28-a878-01fafd91c8dc" (UID: "7311b05e-e192-4f28-a878-01fafd91c8dc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:28:54.188663 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:54.188625    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7311b05e-e192-4f28-a878-01fafd91c8dc-maas-api-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:28:54.843488 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:54.843460    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc"
Sep 10 17:28:54.843695 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:54.843501    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc" event={"ID":"7311b05e-e192-4f28-a878-01fafd91c8dc","Type":"ContainerDied","Data":"d761ec0c85d598700b71c81ed9db886e5c4b7228e15c42568ddef4715188ff54"}
Sep 10 17:28:54.843695 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:54.843547    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d761ec0c85d598700b71c81ed9db886e5c4b7228e15c42568ddef4715188ff54"
Sep 10 17:28:56.079270 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.079231    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l" podUID="c81a68ea-b06b-4374-af45-a524c50ac773" containerName="main" containerID="cri-o://b07b309b53239266bb5e989f6c744811ad0f61003b0f44ccf1f8a671acc5e485" gracePeriod=45
Sep 10 17:28:56.326500 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.326476    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:56.506569 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.506534    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-home\") pod \"c81a68ea-b06b-4374-af45-a524c50ac773\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") "
Sep 10 17:28:56.506569 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.506576    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c81a68ea-b06b-4374-af45-a524c50ac773-tls-certs\") pod \"c81a68ea-b06b-4374-af45-a524c50ac773\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") "
Sep 10 17:28:56.506838 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.506616    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-model-cache\") pod \"c81a68ea-b06b-4374-af45-a524c50ac773\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") "
Sep 10 17:28:56.506838 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.506650    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-tmp-dir\") pod \"c81a68ea-b06b-4374-af45-a524c50ac773\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") "
Sep 10 17:28:56.506838 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.506687    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-dshm\") pod \"c81a68ea-b06b-4374-af45-a524c50ac773\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") "
Sep 10 17:28:56.506838 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.506740    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55qgj\" (UniqueName: \"kubernetes.io/projected/c81a68ea-b06b-4374-af45-a524c50ac773-kube-api-access-55qgj\") pod \"c81a68ea-b06b-4374-af45-a524c50ac773\" (UID: \"c81a68ea-b06b-4374-af45-a524c50ac773\") "
Sep 10 17:28:56.507042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.506853    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-home" (OuterVolumeSpecName: "home") pod "c81a68ea-b06b-4374-af45-a524c50ac773" (UID: "c81a68ea-b06b-4374-af45-a524c50ac773"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:28:56.507042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.506865    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-model-cache" (OuterVolumeSpecName: "model-cache") pod "c81a68ea-b06b-4374-af45-a524c50ac773" (UID: "c81a68ea-b06b-4374-af45-a524c50ac773"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:28:56.507042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.506955    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c81a68ea-b06b-4374-af45-a524c50ac773" (UID: "c81a68ea-b06b-4374-af45-a524c50ac773"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:28:56.507042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.506974    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-model-cache\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:28:56.507042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.506995    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-home\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:28:56.508839 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.508816    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-dshm" (OuterVolumeSpecName: "dshm") pod "c81a68ea-b06b-4374-af45-a524c50ac773" (UID: "c81a68ea-b06b-4374-af45-a524c50ac773"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:28:56.508839 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.508811    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c81a68ea-b06b-4374-af45-a524c50ac773-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c81a68ea-b06b-4374-af45-a524c50ac773" (UID: "c81a68ea-b06b-4374-af45-a524c50ac773"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:28:56.508950 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.508917    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c81a68ea-b06b-4374-af45-a524c50ac773-kube-api-access-55qgj" (OuterVolumeSpecName: "kube-api-access-55qgj") pod "c81a68ea-b06b-4374-af45-a524c50ac773" (UID: "c81a68ea-b06b-4374-af45-a524c50ac773"). InnerVolumeSpecName "kube-api-access-55qgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:28:56.607451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.607414    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55qgj\" (UniqueName: \"kubernetes.io/projected/c81a68ea-b06b-4374-af45-a524c50ac773-kube-api-access-55qgj\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:28:56.607451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.607445    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c81a68ea-b06b-4374-af45-a524c50ac773-tls-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:28:56.607451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.607455    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-tmp-dir\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:28:56.607451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.607463    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c81a68ea-b06b-4374-af45-a524c50ac773-dshm\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:28:56.855851 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.855760    2576 generic.go:356] "Generic (PLEG): container finished" podID="c81a68ea-b06b-4374-af45-a524c50ac773" containerID="b07b309b53239266bb5e989f6c744811ad0f61003b0f44ccf1f8a671acc5e485" exitCode=0
Sep 10 17:28:56.855851 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.855807    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"
Sep 10 17:28:56.856084 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.855851    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l" event={"ID":"c81a68ea-b06b-4374-af45-a524c50ac773","Type":"ContainerDied","Data":"b07b309b53239266bb5e989f6c744811ad0f61003b0f44ccf1f8a671acc5e485"}
Sep 10 17:28:56.856084 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.855893    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l" event={"ID":"c81a68ea-b06b-4374-af45-a524c50ac773","Type":"ContainerDied","Data":"aa04b19f475925e79f57bbb3ed939612fd3868230b6e9feff0ccd56d4134fbd8"}
Sep 10 17:28:56.856084 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.855910    2576 scope.go:117] "RemoveContainer" containerID="b07b309b53239266bb5e989f6c744811ad0f61003b0f44ccf1f8a671acc5e485"
Sep 10 17:28:56.865241 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.865219    2576 scope.go:117] "RemoveContainer" containerID="b07b309b53239266bb5e989f6c744811ad0f61003b0f44ccf1f8a671acc5e485"
Sep 10 17:28:56.865526 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:28:56.865486    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b07b309b53239266bb5e989f6c744811ad0f61003b0f44ccf1f8a671acc5e485\": container with ID starting with b07b309b53239266bb5e989f6c744811ad0f61003b0f44ccf1f8a671acc5e485 not found: ID does not exist" containerID="b07b309b53239266bb5e989f6c744811ad0f61003b0f44ccf1f8a671acc5e485"
Sep 10 17:28:56.865526 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.865516    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b07b309b53239266bb5e989f6c744811ad0f61003b0f44ccf1f8a671acc5e485"} err="failed to get container status \"b07b309b53239266bb5e989f6c744811ad0f61003b0f44ccf1f8a671acc5e485\": rpc error: code = NotFound desc = could not find container \"b07b309b53239266bb5e989f6c744811ad0f61003b0f44ccf1f8a671acc5e485\": container with ID starting with b07b309b53239266bb5e989f6c744811ad0f61003b0f44ccf1f8a671acc5e485 not found: ID does not exist"
Sep 10 17:28:56.882539 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.882511    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"]
Sep 10 17:28:56.885042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:56.885015    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-4b53b5/explicit-model-4b53b5-kserve-67488954c5-6z45l"]
Sep 10 17:28:57.046024 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.045988    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"]
Sep 10 17:28:57.046347 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.046334    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c81a68ea-b06b-4374-af45-a524c50ac773" containerName="main"
Sep 10 17:28:57.046393 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.046349    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c81a68ea-b06b-4374-af45-a524c50ac773" containerName="main"
Sep 10 17:28:57.046393 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.046360    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc578af2-e082-4a26-9047-780861988616" containerName="payload-processing"
Sep 10 17:28:57.046393 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.046365    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc578af2-e082-4a26-9047-780861988616" containerName="payload-processing"
Sep 10 17:28:57.046487 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.046395    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7311b05e-e192-4f28-a878-01fafd91c8dc" containerName="revoke-keys"
Sep 10 17:28:57.046487 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.046401    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7311b05e-e192-4f28-a878-01fafd91c8dc" containerName="revoke-keys"
Sep 10 17:28:57.046487 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.046451    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c81a68ea-b06b-4374-af45-a524c50ac773" containerName="main"
Sep 10 17:28:57.046487 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.046458    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7311b05e-e192-4f28-a878-01fafd91c8dc" containerName="revoke-keys"
Sep 10 17:28:57.046487 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.046464    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc578af2-e082-4a26-9047-780861988616" containerName="payload-processing"
Sep 10 17:28:57.049276 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.049256    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.051812 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.051793    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6dc6af55-openshift-default-dockercfg-gpf99\""
Sep 10 17:28:57.066725 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.066699    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"]
Sep 10 17:28:57.085773 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.085739    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c81a68ea-b06b-4374-af45-a524c50ac773" path="/var/lib/kubelet/pods/c81a68ea-b06b-4374-af45-a524c50ac773/volumes"
Sep 10 17:28:57.213102 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.213036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-credential-socket\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.213295 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.213120    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-envoy\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.213295 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.213148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/306bece2-96a2-44cd-ab63-00dc74d5ca58-istiod-ca-cert\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.213295 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.213183    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-podinfo\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.213295 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.213242    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-token\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.213514 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.213292    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-data\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.213514 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.213327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-workload-socket\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.213514 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.213359    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dbvf\" (UniqueName: \"kubernetes.io/projected/306bece2-96a2-44cd-ab63-00dc74d5ca58-kube-api-access-5dbvf\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.213514 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.213425    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-workload-certs\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.314115 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.314082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-credential-socket\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.314315 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.314123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-envoy\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.314315 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.314140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/306bece2-96a2-44cd-ab63-00dc74d5ca58-istiod-ca-cert\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.314315 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.314257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-podinfo\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.314315 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.314309    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-token\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.314548 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.314330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-data\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.314548 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.314352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-workload-socket\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.314548 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.314387    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dbvf\" (UniqueName: \"kubernetes.io/projected/306bece2-96a2-44cd-ab63-00dc74d5ca58-kube-api-access-5dbvf\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.314548 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.314438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-workload-certs\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.314548 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.314524    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-credential-socket\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.314817 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.314698    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-workload-socket\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.314817 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.314776    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-workload-certs\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.314965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.314945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-data\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.315024 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.314966    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/306bece2-96a2-44cd-ab63-00dc74d5ca58-istiod-ca-cert\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.317100 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.317079    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-envoy\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.317214 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.317196    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-podinfo\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.324583 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.324549    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dbvf\" (UniqueName: \"kubernetes.io/projected/306bece2-96a2-44cd-ab63-00dc74d5ca58-kube-api-access-5dbvf\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.326824 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.326802    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-token\") pod \"e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") " pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.361820 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.361787    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:57.641078 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.640921    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"]
Sep 10 17:28:57.643752 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:28:57.643723    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod306bece2_96a2_44cd_ab63_00dc74d5ca58.slice/crio-c9d224e6aa35564fac4010e3089cc27d04d22a8830912fd970b8a2cc66cb2ca6 WatchSource:0}: Error finding container c9d224e6aa35564fac4010e3089cc27d04d22a8830912fd970b8a2cc66cb2ca6: Status 404 returned error can't find the container with id c9d224e6aa35564fac4010e3089cc27d04d22a8830912fd970b8a2cc66cb2ca6
Sep 10 17:28:57.646027 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.645995    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:28:57.646149 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.646091    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:28:57.646149 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.646138    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:28:57.863657 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.863614    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq" event={"ID":"306bece2-96a2-44cd-ab63-00dc74d5ca58","Type":"ContainerStarted","Data":"035a34524b436b9d30e0c69b7f14e720e8188e8642e5bb4b9207363028c89895"}
Sep 10 17:28:57.863829 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.863688    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq" event={"ID":"306bece2-96a2-44cd-ab63-00dc74d5ca58","Type":"ContainerStarted","Data":"c9d224e6aa35564fac4010e3089cc27d04d22a8830912fd970b8a2cc66cb2ca6"}
Sep 10 17:28:57.897435 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:57.897332    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq" podStartSLOduration=0.897314814 podStartE2EDuration="897.314814ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:28:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:28:57.896187452 +0000 UTC m=+1023.312238447" watchObservedRunningTime="2026-09-10 17:28:57.897314814 +0000 UTC m=+1023.313365762"
Sep 10 17:28:58.362013 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:58.361923    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:58.367288 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:58.367261    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:58.870146 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:58.870114    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:28:58.871016 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:28:58.870996    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:29:00.505673 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:00.505641    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"]
Sep 10 17:29:00.506126 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:00.505900    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc" podUID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" containerName="istio-proxy" containerID="cri-o://854faab232a66c3995f056db5ceecd11db23089a609032c43c863a74e900742f" gracePeriod=30
Sep 10 17:29:00.733247 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:00.733212    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:29:01.371851 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.371820    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"]
Sep 10 17:29:01.376534 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.376502    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.381185 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.381145    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-eb108f-openshift-default-dockercfg-gjpp6\""
Sep 10 17:29:01.396691 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.396665    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"]
Sep 10 17:29:01.448095 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.448033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-podinfo\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.448278 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.448133    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-envoy\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.448278 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.448204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-token\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.448278 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.448240    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-workload-socket\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.448476 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.448288    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istiod-ca-cert\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.448476 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.448319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-credential-socket\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.448476 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.448380    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhs6s\" (UniqueName: \"kubernetes.io/projected/b1bbcf0a-a275-47fe-9f82-b17932497cd2-kube-api-access-zhs6s\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.448476 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.448432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-data\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.448476 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.448452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-workload-certs\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.549119 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.549088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-data\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.549119 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.549124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-workload-certs\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.549626 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.549174    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-podinfo\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.549626 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.549196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-envoy\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.549626 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.549219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-token\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.549626 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.549238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-workload-socket\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.549626 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.549271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istiod-ca-cert\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.549626 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.549298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-credential-socket\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.549626 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.549502    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-data\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.549626 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.549557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhs6s\" (UniqueName: \"kubernetes.io/projected/b1bbcf0a-a275-47fe-9f82-b17932497cd2-kube-api-access-zhs6s\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.549905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.549645    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-workload-certs\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.549905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.549693    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-credential-socket\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.550104 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.550082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istiod-ca-cert\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.550145 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.550084    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-workload-socket\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.551495 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.551474    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-envoy\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.551703 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.551683    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-podinfo\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.565126 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.565095    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhs6s\" (UniqueName: \"kubernetes.io/projected/b1bbcf0a-a275-47fe-9f82-b17932497cd2-kube-api-access-zhs6s\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.566248 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.566222    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-token\") pod \"e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") " pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.689718 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.689636    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:01.995771 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:01.995676    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"]
Sep 10 17:29:02.004308 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:29:02.004281    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1bbcf0a_a275_47fe_9f82_b17932497cd2.slice/crio-d049fb5e0aae7efda20073f0e736b09ebe73fcf923d705aa91c3688268bb574c WatchSource:0}: Error finding container d049fb5e0aae7efda20073f0e736b09ebe73fcf923d705aa91c3688268bb574c: Status 404 returned error can't find the container with id d049fb5e0aae7efda20073f0e736b09ebe73fcf923d705aa91c3688268bb574c
Sep 10 17:29:02.006750 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:02.006714    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:29:02.006849 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:02.006796    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:29:02.006849 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:02.006828    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:29:02.407535 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:02.407496    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"]
Sep 10 17:29:02.412301 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:02.412274    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"
Sep 10 17:29:02.424025 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:29:02.423968    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"payload-processing-e2e-mt-6dc6af55-dockercfg-vs547\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-6dc6af55-dockercfg-vs547\"" type="*v1.Secret"
Sep 10 17:29:02.430781 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:29:02.430752    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="69fd154c-ad03-4f55-9bb7-ec49ece9efe0" pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"
Sep 10 17:29:02.432102 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:29:02.432082    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"payload-processing-plugins-e2e-mt-6dc6af55\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-6dc6af55\"" type="*v1.ConfigMap"
Sep 10 17:29:02.456585 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:02.456539    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sqqc\" (UniqueName: \"kubernetes.io/projected/69fd154c-ad03-4f55-9bb7-ec49ece9efe0-kube-api-access-5sqqc\") pod \"payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47\" (UID: \"69fd154c-ad03-4f55-9bb7-ec49ece9efe0\") " pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"
Sep 10 17:29:02.456729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:02.456664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69fd154c-ad03-4f55-9bb7-ec49ece9efe0-plugins-config-volume\") pod \"payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47\" (UID: \"69fd154c-ad03-4f55-9bb7-ec49ece9efe0\") " pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"
Sep 10 17:29:02.473281 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:02.473241    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"]
Sep 10 17:29:02.557839 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:02.557806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sqqc\" (UniqueName: \"kubernetes.io/projected/69fd154c-ad03-4f55-9bb7-ec49ece9efe0-kube-api-access-5sqqc\") pod \"payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47\" (UID: \"69fd154c-ad03-4f55-9bb7-ec49ece9efe0\") " pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"
Sep 10 17:29:02.558218 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:02.557972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69fd154c-ad03-4f55-9bb7-ec49ece9efe0-plugins-config-volume\") pod \"payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47\" (UID: \"69fd154c-ad03-4f55-9bb7-ec49ece9efe0\") " pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"
Sep 10 17:29:02.587871 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:02.587840    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sqqc\" (UniqueName: \"kubernetes.io/projected/69fd154c-ad03-4f55-9bb7-ec49ece9efe0-kube-api-access-5sqqc\") pod \"payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47\" (UID: \"69fd154c-ad03-4f55-9bb7-ec49ece9efe0\") " pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"
Sep 10 17:29:02.893312 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:02.893274    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc" event={"ID":"b1bbcf0a-a275-47fe-9f82-b17932497cd2","Type":"ContainerStarted","Data":"78ef393e07b5bf5893a76e09b2be7d39a69986a271fca6d65231124cec8cea49"}
Sep 10 17:29:02.893486 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:02.893340    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc" event={"ID":"b1bbcf0a-a275-47fe-9f82-b17932497cd2","Type":"ContainerStarted","Data":"d049fb5e0aae7efda20073f0e736b09ebe73fcf923d705aa91c3688268bb574c"}
Sep 10 17:29:02.986910 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:02.986861    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc" podStartSLOduration=1.9868436900000002 podStartE2EDuration="1.98684369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:29:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:29:02.946844267 +0000 UTC m=+1028.362895217" watchObservedRunningTime="2026-09-10 17:29:02.98684369 +0000 UTC m=+1028.402894638"
Sep 10 17:29:03.350650 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:03.350570    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-6dc6af55\""
Sep 10 17:29:03.359670 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:03.359645    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69fd154c-ad03-4f55-9bb7-ec49ece9efe0-plugins-config-volume\") pod \"payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47\" (UID: \"69fd154c-ad03-4f55-9bb7-ec49ece9efe0\") " pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"
Sep 10 17:29:03.652255 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:03.652216    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc"]
Sep 10 17:29:03.656579 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:03.656554    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-dc5a37-s6kjc"]
Sep 10 17:29:03.689793 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:03.689758    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:03.695034 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:03.695008    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:03.800108 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:03.800071    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-6dc6af55-dockercfg-vs547\""
Sep 10 17:29:03.807631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:03.807580    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"
Sep 10 17:29:03.899500 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:03.899475    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:03.900496 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:03.900476    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:04.105336 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:04.105309    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"]
Sep 10 17:29:04.106679 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:29:04.106650    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fd154c_ad03_4f55_9bb7_ec49ece9efe0.slice/crio-ac055323adacd84e8c6ca3ce3ef0d2123113f96524d1da9dd1d79b111e76748c WatchSource:0}: Error finding container ac055323adacd84e8c6ca3ce3ef0d2123113f96524d1da9dd1d79b111e76748c: Status 404 returned error can't find the container with id ac055323adacd84e8c6ca3ce3ef0d2123113f96524d1da9dd1d79b111e76748c
Sep 10 17:29:04.906024 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:04.905988    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47" event={"ID":"69fd154c-ad03-4f55-9bb7-ec49ece9efe0","Type":"ContainerStarted","Data":"3ede9b872d3ec04438c8bcb72f9cc9ea69ff8b612e00aa4510a1871d684dd818"}
Sep 10 17:29:04.906468 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:04.906083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47" event={"ID":"69fd154c-ad03-4f55-9bb7-ec49ece9efe0","Type":"ContainerStarted","Data":"ac055323adacd84e8c6ca3ce3ef0d2123113f96524d1da9dd1d79b111e76748c"}
Sep 10 17:29:04.929760 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:04.929705    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47" podStartSLOduration=2.929689046 podStartE2EDuration="2.929689046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:29:04.928248657 +0000 UTC m=+1030.344299619" watchObservedRunningTime="2026-09-10 17:29:04.929689046 +0000 UTC m=+1030.345739994"
Sep 10 17:29:05.086282 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.086233    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7311b05e-e192-4f28-a878-01fafd91c8dc" path="/var/lib/kubelet/pods/7311b05e-e192-4f28-a878-01fafd91c8dc/volumes"
Sep 10 17:29:05.763039 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.763014    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:29:05.788417 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.788348    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86288\" (UniqueName: \"kubernetes.io/projected/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-kube-api-access-86288\") pod \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") "
Sep 10 17:29:05.788417 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.788388    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-workload-socket\") pod \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") "
Sep 10 17:29:05.788611 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.788433    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istiod-ca-cert\") pod \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") "
Sep 10 17:29:05.788611 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.788461    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-token\") pod \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") "
Sep 10 17:29:05.788611 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.788496    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-workload-certs\") pod \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") "
Sep 10 17:29:05.788611 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.788530    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-credential-socket\") pod \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") "
Sep 10 17:29:05.788611 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.788554    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-data\") pod \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") "
Sep 10 17:29:05.788611 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.788578    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-envoy\") pod \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") "
Sep 10 17:29:05.788611 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.788600    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-podinfo\") pod \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\" (UID: \"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8\") "
Sep 10 17:29:05.788948 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.788761    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" (UID: "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:05.788948 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.788889    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:05.788948 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.788903    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" (UID: "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:05.788948 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.788911    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" (UID: "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:29:05.788948 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.788919    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-data" (OuterVolumeSpecName: "istio-data") pod "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" (UID: "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:05.789231 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.789156    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" (UID: "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:05.790601 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.790575    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-kube-api-access-86288" (OuterVolumeSpecName: "kube-api-access-86288") pod "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" (UID: "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8"). InnerVolumeSpecName "kube-api-access-86288". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:29:05.790888 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.790866    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" (UID: "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:05.790999 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.790907    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-token" (OuterVolumeSpecName: "istio-token") pod "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" (UID: "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:29:05.790999 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.790904    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" (UID: "0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:29:05.890035 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.889998    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86288\" (UniqueName: \"kubernetes.io/projected/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-kube-api-access-86288\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:05.890035 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.890027    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:05.890035 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.890037    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:05.890035 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.890045    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:05.890035 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.890065    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:05.890349 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.890074    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:05.890349 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.890082    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:05.890349 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.890089    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:05.913836 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.913801    2576 generic.go:356] "Generic (PLEG): container finished" podID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" containerID="854faab232a66c3995f056db5ceecd11db23089a609032c43c863a74e900742f" exitCode=0
Sep 10 17:29:05.914259 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.913848    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"
Sep 10 17:29:05.914259 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.913883    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc" event={"ID":"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8","Type":"ContainerDied","Data":"854faab232a66c3995f056db5ceecd11db23089a609032c43c863a74e900742f"}
Sep 10 17:29:05.914259 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.913935    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc" event={"ID":"0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8","Type":"ContainerDied","Data":"95629069a437ed92049b52a1689c76dcc28b85bb4d302d5dd6189a3830acef54"}
Sep 10 17:29:05.914259 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.913958    2576 scope.go:117] "RemoveContainer" containerID="854faab232a66c3995f056db5ceecd11db23089a609032c43c863a74e900742f"
Sep 10 17:29:05.914259 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.914225    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"
Sep 10 17:29:05.923599 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.923581    2576 scope.go:117] "RemoveContainer" containerID="43a81406589287809f94ccdf831b3d7068915e125ecb2163e0ac5ad2b0322375"
Sep 10 17:29:05.933940 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.933922    2576 scope.go:117] "RemoveContainer" containerID="854faab232a66c3995f056db5ceecd11db23089a609032c43c863a74e900742f"
Sep 10 17:29:05.934482 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:29:05.934464    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"854faab232a66c3995f056db5ceecd11db23089a609032c43c863a74e900742f\": container with ID starting with 854faab232a66c3995f056db5ceecd11db23089a609032c43c863a74e900742f not found: ID does not exist" containerID="854faab232a66c3995f056db5ceecd11db23089a609032c43c863a74e900742f"
Sep 10 17:29:05.934547 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.934491    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"854faab232a66c3995f056db5ceecd11db23089a609032c43c863a74e900742f"} err="failed to get container status \"854faab232a66c3995f056db5ceecd11db23089a609032c43c863a74e900742f\": rpc error: code = NotFound desc = could not find container \"854faab232a66c3995f056db5ceecd11db23089a609032c43c863a74e900742f\": container with ID starting with 854faab232a66c3995f056db5ceecd11db23089a609032c43c863a74e900742f not found: ID does not exist"
Sep 10 17:29:05.934547 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.934509    2576 scope.go:117] "RemoveContainer" containerID="43a81406589287809f94ccdf831b3d7068915e125ecb2163e0ac5ad2b0322375"
Sep 10 17:29:05.934793 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:29:05.934774    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43a81406589287809f94ccdf831b3d7068915e125ecb2163e0ac5ad2b0322375\": container with ID starting with 43a81406589287809f94ccdf831b3d7068915e125ecb2163e0ac5ad2b0322375 not found: ID does not exist" containerID="43a81406589287809f94ccdf831b3d7068915e125ecb2163e0ac5ad2b0322375"
Sep 10 17:29:05.934851 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.934798    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43a81406589287809f94ccdf831b3d7068915e125ecb2163e0ac5ad2b0322375"} err="failed to get container status \"43a81406589287809f94ccdf831b3d7068915e125ecb2163e0ac5ad2b0322375\": rpc error: code = NotFound desc = could not find container \"43a81406589287809f94ccdf831b3d7068915e125ecb2163e0ac5ad2b0322375\": container with ID starting with 43a81406589287809f94ccdf831b3d7068915e125ecb2163e0ac5ad2b0322375 not found: ID does not exist"
Sep 10 17:29:05.939235 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.939213    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"]
Sep 10 17:29:05.945440 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.945411    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-4b53b5-openshift-default-7474cd8ff6-tkksc"]
Sep 10 17:29:05.976880 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:05.976843    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2" podUID="4c4a9cdf-e0d5-48df-87c5-5deb320a5df1" containerName="main" containerID="cri-o://3030368998d692d112b0c8ba9b6b48dc95ca15280b69b468ed497f6ba09676cc" gracePeriod=45
Sep 10 17:29:06.222315 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.222286    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:29:06.293581 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.293544    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-tls-certs\") pod \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") "
Sep 10 17:29:06.293739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.293605    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-model-cache\") pod \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") "
Sep 10 17:29:06.293739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.293629    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-dshm\") pod \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") "
Sep 10 17:29:06.293739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.293682    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-tmp-dir\") pod \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") "
Sep 10 17:29:06.293739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.293703    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-home\") pod \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") "
Sep 10 17:29:06.293739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.293724    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt25p\" (UniqueName: \"kubernetes.io/projected/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-kube-api-access-pt25p\") pod \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\" (UID: \"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1\") "
Sep 10 17:29:06.294042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.293823    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-model-cache" (OuterVolumeSpecName: "model-cache") pod "4c4a9cdf-e0d5-48df-87c5-5deb320a5df1" (UID: "4c4a9cdf-e0d5-48df-87c5-5deb320a5df1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:06.294042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.293935    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4c4a9cdf-e0d5-48df-87c5-5deb320a5df1" (UID: "4c4a9cdf-e0d5-48df-87c5-5deb320a5df1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:06.294213 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.294097    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-model-cache\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:06.294213 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.294115    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-tmp-dir\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:06.294356 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.294321    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-home" (OuterVolumeSpecName: "home") pod "4c4a9cdf-e0d5-48df-87c5-5deb320a5df1" (UID: "4c4a9cdf-e0d5-48df-87c5-5deb320a5df1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:06.296535 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.296504    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-kube-api-access-pt25p" (OuterVolumeSpecName: "kube-api-access-pt25p") pod "4c4a9cdf-e0d5-48df-87c5-5deb320a5df1" (UID: "4c4a9cdf-e0d5-48df-87c5-5deb320a5df1"). InnerVolumeSpecName "kube-api-access-pt25p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:29:06.296679 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.296535    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-dshm" (OuterVolumeSpecName: "dshm") pod "4c4a9cdf-e0d5-48df-87c5-5deb320a5df1" (UID: "4c4a9cdf-e0d5-48df-87c5-5deb320a5df1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:06.296679 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.296514    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4c4a9cdf-e0d5-48df-87c5-5deb320a5df1" (UID: "4c4a9cdf-e0d5-48df-87c5-5deb320a5df1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:29:06.395445 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.395408    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-home\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:06.395445 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.395440    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt25p\" (UniqueName: \"kubernetes.io/projected/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-kube-api-access-pt25p\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:06.395654 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.395458    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-tls-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:06.395654 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.395470    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1-dshm\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:06.922506 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.922471    2576 generic.go:356] "Generic (PLEG): container finished" podID="4c4a9cdf-e0d5-48df-87c5-5deb320a5df1" containerID="3030368998d692d112b0c8ba9b6b48dc95ca15280b69b468ed497f6ba09676cc" exitCode=0
Sep 10 17:29:06.922946 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.922511    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"
Sep 10 17:29:06.922946 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.922545    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2" event={"ID":"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1","Type":"ContainerDied","Data":"3030368998d692d112b0c8ba9b6b48dc95ca15280b69b468ed497f6ba09676cc"}
Sep 10 17:29:06.922946 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.922582    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2" event={"ID":"4c4a9cdf-e0d5-48df-87c5-5deb320a5df1","Type":"ContainerDied","Data":"eb5f8057ff513543fefd95db1e96f74a5ceb0707f2aa47352faeb73c5693437a"}
Sep 10 17:29:06.922946 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.922600    2576 scope.go:117] "RemoveContainer" containerID="3030368998d692d112b0c8ba9b6b48dc95ca15280b69b468ed497f6ba09676cc"
Sep 10 17:29:06.931992 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.931973    2576 scope.go:117] "RemoveContainer" containerID="3030368998d692d112b0c8ba9b6b48dc95ca15280b69b468ed497f6ba09676cc"
Sep 10 17:29:06.932302 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:29:06.932283    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3030368998d692d112b0c8ba9b6b48dc95ca15280b69b468ed497f6ba09676cc\": container with ID starting with 3030368998d692d112b0c8ba9b6b48dc95ca15280b69b468ed497f6ba09676cc not found: ID does not exist" containerID="3030368998d692d112b0c8ba9b6b48dc95ca15280b69b468ed497f6ba09676cc"
Sep 10 17:29:06.932378 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.932314    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3030368998d692d112b0c8ba9b6b48dc95ca15280b69b468ed497f6ba09676cc"} err="failed to get container status \"3030368998d692d112b0c8ba9b6b48dc95ca15280b69b468ed497f6ba09676cc\": rpc error: code = NotFound desc = could not find container \"3030368998d692d112b0c8ba9b6b48dc95ca15280b69b468ed497f6ba09676cc\": container with ID starting with 3030368998d692d112b0c8ba9b6b48dc95ca15280b69b468ed497f6ba09676cc not found: ID does not exist"
Sep 10 17:29:06.949865 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.949835    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"]
Sep 10 17:29:06.964306 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:06.964277    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-75bd9a/test-model-75bd9a-kserve-6d55d79cc-dhhq2"]
Sep 10 17:29:07.085587 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:07.085555    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" path="/var/lib/kubelet/pods/0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8/volumes"
Sep 10 17:29:07.085961 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:07.085949    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c4a9cdf-e0d5-48df-87c5-5deb320a5df1" path="/var/lib/kubelet/pods/4c4a9cdf-e0d5-48df-87c5-5deb320a5df1/volumes"
Sep 10 17:29:12.240263 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:12.240228    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:29:14.912238 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:14.912195    2576 patch_prober.go:28] interesting pod/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 17:29:14.912705 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:14.912275    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq" podUID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 17:29:16.924920 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:16.924883    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"
Sep 10 17:29:16.982814 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:16.982784    2576 generic.go:356] "Generic (PLEG): container finished" podID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerID="035a34524b436b9d30e0c69b7f14e720e8188e8642e5bb4b9207363028c89895" exitCode=0
Sep 10 17:29:16.982993 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:16.982868    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq" event={"ID":"306bece2-96a2-44cd-ab63-00dc74d5ca58","Type":"ContainerDied","Data":"035a34524b436b9d30e0c69b7f14e720e8188e8642e5bb4b9207363028c89895"}
Sep 10 17:29:16.983387 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:16.983360    2576 scope.go:117] "RemoveContainer" containerID="035a34524b436b9d30e0c69b7f14e720e8188e8642e5bb4b9207363028c89895"
Sep 10 17:29:16.984527 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:16.984496    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:29:16.984622 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:16.984581    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:29:16.984685 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:16.984630    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:29:17.994515 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:17.994473    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq" event={"ID":"306bece2-96a2-44cd-ab63-00dc74d5ca58","Type":"ContainerStarted","Data":"8e83fd7ae075132b61d2717ce42f79c1c28b70df8d0e82fa9d821eb0b7477762"}
Sep 10 17:29:18.362828 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:18.362720    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:29:18.363013 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:18.362989    2576 patch_prober.go:28] interesting pod/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 10 17:29:18.363095 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:18.363038    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq" podUID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 10 17:29:19.362633 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:19.362594    2576 patch_prober.go:28] interesting pod/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 10 17:29:19.363011 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:19.362650    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq" podUID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 10 17:29:20.362217 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:20.362179    2576 patch_prober.go:28] interesting pod/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 10 17:29:20.362404 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:20.362238    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq" podUID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 10 17:29:21.362833 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:21.362789    2576 patch_prober.go:28] interesting pod/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 10 17:29:21.363290 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:21.362859    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq" podUID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 10 17:29:22.363005 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:22.362967    2576 patch_prober.go:28] interesting pod/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 10 17:29:22.363453 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:22.363023    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq" podUID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 10 17:29:23.366625 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:23.366593    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:29:23.367078 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:23.366878    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:29:23.367612 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:23.367591    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:29:23.665475 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:23.665424    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"]
Sep 10 17:29:23.665710 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:23.665653    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc" podUID="b1bbcf0a-a275-47fe-9f82-b17932497cd2" containerName="istio-proxy" containerID="cri-o://78ef393e07b5bf5893a76e09b2be7d39a69986a271fca6d65231124cec8cea49" gracePeriod=30
Sep 10 17:29:26.631565 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:26.631530    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:29:28.918801 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:28.918777    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:29.006845 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.006758    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-envoy\") pod \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") "
Sep 10 17:29:29.006845 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.006795    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-podinfo\") pod \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") "
Sep 10 17:29:29.006845 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.006831    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istiod-ca-cert\") pod \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") "
Sep 10 17:29:29.007145 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.006871    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-workload-certs\") pod \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") "
Sep 10 17:29:29.007145 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.006893    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-credential-socket\") pod \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") "
Sep 10 17:29:29.007145 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.006910    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-workload-socket\") pod \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") "
Sep 10 17:29:29.007145 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.006929    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhs6s\" (UniqueName: \"kubernetes.io/projected/b1bbcf0a-a275-47fe-9f82-b17932497cd2-kube-api-access-zhs6s\") pod \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") "
Sep 10 17:29:29.007145 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.006971    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-token\") pod \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") "
Sep 10 17:29:29.007145 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.007085    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-data\") pod \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\" (UID: \"b1bbcf0a-a275-47fe-9f82-b17932497cd2\") "
Sep 10 17:29:29.007452 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.007274    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b1bbcf0a-a275-47fe-9f82-b17932497cd2" (UID: "b1bbcf0a-a275-47fe-9f82-b17932497cd2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:29.007452 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.007387    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:29.007452 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.007347    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b1bbcf0a-a275-47fe-9f82-b17932497cd2" (UID: "b1bbcf0a-a275-47fe-9f82-b17932497cd2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:29.007452 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.007439    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b1bbcf0a-a275-47fe-9f82-b17932497cd2" (UID: "b1bbcf0a-a275-47fe-9f82-b17932497cd2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:29.007659 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.007501    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-data" (OuterVolumeSpecName: "istio-data") pod "b1bbcf0a-a275-47fe-9f82-b17932497cd2" (UID: "b1bbcf0a-a275-47fe-9f82-b17932497cd2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:29.007659 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.007611    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b1bbcf0a-a275-47fe-9f82-b17932497cd2" (UID: "b1bbcf0a-a275-47fe-9f82-b17932497cd2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:29:29.009443 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.009418    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1bbcf0a-a275-47fe-9f82-b17932497cd2-kube-api-access-zhs6s" (OuterVolumeSpecName: "kube-api-access-zhs6s") pod "b1bbcf0a-a275-47fe-9f82-b17932497cd2" (UID: "b1bbcf0a-a275-47fe-9f82-b17932497cd2"). InnerVolumeSpecName "kube-api-access-zhs6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:29:29.009541 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.009475    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b1bbcf0a-a275-47fe-9f82-b17932497cd2" (UID: "b1bbcf0a-a275-47fe-9f82-b17932497cd2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:29.009541 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.009480    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1bbcf0a-a275-47fe-9f82-b17932497cd2" (UID: "b1bbcf0a-a275-47fe-9f82-b17932497cd2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:29:29.009541 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.009470    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b1bbcf0a-a275-47fe-9f82-b17932497cd2" (UID: "b1bbcf0a-a275-47fe-9f82-b17932497cd2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:29:29.061446 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.061410    2576 generic.go:356] "Generic (PLEG): container finished" podID="b1bbcf0a-a275-47fe-9f82-b17932497cd2" containerID="78ef393e07b5bf5893a76e09b2be7d39a69986a271fca6d65231124cec8cea49" exitCode=0
Sep 10 17:29:29.061621 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.061456    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"
Sep 10 17:29:29.061621 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.061475    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc" event={"ID":"b1bbcf0a-a275-47fe-9f82-b17932497cd2","Type":"ContainerDied","Data":"78ef393e07b5bf5893a76e09b2be7d39a69986a271fca6d65231124cec8cea49"}
Sep 10 17:29:29.061621 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.061528    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc" event={"ID":"b1bbcf0a-a275-47fe-9f82-b17932497cd2","Type":"ContainerDied","Data":"d049fb5e0aae7efda20073f0e736b09ebe73fcf923d705aa91c3688268bb574c"}
Sep 10 17:29:29.061621 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.061558    2576 scope.go:117] "RemoveContainer" containerID="78ef393e07b5bf5893a76e09b2be7d39a69986a271fca6d65231124cec8cea49"
Sep 10 17:29:29.070778 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.070758    2576 scope.go:117] "RemoveContainer" containerID="78ef393e07b5bf5893a76e09b2be7d39a69986a271fca6d65231124cec8cea49"
Sep 10 17:29:29.071044 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:29:29.071023    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78ef393e07b5bf5893a76e09b2be7d39a69986a271fca6d65231124cec8cea49\": container with ID starting with 78ef393e07b5bf5893a76e09b2be7d39a69986a271fca6d65231124cec8cea49 not found: ID does not exist" containerID="78ef393e07b5bf5893a76e09b2be7d39a69986a271fca6d65231124cec8cea49"
Sep 10 17:29:29.071044 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.071080    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78ef393e07b5bf5893a76e09b2be7d39a69986a271fca6d65231124cec8cea49"} err="failed to get container status \"78ef393e07b5bf5893a76e09b2be7d39a69986a271fca6d65231124cec8cea49\": rpc error: code = NotFound desc = could not find container \"78ef393e07b5bf5893a76e09b2be7d39a69986a271fca6d65231124cec8cea49\": container with ID starting with 78ef393e07b5bf5893a76e09b2be7d39a69986a271fca6d65231124cec8cea49 not found: ID does not exist"
Sep 10 17:29:29.085971 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.085942    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"]
Sep 10 17:29:29.094169 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.094147    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-eb108f-openshift-default-d56698d7b-8wjdc"]
Sep 10 17:29:29.108696 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.108670    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:29.108696 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.108692    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:29.108696 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.108701    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:29.108892 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.108711    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:29.108892 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.108719    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1bbcf0a-a275-47fe-9f82-b17932497cd2-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:29.108892 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.108729    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:29.108892 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.108736    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1bbcf0a-a275-47fe-9f82-b17932497cd2-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:29.108892 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:29.108745    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhs6s\" (UniqueName: \"kubernetes.io/projected/b1bbcf0a-a275-47fe-9f82-b17932497cd2-kube-api-access-zhs6s\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:31.084098 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:31.084046    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1bbcf0a-a275-47fe-9f82-b17932497cd2" path="/var/lib/kubelet/pods/b1bbcf0a-a275-47fe-9f82-b17932497cd2/volumes"
Sep 10 17:29:31.761393 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:31.761355    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"]
Sep 10 17:29:31.761607 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:31.761562    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g" podUID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" containerName="istio-proxy" containerID="cri-o://8e816ba18dd490d7acd3f04969b3102a54e246eb17c6eb666940182a41a768b5" gracePeriod=30
Sep 10 17:29:37.047399 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.047320    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:29:37.117161 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.117123    2576 generic.go:356] "Generic (PLEG): container finished" podID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" containerID="8e816ba18dd490d7acd3f04969b3102a54e246eb17c6eb666940182a41a768b5" exitCode=0
Sep 10 17:29:37.117341 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.117172    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"
Sep 10 17:29:37.117341 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.117192    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g" event={"ID":"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0","Type":"ContainerDied","Data":"8e816ba18dd490d7acd3f04969b3102a54e246eb17c6eb666940182a41a768b5"}
Sep 10 17:29:37.117341 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.117252    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g" event={"ID":"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0","Type":"ContainerDied","Data":"a9bc484f0cc24cfaf72568afec651a09a2b61f6cdbf52c58006e4f796f7e0d18"}
Sep 10 17:29:37.117341 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.117278    2576 scope.go:117] "RemoveContainer" containerID="8e816ba18dd490d7acd3f04969b3102a54e246eb17c6eb666940182a41a768b5"
Sep 10 17:29:37.126284 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.126267    2576 scope.go:117] "RemoveContainer" containerID="963ad745491507d8dbc09e9dd37f5fab63d27f5a83f42331ff5025f0b920266e"
Sep 10 17:29:37.134722 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.134702    2576 scope.go:117] "RemoveContainer" containerID="8e816ba18dd490d7acd3f04969b3102a54e246eb17c6eb666940182a41a768b5"
Sep 10 17:29:37.135029 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:29:37.135002    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e816ba18dd490d7acd3f04969b3102a54e246eb17c6eb666940182a41a768b5\": container with ID starting with 8e816ba18dd490d7acd3f04969b3102a54e246eb17c6eb666940182a41a768b5 not found: ID does not exist" containerID="8e816ba18dd490d7acd3f04969b3102a54e246eb17c6eb666940182a41a768b5"
Sep 10 17:29:37.135104 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.135043    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e816ba18dd490d7acd3f04969b3102a54e246eb17c6eb666940182a41a768b5"} err="failed to get container status \"8e816ba18dd490d7acd3f04969b3102a54e246eb17c6eb666940182a41a768b5\": rpc error: code = NotFound desc = could not find container \"8e816ba18dd490d7acd3f04969b3102a54e246eb17c6eb666940182a41a768b5\": container with ID starting with 8e816ba18dd490d7acd3f04969b3102a54e246eb17c6eb666940182a41a768b5 not found: ID does not exist"
Sep 10 17:29:37.135104 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.135087    2576 scope.go:117] "RemoveContainer" containerID="963ad745491507d8dbc09e9dd37f5fab63d27f5a83f42331ff5025f0b920266e"
Sep 10 17:29:37.135414 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:29:37.135388    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"963ad745491507d8dbc09e9dd37f5fab63d27f5a83f42331ff5025f0b920266e\": container with ID starting with 963ad745491507d8dbc09e9dd37f5fab63d27f5a83f42331ff5025f0b920266e not found: ID does not exist" containerID="963ad745491507d8dbc09e9dd37f5fab63d27f5a83f42331ff5025f0b920266e"
Sep 10 17:29:37.135519 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.135424    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"963ad745491507d8dbc09e9dd37f5fab63d27f5a83f42331ff5025f0b920266e"} err="failed to get container status \"963ad745491507d8dbc09e9dd37f5fab63d27f5a83f42331ff5025f0b920266e\": rpc error: code = NotFound desc = could not find container \"963ad745491507d8dbc09e9dd37f5fab63d27f5a83f42331ff5025f0b920266e\": container with ID starting with 963ad745491507d8dbc09e9dd37f5fab63d27f5a83f42331ff5025f0b920266e not found: ID does not exist"
Sep 10 17:29:37.178761 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.178723    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-token\") pod \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") "
Sep 10 17:29:37.178761 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.178767    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-envoy\") pod \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") "
Sep 10 17:29:37.179011 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.178788    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-podinfo\") pod \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") "
Sep 10 17:29:37.179011 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.178829    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-workload-socket\") pod \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") "
Sep 10 17:29:37.179011 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.178882    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zp6m\" (UniqueName: \"kubernetes.io/projected/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-kube-api-access-2zp6m\") pod \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") "
Sep 10 17:29:37.179011 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.178933    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-data\") pod \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") "
Sep 10 17:29:37.179011 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.178954    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istiod-ca-cert\") pod \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") "
Sep 10 17:29:37.179011 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.178987    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-credential-socket\") pod \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") "
Sep 10 17:29:37.179011 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.179011    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-workload-certs\") pod \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\" (UID: \"8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0\") "
Sep 10 17:29:37.179430 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.179163    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" (UID: "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:37.179430 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.179329    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:37.179430 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.179336    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-data" (OuterVolumeSpecName: "istio-data") pod "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" (UID: "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:37.179430 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.179342    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" (UID: "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:37.179680 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.179640    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" (UID: "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:29:37.180136 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.180114    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" (UID: "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:37.181224 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.181198    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" (UID: "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:37.181379 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.181361    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-token" (OuterVolumeSpecName: "istio-token") pod "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" (UID: "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:29:37.181571 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.181543    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" (UID: "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:29:37.181631 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.181577    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-kube-api-access-2zp6m" (OuterVolumeSpecName: "kube-api-access-2zp6m") pod "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" (UID: "8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0"). InnerVolumeSpecName "kube-api-access-2zp6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:29:37.280689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.280596    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:37.280689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.280629    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:37.280689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.280640    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:37.280689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.280652    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zp6m\" (UniqueName: \"kubernetes.io/projected/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-kube-api-access-2zp6m\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:37.280689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.280669    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:37.280689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.280680    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:37.280689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.280693    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:37.281193 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.280705    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:37.446417 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.446373    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"]
Sep 10 17:29:37.453954 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:37.453913    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-75bd9a-openshift-default-7cf57df5d4-cq28g"]
Sep 10 17:29:39.084962 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:39.084926    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" path="/var/lib/kubelet/pods/8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0/volumes"
Sep 10 17:29:42.379790 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:42.379754    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:29:45.622131 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:45.622098    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"]
Sep 10 17:29:45.622657 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:45.622344    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47" podUID="69fd154c-ad03-4f55-9bb7-ec49ece9efe0" containerName="payload-processing" containerID="cri-o://3ede9b872d3ec04438c8bcb72f9cc9ea69ff8b612e00aa4510a1871d684dd818" gracePeriod=30
Sep 10 17:29:45.869170 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:45.869135    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"
Sep 10 17:29:46.059268 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:46.059173    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sqqc\" (UniqueName: \"kubernetes.io/projected/69fd154c-ad03-4f55-9bb7-ec49ece9efe0-kube-api-access-5sqqc\") pod \"69fd154c-ad03-4f55-9bb7-ec49ece9efe0\" (UID: \"69fd154c-ad03-4f55-9bb7-ec49ece9efe0\") "
Sep 10 17:29:46.059268 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:46.059218    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69fd154c-ad03-4f55-9bb7-ec49ece9efe0-plugins-config-volume\") pod \"69fd154c-ad03-4f55-9bb7-ec49ece9efe0\" (UID: \"69fd154c-ad03-4f55-9bb7-ec49ece9efe0\") "
Sep 10 17:29:46.059661 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:46.059634    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69fd154c-ad03-4f55-9bb7-ec49ece9efe0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "69fd154c-ad03-4f55-9bb7-ec49ece9efe0" (UID: "69fd154c-ad03-4f55-9bb7-ec49ece9efe0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:29:46.061303 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:46.061278    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69fd154c-ad03-4f55-9bb7-ec49ece9efe0-kube-api-access-5sqqc" (OuterVolumeSpecName: "kube-api-access-5sqqc") pod "69fd154c-ad03-4f55-9bb7-ec49ece9efe0" (UID: "69fd154c-ad03-4f55-9bb7-ec49ece9efe0"). InnerVolumeSpecName "kube-api-access-5sqqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:29:46.159730 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:46.159698    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sqqc\" (UniqueName: \"kubernetes.io/projected/69fd154c-ad03-4f55-9bb7-ec49ece9efe0-kube-api-access-5sqqc\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:46.159730 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:46.159724    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69fd154c-ad03-4f55-9bb7-ec49ece9efe0-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:46.162658 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:46.162629    2576 generic.go:356] "Generic (PLEG): container finished" podID="69fd154c-ad03-4f55-9bb7-ec49ece9efe0" containerID="3ede9b872d3ec04438c8bcb72f9cc9ea69ff8b612e00aa4510a1871d684dd818" exitCode=0
Sep 10 17:29:46.162798 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:46.162690    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"
Sep 10 17:29:46.162798 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:46.162718    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47" event={"ID":"69fd154c-ad03-4f55-9bb7-ec49ece9efe0","Type":"ContainerDied","Data":"3ede9b872d3ec04438c8bcb72f9cc9ea69ff8b612e00aa4510a1871d684dd818"}
Sep 10 17:29:46.162798 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:46.162771    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47" event={"ID":"69fd154c-ad03-4f55-9bb7-ec49ece9efe0","Type":"ContainerDied","Data":"ac055323adacd84e8c6ca3ce3ef0d2123113f96524d1da9dd1d79b111e76748c"}
Sep 10 17:29:46.162798 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:46.162795    2576 scope.go:117] "RemoveContainer" containerID="3ede9b872d3ec04438c8bcb72f9cc9ea69ff8b612e00aa4510a1871d684dd818"
Sep 10 17:29:46.171374 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:46.171350    2576 scope.go:117] "RemoveContainer" containerID="3ede9b872d3ec04438c8bcb72f9cc9ea69ff8b612e00aa4510a1871d684dd818"
Sep 10 17:29:46.171649 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:29:46.171634    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ede9b872d3ec04438c8bcb72f9cc9ea69ff8b612e00aa4510a1871d684dd818\": container with ID starting with 3ede9b872d3ec04438c8bcb72f9cc9ea69ff8b612e00aa4510a1871d684dd818 not found: ID does not exist" containerID="3ede9b872d3ec04438c8bcb72f9cc9ea69ff8b612e00aa4510a1871d684dd818"
Sep 10 17:29:46.171696 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:46.171656    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ede9b872d3ec04438c8bcb72f9cc9ea69ff8b612e00aa4510a1871d684dd818"} err="failed to get container status \"3ede9b872d3ec04438c8bcb72f9cc9ea69ff8b612e00aa4510a1871d684dd818\": rpc error: code = NotFound desc = could not find container \"3ede9b872d3ec04438c8bcb72f9cc9ea69ff8b612e00aa4510a1871d684dd818\": container with ID starting with 3ede9b872d3ec04438c8bcb72f9cc9ea69ff8b612e00aa4510a1871d684dd818 not found: ID does not exist"
Sep 10 17:29:46.185982 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:46.185953    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"]
Sep 10 17:29:46.190965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:46.190937    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6dc6af55-6695dcc5b9-nvq47"]
Sep 10 17:29:47.084780 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:47.084702    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69fd154c-ad03-4f55-9bb7-ec49ece9efe0" path="/var/lib/kubelet/pods/69fd154c-ad03-4f55-9bb7-ec49ece9efe0/volumes"
Sep 10 17:29:52.920643 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:52.920606    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:29:53.133476 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:53.133440    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"]
Sep 10 17:29:53.133753 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:53.133699    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq" podUID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerName="istio-proxy" containerID="cri-o://8e83fd7ae075132b61d2717ce42f79c1c28b70df8d0e82fa9d821eb0b7477762" gracePeriod=30
Sep 10 17:29:53.369040 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:53.369002    2576 patch_prober.go:28] interesting pod/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 10 17:29:53.369243 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:53.369106    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq" podUID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 17:29:58.380522 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.380492    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:29:58.453648 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.453558    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-data\") pod \"306bece2-96a2-44cd-ab63-00dc74d5ca58\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") "
Sep 10 17:29:58.453648 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.453606    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-podinfo\") pod \"306bece2-96a2-44cd-ab63-00dc74d5ca58\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") "
Sep 10 17:29:58.453899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.453654    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-envoy\") pod \"306bece2-96a2-44cd-ab63-00dc74d5ca58\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") "
Sep 10 17:29:58.453899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.453689    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-token\") pod \"306bece2-96a2-44cd-ab63-00dc74d5ca58\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") "
Sep 10 17:29:58.453899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.453720    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/306bece2-96a2-44cd-ab63-00dc74d5ca58-istiod-ca-cert\") pod \"306bece2-96a2-44cd-ab63-00dc74d5ca58\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") "
Sep 10 17:29:58.453899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.453741    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-workload-socket\") pod \"306bece2-96a2-44cd-ab63-00dc74d5ca58\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") "
Sep 10 17:29:58.453899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.453785    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-workload-certs\") pod \"306bece2-96a2-44cd-ab63-00dc74d5ca58\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") "
Sep 10 17:29:58.453899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.453813    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-data" (OuterVolumeSpecName: "istio-data") pod "306bece2-96a2-44cd-ab63-00dc74d5ca58" (UID: "306bece2-96a2-44cd-ab63-00dc74d5ca58"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:58.453899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.453836    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-credential-socket\") pod \"306bece2-96a2-44cd-ab63-00dc74d5ca58\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") "
Sep 10 17:29:58.453899 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.453863    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dbvf\" (UniqueName: \"kubernetes.io/projected/306bece2-96a2-44cd-ab63-00dc74d5ca58-kube-api-access-5dbvf\") pod \"306bece2-96a2-44cd-ab63-00dc74d5ca58\" (UID: \"306bece2-96a2-44cd-ab63-00dc74d5ca58\") "
Sep 10 17:29:58.454351 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.454089    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "306bece2-96a2-44cd-ab63-00dc74d5ca58" (UID: "306bece2-96a2-44cd-ab63-00dc74d5ca58"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:58.454351 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.454103    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "306bece2-96a2-44cd-ab63-00dc74d5ca58" (UID: "306bece2-96a2-44cd-ab63-00dc74d5ca58"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:58.454351 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.454144    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:58.454351 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.454293    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "306bece2-96a2-44cd-ab63-00dc74d5ca58" (UID: "306bece2-96a2-44cd-ab63-00dc74d5ca58"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:58.454351 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.454206    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/306bece2-96a2-44cd-ab63-00dc74d5ca58-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "306bece2-96a2-44cd-ab63-00dc74d5ca58" (UID: "306bece2-96a2-44cd-ab63-00dc74d5ca58"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:29:58.456172 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.456147    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/306bece2-96a2-44cd-ab63-00dc74d5ca58-kube-api-access-5dbvf" (OuterVolumeSpecName: "kube-api-access-5dbvf") pod "306bece2-96a2-44cd-ab63-00dc74d5ca58" (UID: "306bece2-96a2-44cd-ab63-00dc74d5ca58"). InnerVolumeSpecName "kube-api-access-5dbvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:29:58.456357 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.456333    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "306bece2-96a2-44cd-ab63-00dc74d5ca58" (UID: "306bece2-96a2-44cd-ab63-00dc74d5ca58"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:29:58.456474 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.456371    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "306bece2-96a2-44cd-ab63-00dc74d5ca58" (UID: "306bece2-96a2-44cd-ab63-00dc74d5ca58"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:29:58.456474 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.456386    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-token" (OuterVolumeSpecName: "istio-token") pod "306bece2-96a2-44cd-ab63-00dc74d5ca58" (UID: "306bece2-96a2-44cd-ab63-00dc74d5ca58"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:29:58.554929 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.554887    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:58.554929 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.554913    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dbvf\" (UniqueName: \"kubernetes.io/projected/306bece2-96a2-44cd-ab63-00dc74d5ca58-kube-api-access-5dbvf\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:58.554929 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.554928    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:58.554929 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.554941    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:58.555356 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.554950    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/306bece2-96a2-44cd-ab63-00dc74d5ca58-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:58.555356 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.554960    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/306bece2-96a2-44cd-ab63-00dc74d5ca58-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:58.555356 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.554971    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:58.555356 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:58.554980    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/306bece2-96a2-44cd-ab63-00dc74d5ca58-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:29:59.226211 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:59.226174    2576 generic.go:356] "Generic (PLEG): container finished" podID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerID="8e83fd7ae075132b61d2717ce42f79c1c28b70df8d0e82fa9d821eb0b7477762" exitCode=0
Sep 10 17:29:59.226387 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:59.226224    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq" event={"ID":"306bece2-96a2-44cd-ab63-00dc74d5ca58","Type":"ContainerDied","Data":"8e83fd7ae075132b61d2717ce42f79c1c28b70df8d0e82fa9d821eb0b7477762"}
Sep 10 17:29:59.226387 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:59.226294    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq" event={"ID":"306bece2-96a2-44cd-ab63-00dc74d5ca58","Type":"ContainerDied","Data":"c9d224e6aa35564fac4010e3089cc27d04d22a8830912fd970b8a2cc66cb2ca6"}
Sep 10 17:29:59.226387 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:59.226238    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"
Sep 10 17:29:59.226387 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:59.226323    2576 scope.go:117] "RemoveContainer" containerID="8e83fd7ae075132b61d2717ce42f79c1c28b70df8d0e82fa9d821eb0b7477762"
Sep 10 17:29:59.235394 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:59.235375    2576 scope.go:117] "RemoveContainer" containerID="035a34524b436b9d30e0c69b7f14e720e8188e8642e5bb4b9207363028c89895"
Sep 10 17:29:59.242967 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:59.242949    2576 scope.go:117] "RemoveContainer" containerID="8e83fd7ae075132b61d2717ce42f79c1c28b70df8d0e82fa9d821eb0b7477762"
Sep 10 17:29:59.243251 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:29:59.243233    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e83fd7ae075132b61d2717ce42f79c1c28b70df8d0e82fa9d821eb0b7477762\": container with ID starting with 8e83fd7ae075132b61d2717ce42f79c1c28b70df8d0e82fa9d821eb0b7477762 not found: ID does not exist" containerID="8e83fd7ae075132b61d2717ce42f79c1c28b70df8d0e82fa9d821eb0b7477762"
Sep 10 17:29:59.243307 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:59.243259    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e83fd7ae075132b61d2717ce42f79c1c28b70df8d0e82fa9d821eb0b7477762"} err="failed to get container status \"8e83fd7ae075132b61d2717ce42f79c1c28b70df8d0e82fa9d821eb0b7477762\": rpc error: code = NotFound desc = could not find container \"8e83fd7ae075132b61d2717ce42f79c1c28b70df8d0e82fa9d821eb0b7477762\": container with ID starting with 8e83fd7ae075132b61d2717ce42f79c1c28b70df8d0e82fa9d821eb0b7477762 not found: ID does not exist"
Sep 10 17:29:59.243307 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:59.243276    2576 scope.go:117] "RemoveContainer" containerID="035a34524b436b9d30e0c69b7f14e720e8188e8642e5bb4b9207363028c89895"
Sep 10 17:29:59.243547 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:29:59.243531    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"035a34524b436b9d30e0c69b7f14e720e8188e8642e5bb4b9207363028c89895\": container with ID starting with 035a34524b436b9d30e0c69b7f14e720e8188e8642e5bb4b9207363028c89895 not found: ID does not exist" containerID="035a34524b436b9d30e0c69b7f14e720e8188e8642e5bb4b9207363028c89895"
Sep 10 17:29:59.243602 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:59.243550    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"035a34524b436b9d30e0c69b7f14e720e8188e8642e5bb4b9207363028c89895"} err="failed to get container status \"035a34524b436b9d30e0c69b7f14e720e8188e8642e5bb4b9207363028c89895\": rpc error: code = NotFound desc = could not find container \"035a34524b436b9d30e0c69b7f14e720e8188e8642e5bb4b9207363028c89895\": container with ID starting with 035a34524b436b9d30e0c69b7f14e720e8188e8642e5bb4b9207363028c89895 not found: ID does not exist"
Sep 10 17:29:59.252819 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:59.252793    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"]
Sep 10 17:29:59.256159 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:29:59.256138    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6dc6af55-openshift-default-6466bf4c84-sbdxq"]
Sep 10 17:30:00.163335 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163296    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817690-dmrm8"]
Sep 10 17:30:00.163802 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163751    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" containerName="istio-proxy"
Sep 10 17:30:00.163802 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163769    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" containerName="istio-proxy"
Sep 10 17:30:00.163802 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163788    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerName="istio-proxy"
Sep 10 17:30:00.163802 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163795    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerName="istio-proxy"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163810    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" containerName="istio-proxy"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163819    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" containerName="istio-proxy"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163831    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69fd154c-ad03-4f55-9bb7-ec49ece9efe0" containerName="payload-processing"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163839    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="69fd154c-ad03-4f55-9bb7-ec49ece9efe0" containerName="payload-processing"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163853    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c4a9cdf-e0d5-48df-87c5-5deb320a5df1" containerName="main"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163861    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c4a9cdf-e0d5-48df-87c5-5deb320a5df1" containerName="main"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163869    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" containerName="istio-proxy"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163877    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" containerName="istio-proxy"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163886    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1bbcf0a-a275-47fe-9f82-b17932497cd2" containerName="istio-proxy"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163894    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1bbcf0a-a275-47fe-9f82-b17932497cd2" containerName="istio-proxy"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163978    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="69fd154c-ad03-4f55-9bb7-ec49ece9efe0" containerName="payload-processing"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.163988    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerName="istio-proxy"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.164000    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c4a9cdf-e0d5-48df-87c5-5deb320a5df1" containerName="main"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.164008    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" containerName="istio-proxy"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.164016    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1bbcf0a-a275-47fe-9f82-b17932497cd2" containerName="istio-proxy"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.164029    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b6272ab-a9ee-46aa-bfa0-c18c50b6adb8" containerName="istio-proxy"
Sep 10 17:30:00.164038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.164040    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" containerName="istio-proxy"
Sep 10 17:30:00.164854 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.164067    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" containerName="istio-proxy"
Sep 10 17:30:00.167224 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.167203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817690-dmrm8"
Sep 10 17:30:00.170445 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.170424    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4mln5\""
Sep 10 17:30:00.176752 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.176730    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817690-dmrm8"
Sep 10 17:30:00.178998 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.178631    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817690-dmrm8"]
Sep 10 17:30:00.451426 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:00.451398    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817690-dmrm8"]
Sep 10 17:30:00.452238 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:30:00.452216    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f656fdf_d25e_4dbd_a447_8958b15b6d62.slice/crio-0fdc774cb4d92f9fe72877d45ab69f57ea27cadeb8d6cf91a399b2effdb3533e WatchSource:0}: Error finding container 0fdc774cb4d92f9fe72877d45ab69f57ea27cadeb8d6cf91a399b2effdb3533e: Status 404 returned error can't find the container with id 0fdc774cb4d92f9fe72877d45ab69f57ea27cadeb8d6cf91a399b2effdb3533e
Sep 10 17:30:01.084444 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:01.084367    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="306bece2-96a2-44cd-ab63-00dc74d5ca58" path="/var/lib/kubelet/pods/306bece2-96a2-44cd-ab63-00dc74d5ca58/volumes"
Sep 10 17:30:01.241441 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:01.241403    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817690-dmrm8" event={"ID":"7f656fdf-d25e-4dbd-a447-8958b15b6d62","Type":"ContainerStarted","Data":"9b1a96722aa1c1972279cb135e65394aa8ddf0eb383009e96425f857dccf8d1f"}
Sep 10 17:30:01.241836 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:01.241462    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817690-dmrm8" event={"ID":"7f656fdf-d25e-4dbd-a447-8958b15b6d62","Type":"ContainerStarted","Data":"0fdc774cb4d92f9fe72877d45ab69f57ea27cadeb8d6cf91a399b2effdb3533e"}
Sep 10 17:30:01.277026 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:01.276967    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817690-dmrm8" podStartSLOduration=1.276948259 podStartE2EDuration="1.276948259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:30:01.275445614 +0000 UTC m=+1086.691496564" watchObservedRunningTime="2026-09-10 17:30:01.276948259 +0000 UTC m=+1086.692999207"
Sep 10 17:30:02.158270 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.158237    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"]
Sep 10 17:30:02.158659 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.158641    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" containerName="istio-proxy"
Sep 10 17:30:02.158753 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.158662    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e45bbc0-5a25-47a4-8f46-9d9c414c6ae0" containerName="istio-proxy"
Sep 10 17:30:02.158753 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.158679    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerName="istio-proxy"
Sep 10 17:30:02.158753 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.158687    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerName="istio-proxy"
Sep 10 17:30:02.158953 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.158763    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="306bece2-96a2-44cd-ab63-00dc74d5ca58" containerName="istio-proxy"
Sep 10 17:30:02.160713 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.160692    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.164373 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.164347    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-6806f1-openshift-default-dockercfg-mkf7z\""
Sep 10 17:30:02.185963 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.185932    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-token\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.186156 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.185982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-envoy\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.186156 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.186102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnq45\" (UniqueName: \"kubernetes.io/projected/bbd2ad43-302a-4326-96ea-f8d0af258d96-kube-api-access-fnq45\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.186297 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.186161    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-data\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.186297 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.186187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-podinfo\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.186297 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.186244    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-workload-certs\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.186462 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.186332    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-workload-socket\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.186462 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.186370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbd2ad43-302a-4326-96ea-f8d0af258d96-istiod-ca-cert\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.186462 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.186404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-credential-socket\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.187144 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.187121    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"]
Sep 10 17:30:02.248460 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.248427    2576 generic.go:356] "Generic (PLEG): container finished" podID="7f656fdf-d25e-4dbd-a447-8958b15b6d62" containerID="9b1a96722aa1c1972279cb135e65394aa8ddf0eb383009e96425f857dccf8d1f" exitCode=0
Sep 10 17:30:02.248847 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.248504    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817690-dmrm8" event={"ID":"7f656fdf-d25e-4dbd-a447-8958b15b6d62","Type":"ContainerDied","Data":"9b1a96722aa1c1972279cb135e65394aa8ddf0eb383009e96425f857dccf8d1f"}
Sep 10 17:30:02.287676 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.287641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnq45\" (UniqueName: \"kubernetes.io/projected/bbd2ad43-302a-4326-96ea-f8d0af258d96-kube-api-access-fnq45\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.287676 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.287678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-data\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.287877 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.287694    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-podinfo\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.287877 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.287734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-workload-certs\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.287877 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.287769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-workload-socket\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.287877 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.287784    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbd2ad43-302a-4326-96ea-f8d0af258d96-istiod-ca-cert\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.287877 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.287814    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-credential-socket\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.287877 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.287854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-token\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.288241 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.287881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-envoy\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.288241 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.288152    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-data\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.288241 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.288221    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-workload-socket\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.288387 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.288364    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-workload-certs\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.288610 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.288587    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbd2ad43-302a-4326-96ea-f8d0af258d96-istiod-ca-cert\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.288721 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.288619    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-credential-socket\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.290236 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.290214    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-envoy\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.290683 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.290665    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-podinfo\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.296655 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.296629    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnq45\" (UniqueName: \"kubernetes.io/projected/bbd2ad43-302a-4326-96ea-f8d0af258d96-kube-api-access-fnq45\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.296655 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.296646    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-token\") pod \"e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") " pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.471404 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.471301    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:02.752667 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.752576    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"]
Sep 10 17:30:02.755392 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:30:02.755348    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd2ad43_302a_4326_96ea_f8d0af258d96.slice/crio-19bf918c4710cfe19eda44878ce1640161b9e9a291e2129440b6bd99a435d61c WatchSource:0}: Error finding container 19bf918c4710cfe19eda44878ce1640161b9e9a291e2129440b6bd99a435d61c: Status 404 returned error can't find the container with id 19bf918c4710cfe19eda44878ce1640161b9e9a291e2129440b6bd99a435d61c
Sep 10 17:30:02.757709 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.757669    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:30:02.757805 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.757762    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:30:02.757845 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:02.757808    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:30:03.256524 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:03.256490    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" event={"ID":"bbd2ad43-302a-4326-96ea-f8d0af258d96","Type":"ContainerStarted","Data":"ca9f9738e514752f4e9088ed9078d814048727442e958d37029468955fefce53"}
Sep 10 17:30:03.256974 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:03.256544    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" event={"ID":"bbd2ad43-302a-4326-96ea-f8d0af258d96","Type":"ContainerStarted","Data":"19bf918c4710cfe19eda44878ce1640161b9e9a291e2129440b6bd99a435d61c"}
Sep 10 17:30:03.310523 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:03.310355    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" podStartSLOduration=1.31033257 podStartE2EDuration="1.31033257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:30:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:30:03.309310601 +0000 UTC m=+1088.725361552" watchObservedRunningTime="2026-09-10 17:30:03.31033257 +0000 UTC m=+1088.726383520"
Sep 10 17:30:03.383724 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:03.383696    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817690-dmrm8"
Sep 10 17:30:03.472504 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:03.472464    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:03.474015 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:03.473986    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 17:30:03.474153 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:03.474063    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 17:30:04.262313 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:04.262285    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817690-dmrm8"
Sep 10 17:30:04.262691 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:04.262315    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817690-dmrm8" event={"ID":"7f656fdf-d25e-4dbd-a447-8958b15b6d62","Type":"ContainerDied","Data":"0fdc774cb4d92f9fe72877d45ab69f57ea27cadeb8d6cf91a399b2effdb3533e"}
Sep 10 17:30:04.262691 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:04.262364    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fdc774cb4d92f9fe72877d45ab69f57ea27cadeb8d6cf91a399b2effdb3533e"
Sep 10 17:30:04.476140 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:04.476112    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:05.268070 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:05.268019    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:05.269165 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:05.269146    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:07.600203 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.600167    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"]
Sep 10 17:30:07.600612 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.600489    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f656fdf-d25e-4dbd-a447-8958b15b6d62" containerName="cleanup"
Sep 10 17:30:07.600612 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.600500    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f656fdf-d25e-4dbd-a447-8958b15b6d62" containerName="cleanup"
Sep 10 17:30:07.600612 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.600561    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f656fdf-d25e-4dbd-a447-8958b15b6d62" containerName="cleanup"
Sep 10 17:30:07.602442 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.602423    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"
Sep 10 17:30:07.606011 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.605991    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-6806f1-dockercfg-c47ps\""
Sep 10 17:30:07.606141 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.606024    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-6806f1\""
Sep 10 17:30:07.615789 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.615763    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"]
Sep 10 17:30:07.637434 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.637400    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmw26\" (UniqueName: \"kubernetes.io/projected/8f659e42-dc31-4112-9351-ae6c0cf27b2b-kube-api-access-mmw26\") pod \"payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5\" (UID: \"8f659e42-dc31-4112-9351-ae6c0cf27b2b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"
Sep 10 17:30:07.637591 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.637460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f659e42-dc31-4112-9351-ae6c0cf27b2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5\" (UID: \"8f659e42-dc31-4112-9351-ae6c0cf27b2b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"
Sep 10 17:30:07.732892 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.732855    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"]
Sep 10 17:30:07.735153 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.735136    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"
Sep 10 17:30:07.737921 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.737898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmw26\" (UniqueName: \"kubernetes.io/projected/8f659e42-dc31-4112-9351-ae6c0cf27b2b-kube-api-access-mmw26\") pod \"payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5\" (UID: \"8f659e42-dc31-4112-9351-ae6c0cf27b2b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"
Sep 10 17:30:07.738032 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.737948    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f659e42-dc31-4112-9351-ae6c0cf27b2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5\" (UID: \"8f659e42-dc31-4112-9351-ae6c0cf27b2b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"
Sep 10 17:30:07.738629 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.738611    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f659e42-dc31-4112-9351-ae6c0cf27b2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5\" (UID: \"8f659e42-dc31-4112-9351-ae6c0cf27b2b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"
Sep 10 17:30:07.759043 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.759011    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"]
Sep 10 17:30:07.759978 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.759955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmw26\" (UniqueName: \"kubernetes.io/projected/8f659e42-dc31-4112-9351-ae6c0cf27b2b-kube-api-access-mmw26\") pod \"payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5\" (UID: \"8f659e42-dc31-4112-9351-ae6c0cf27b2b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"
Sep 10 17:30:07.838600 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.838561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh5mn\" (UniqueName: \"kubernetes.io/projected/57084a0a-09f6-4e01-9002-ff2bf6195af4-kube-api-access-gh5mn\") pod \"payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f\" (UID: \"57084a0a-09f6-4e01-9002-ff2bf6195af4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"
Sep 10 17:30:07.838780 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.838618    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57084a0a-09f6-4e01-9002-ff2bf6195af4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f\" (UID: \"57084a0a-09f6-4e01-9002-ff2bf6195af4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"
Sep 10 17:30:07.911941 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.911907    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"
Sep 10 17:30:07.939637 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.939607    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57084a0a-09f6-4e01-9002-ff2bf6195af4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f\" (UID: \"57084a0a-09f6-4e01-9002-ff2bf6195af4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"
Sep 10 17:30:07.939806 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.939683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh5mn\" (UniqueName: \"kubernetes.io/projected/57084a0a-09f6-4e01-9002-ff2bf6195af4-kube-api-access-gh5mn\") pod \"payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f\" (UID: \"57084a0a-09f6-4e01-9002-ff2bf6195af4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"
Sep 10 17:30:07.940327 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.940302    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57084a0a-09f6-4e01-9002-ff2bf6195af4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f\" (UID: \"57084a0a-09f6-4e01-9002-ff2bf6195af4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"
Sep 10 17:30:07.951414 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:07.951380    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh5mn\" (UniqueName: \"kubernetes.io/projected/57084a0a-09f6-4e01-9002-ff2bf6195af4-kube-api-access-gh5mn\") pod \"payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f\" (UID: \"57084a0a-09f6-4e01-9002-ff2bf6195af4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"
Sep 10 17:30:08.045676 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:08.045635    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"
Sep 10 17:30:08.197768 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:08.197742    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"]
Sep 10 17:30:08.199843 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:30:08.199800    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f659e42_dc31_4112_9351_ae6c0cf27b2b.slice/crio-4cafaaaec2cebb8d618eb28da328fe111c4a867df2ca55a24ff78376505626e6 WatchSource:0}: Error finding container 4cafaaaec2cebb8d618eb28da328fe111c4a867df2ca55a24ff78376505626e6: Status 404 returned error can't find the container with id 4cafaaaec2cebb8d618eb28da328fe111c4a867df2ca55a24ff78376505626e6
Sep 10 17:30:08.285563 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:08.285517    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5" event={"ID":"8f659e42-dc31-4112-9351-ae6c0cf27b2b","Type":"ContainerStarted","Data":"3699d091d6baf625cdfafe035446fb9eba96c278ac9275f7c05ff846ced275bc"}
Sep 10 17:30:08.285747 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:08.285578    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5" event={"ID":"8f659e42-dc31-4112-9351-ae6c0cf27b2b","Type":"ContainerStarted","Data":"4cafaaaec2cebb8d618eb28da328fe111c4a867df2ca55a24ff78376505626e6"}
Sep 10 17:30:08.285747 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:08.285610    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"
Sep 10 17:30:08.319676 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:08.319622    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5" podStartSLOduration=1.319602789 podStartE2EDuration="1.319602789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:30:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:30:08.316947635 +0000 UTC m=+1093.732998584" watchObservedRunningTime="2026-09-10 17:30:08.319602789 +0000 UTC m=+1093.735653738"
Sep 10 17:30:08.321864 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:08.321841    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"]
Sep 10 17:30:08.323489 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:30:08.323464    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57084a0a_09f6_4e01_9002_ff2bf6195af4.slice/crio-9123a8d097961771a164dae031ffe97732500b38fee27706f4b8a183f194e2b9 WatchSource:0}: Error finding container 9123a8d097961771a164dae031ffe97732500b38fee27706f4b8a183f194e2b9: Status 404 returned error can't find the container with id 9123a8d097961771a164dae031ffe97732500b38fee27706f4b8a183f194e2b9
Sep 10 17:30:09.292220 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:09.292182    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f" event={"ID":"57084a0a-09f6-4e01-9002-ff2bf6195af4","Type":"ContainerStarted","Data":"e0b3a13980b26dd22cbb3fd7747559153da2be6c9c715e8ded16df960c0d26ae"}
Sep 10 17:30:09.292812 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:09.292233    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f" event={"ID":"57084a0a-09f6-4e01-9002-ff2bf6195af4","Type":"ContainerStarted","Data":"9123a8d097961771a164dae031ffe97732500b38fee27706f4b8a183f194e2b9"}
Sep 10 17:30:09.292812 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:09.292351    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"
Sep 10 17:30:09.313963 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:09.313909    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f" podStartSLOduration=2.3138887280000002 podStartE2EDuration="2.313888728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:30:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:30:09.311204458 +0000 UTC m=+1094.727255419" watchObservedRunningTime="2026-09-10 17:30:09.313888728 +0000 UTC m=+1094.729939678"
Sep 10 17:30:10.913184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:10.913150    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:30:11.043643 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.043609    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"]
Sep 10 17:30:11.047317 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.047298    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.057064 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.057030    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-33b7bb-openshift-default-dockercfg-nnkpm\""
Sep 10 17:30:11.061854 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.061828    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"]
Sep 10 17:30:11.170289 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.170186    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-workload-certs\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.170289 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.170251    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-credential-socket\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.170538 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.170310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istiod-ca-cert\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.170538 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.170401    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-token\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.170538 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.170439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmpm4\" (UniqueName: \"kubernetes.io/projected/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-kube-api-access-jmpm4\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.170538 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.170473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-podinfo\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.170736 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.170549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-data\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.170736 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.170587    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-workload-socket\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.170736 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.170624    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-envoy\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.271136 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.271094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-token\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.271136 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.271137    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmpm4\" (UniqueName: \"kubernetes.io/projected/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-kube-api-access-jmpm4\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.271380 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.271166    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-podinfo\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.271380 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.271203    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-data\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.271380 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.271231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-workload-socket\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.271380 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.271264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-envoy\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.271380 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.271310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-workload-certs\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.271380 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.271355    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-credential-socket\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.271696 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.271423    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istiod-ca-cert\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.271696 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.271663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-data\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.271812 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.271705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-workload-certs\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.271812 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.271717    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-workload-socket\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.271887 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.271824    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-credential-socket\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.272139 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.272121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istiod-ca-cert\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.273583 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.273562    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-envoy\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.273804 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.273786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-podinfo\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.282137 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.282111    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmpm4\" (UniqueName: \"kubernetes.io/projected/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-kube-api-access-jmpm4\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.282390 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.282367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-token\") pod \"e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") " pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.357788 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.357743    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:11.637073 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.637022    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"]
Sep 10 17:30:11.638849 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:30:11.638822    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92cd8f50_b364_4ed4_b6b1_fd986ffe00a4.slice/crio-bfd08a72ec979bbe91c9c449903981905125c04428b3d1250029d50fcf79088d WatchSource:0}: Error finding container bfd08a72ec979bbe91c9c449903981905125c04428b3d1250029d50fcf79088d: Status 404 returned error can't find the container with id bfd08a72ec979bbe91c9c449903981905125c04428b3d1250029d50fcf79088d
Sep 10 17:30:11.641124 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.641093    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:30:11.641195 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.641160    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:30:11.641195 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:11.641189    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:30:12.308551 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:12.308511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd" event={"ID":"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4","Type":"ContainerStarted","Data":"cdc3c58417f6e75c934a04608c7dac3658783d5d7e669b3dd25d72193c087589"}
Sep 10 17:30:12.308954 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:12.308607    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd" event={"ID":"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4","Type":"ContainerStarted","Data":"bfd08a72ec979bbe91c9c449903981905125c04428b3d1250029d50fcf79088d"}
Sep 10 17:30:12.334329 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:12.334270    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd" podStartSLOduration=1.334253162 podStartE2EDuration="1.334253162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:30:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:30:12.331662501 +0000 UTC m=+1097.747713450" watchObservedRunningTime="2026-09-10 17:30:12.334253162 +0000 UTC m=+1097.750304110"
Sep 10 17:30:12.358853 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:12.358816    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:12.363877 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:12.363855    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:13.313281 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:13.313246    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:13.314277 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:13.314262    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:19.294243 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:19.294208    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"
Sep 10 17:30:20.299753 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:20.299721    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"
Sep 10 17:30:21.309269 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:21.309224    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 17:30:21.310618 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:21.309314    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 17:30:21.360523 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:21.360494    2576 generic.go:356] "Generic (PLEG): container finished" podID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerID="ca9f9738e514752f4e9088ed9078d814048727442e958d37029468955fefce53" exitCode=0
Sep 10 17:30:21.360680 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:21.360535    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" event={"ID":"bbd2ad43-302a-4326-96ea-f8d0af258d96","Type":"ContainerDied","Data":"ca9f9738e514752f4e9088ed9078d814048727442e958d37029468955fefce53"}
Sep 10 17:30:21.360918 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:21.360905    2576 scope.go:117] "RemoveContainer" containerID="ca9f9738e514752f4e9088ed9078d814048727442e958d37029468955fefce53"
Sep 10 17:30:21.361940 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:21.361913    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:30:21.361990 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:21.361977    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:30:21.362030 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:21.362011    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:30:22.368304 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:22.368265    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" event={"ID":"bbd2ad43-302a-4326-96ea-f8d0af258d96","Type":"ContainerStarted","Data":"8b56da70270c12afcd7747278a109a87e71c86a835c93c3b0020754dcdb3fbfd"}
Sep 10 17:30:22.471729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:22.471686    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:22.471998 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:22.471973    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 17:30:22.472101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:22.472040    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 17:30:23.472517 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:23.472464    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 17:30:23.472922 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:23.472529    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 17:30:24.421301 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:24.421257    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:30:24.472540 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:24.472500    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 17:30:24.472890 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:24.472568    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 17:30:25.471827 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:25.471786    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 17:30:25.472012 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:25.471843    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 17:30:26.472745 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:26.472707    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 17:30:26.473149 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:26.472778    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 17:30:27.472254 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:27.472214    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 10 17:30:27.472475 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:27.472273    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 10 17:30:28.476132 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:28.476090    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:28.476543 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:28.476472    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:28.477260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:28.477232    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:30:28.819297 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:28.818118    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:47190->10.133.0.59:15021: read: connection reset by peer" start-of-body=
Sep 10 17:30:28.819297 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:28.818203    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd" podUID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:47190->10.133.0.59:15021: read: connection reset by peer"
Sep 10 17:30:29.413651 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:29.413617    2576 generic.go:356] "Generic (PLEG): container finished" podID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" containerID="cdc3c58417f6e75c934a04608c7dac3658783d5d7e669b3dd25d72193c087589" exitCode=0
Sep 10 17:30:29.414408 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:29.414371    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd" event={"ID":"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4","Type":"ContainerDied","Data":"cdc3c58417f6e75c934a04608c7dac3658783d5d7e669b3dd25d72193c087589"}
Sep 10 17:30:29.414823 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:29.414803    2576 scope.go:117] "RemoveContainer" containerID="cdc3c58417f6e75c934a04608c7dac3658783d5d7e669b3dd25d72193c087589"
Sep 10 17:30:29.416064 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:29.416030    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:30:29.416132 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:29.416117    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:30:29.416177 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:29.416151    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:30:30.421396 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:30.421364    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd" event={"ID":"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4","Type":"ContainerStarted","Data":"14253760048bfca23e01f42c6bc1e20275009539c039b7188831d1ad5c7232b2"}
Sep 10 17:30:31.357958 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:31.357923    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:31.358174 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:31.358152    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 17:30:31.358226 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:31.358203    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd" podUID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 17:30:32.358674 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:32.358634    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 17:30:32.359092 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:32.358694    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd" podUID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 17:30:33.358704 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:33.358660    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 17:30:33.359215 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:33.358726    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd" podUID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 17:30:34.358859 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:34.358822    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 17:30:34.359263 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:34.358881    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd" podUID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 17:30:35.358595 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:35.358563    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 10 17:30:35.358774 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:35.358616    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd" podUID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 10 17:30:36.362197 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:36.362163    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:36.362589 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:36.362546    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:36.363155 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:36.363136    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:30:40.042992 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.042957    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"]
Sep 10 17:30:40.047440 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.047415    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.052261 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.052237    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-edbcb5-openshift-default-dockercfg-vwsks\""
Sep 10 17:30:40.075257 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.075229    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"]
Sep 10 17:30:40.143292 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.143255    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-envoy\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.143495 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.143386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-data\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.143495 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.143439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lh4n\" (UniqueName: \"kubernetes.io/projected/7887549b-2c5c-4a91-b7b0-d4b799704e84-kube-api-access-8lh4n\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.143641 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.143510    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-credential-socket\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.143641 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.143583    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-workload-certs\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.143641 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.143626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-podinfo\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.143797 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.143674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-token\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.143797 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.143732    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7887549b-2c5c-4a91-b7b0-d4b799704e84-istiod-ca-cert\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.143797 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.143763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-workload-socket\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.245193 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.245158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-podinfo\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.245419 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.245207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-token\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.245419 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.245251    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7887549b-2c5c-4a91-b7b0-d4b799704e84-istiod-ca-cert\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.245419 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.245282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-workload-socket\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.245419 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.245321    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-envoy\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.245419 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.245359    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-data\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.245419 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.245401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lh4n\" (UniqueName: \"kubernetes.io/projected/7887549b-2c5c-4a91-b7b0-d4b799704e84-kube-api-access-8lh4n\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.245847 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.245429    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-credential-socket\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.245847 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.245462    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-workload-certs\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.245847 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.245807    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-workload-certs\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.246027 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.245874    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-data\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.246027 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.245903    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-credential-socket\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.246138 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.246080    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7887549b-2c5c-4a91-b7b0-d4b799704e84-istiod-ca-cert\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.246138 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.246096    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-workload-socket\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.247725 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.247702    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-podinfo\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.247890 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.247867    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-envoy\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.255640 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.255615    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lh4n\" (UniqueName: \"kubernetes.io/projected/7887549b-2c5c-4a91-b7b0-d4b799704e84-kube-api-access-8lh4n\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.256108 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.256088    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-token\") pod \"e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") " pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.360647 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.360547    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:40.642534 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.642475    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"]
Sep 10 17:30:40.645070 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:30:40.645019    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7887549b_2c5c_4a91_b7b0_d4b799704e84.slice/crio-5fadcc0cf80e51d7644fd619cddcfcc3eae70b6e64a2e1b48f8bfcc7743b499e WatchSource:0}: Error finding container 5fadcc0cf80e51d7644fd619cddcfcc3eae70b6e64a2e1b48f8bfcc7743b499e: Status 404 returned error can't find the container with id 5fadcc0cf80e51d7644fd619cddcfcc3eae70b6e64a2e1b48f8bfcc7743b499e
Sep 10 17:30:40.647249 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.647219    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:30:40.647319 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.647284    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:30:40.647319 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:40.647310    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:30:41.480221 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:41.480182    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx" event={"ID":"7887549b-2c5c-4a91-b7b0-d4b799704e84","Type":"ContainerStarted","Data":"6ef058ded20e70f34fd9593dd48c5118aacc634fec07378bd230d8605c8a2f28"}
Sep 10 17:30:41.480667 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:41.480242    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx" event={"ID":"7887549b-2c5c-4a91-b7b0-d4b799704e84","Type":"ContainerStarted","Data":"5fadcc0cf80e51d7644fd619cddcfcc3eae70b6e64a2e1b48f8bfcc7743b499e"}
Sep 10 17:30:41.523318 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:41.523262    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx" podStartSLOduration=1.5232429010000001 podStartE2EDuration="1.523242901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:30:41.523096435 +0000 UTC m=+1126.939147384" watchObservedRunningTime="2026-09-10 17:30:41.523242901 +0000 UTC m=+1126.939293853"
Sep 10 17:30:42.361364 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:42.361324    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:42.366706 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:42.366679    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:42.485630 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:42.485596    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:42.486556 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:42.486533    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:30:43.534550 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:43.534515    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:30:57.614702 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:30:57.614664    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:31:01.582244 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:01.582206    2576 generic.go:356] "Generic (PLEG): container finished" podID="7887549b-2c5c-4a91-b7b0-d4b799704e84" containerID="6ef058ded20e70f34fd9593dd48c5118aacc634fec07378bd230d8605c8a2f28" exitCode=0
Sep 10 17:31:01.582657 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:01.582273    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx" event={"ID":"7887549b-2c5c-4a91-b7b0-d4b799704e84","Type":"ContainerDied","Data":"6ef058ded20e70f34fd9593dd48c5118aacc634fec07378bd230d8605c8a2f28"}
Sep 10 17:31:01.582657 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:01.582649    2576 scope.go:117] "RemoveContainer" containerID="6ef058ded20e70f34fd9593dd48c5118aacc634fec07378bd230d8605c8a2f28"
Sep 10 17:31:01.583706 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:01.583678    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:31:01.583793 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:01.583744    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:31:01.583793 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:01.583777    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:31:02.589558 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:02.589525    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx" event={"ID":"7887549b-2c5c-4a91-b7b0-d4b799704e84","Type":"ContainerStarted","Data":"8dadaf547f3231ab414278d853f343271ebd4b741475c4abb600f72c33cef666"}
Sep 10 17:31:03.361125 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:03.361086    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:31:03.361368 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:03.361344    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 17:31:03.361432 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:03.361396    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx" podUID="7887549b-2c5c-4a91-b7b0-d4b799704e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 17:31:04.361202 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:04.361162    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 17:31:04.361612 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:04.361234    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx" podUID="7887549b-2c5c-4a91-b7b0-d4b799704e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 17:31:05.361355 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:05.361319    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 17:31:05.361751 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:05.361391    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx" podUID="7887549b-2c5c-4a91-b7b0-d4b799704e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 17:31:06.361230 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:06.361192    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 17:31:06.361410 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:06.361260    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx" podUID="7887549b-2c5c-4a91-b7b0-d4b799704e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 17:31:07.361881 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:07.361843    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 10 17:31:07.362330 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:07.361896    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx" podUID="7887549b-2c5c-4a91-b7b0-d4b799704e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 10 17:31:08.481281 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:08.481247    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:31:08.482198 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:08.482174    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:31:08.494781 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:08.494761    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:31:09.339844 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:09.339804    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7638-b30e8a"]
Sep 10 17:31:09.342320 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:09.342302    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-b30e8a"
Sep 10 17:31:09.345182 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:09.345163    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4gkv4\""
Sep 10 17:31:09.352717 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:09.352693    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-b30e8a"]
Sep 10 17:31:09.420543 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:09.420503    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfwp7\" (UniqueName: \"kubernetes.io/projected/cb70eb0f-510b-4fd3-990a-230099850419-kube-api-access-rfwp7\") pod \"test-curl-7638-b30e8a\" (UID: \"cb70eb0f-510b-4fd3-990a-230099850419\") " pod="opendatahub/test-curl-7638-b30e8a"
Sep 10 17:31:09.520965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:09.520921    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfwp7\" (UniqueName: \"kubernetes.io/projected/cb70eb0f-510b-4fd3-990a-230099850419-kube-api-access-rfwp7\") pod \"test-curl-7638-b30e8a\" (UID: \"cb70eb0f-510b-4fd3-990a-230099850419\") " pod="opendatahub/test-curl-7638-b30e8a"
Sep 10 17:31:09.530516 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:09.530482    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfwp7\" (UniqueName: \"kubernetes.io/projected/cb70eb0f-510b-4fd3-990a-230099850419-kube-api-access-rfwp7\") pod \"test-curl-7638-b30e8a\" (UID: \"cb70eb0f-510b-4fd3-990a-230099850419\") " pod="opendatahub/test-curl-7638-b30e8a"
Sep 10 17:31:09.651554 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:09.651524    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-b30e8a"
Sep 10 17:31:09.927286 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:09.927160    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-b30e8a"]
Sep 10 17:31:09.929625 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:31:09.929589    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb70eb0f_510b_4fd3_990a_230099850419.slice/crio-ddd9f8b05ed2496efabd0e67e5c82823a065c94b9686904c2935147cc484e832 WatchSource:0}: Error finding container ddd9f8b05ed2496efabd0e67e5c82823a065c94b9686904c2935147cc484e832: Status 404 returned error can't find the container with id ddd9f8b05ed2496efabd0e67e5c82823a065c94b9686904c2935147cc484e832
Sep 10 17:31:10.638278 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:10.638245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-b30e8a" event={"ID":"cb70eb0f-510b-4fd3-990a-230099850419","Type":"ContainerStarted","Data":"6a97ad59f409d64e892e6f6eb6c017c207b32ccd10b3ff61bd351b9ec9797444"}
Sep 10 17:31:10.638278 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:10.638283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-b30e8a" event={"ID":"cb70eb0f-510b-4fd3-990a-230099850419","Type":"ContainerStarted","Data":"ddd9f8b05ed2496efabd0e67e5c82823a065c94b9686904c2935147cc484e832"}
Sep 10 17:31:10.654285 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:10.654236    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7638-b30e8a" podStartSLOduration=1.6542203290000002 podStartE2EDuration="1.654220329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:31:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:31:10.653443867 +0000 UTC m=+1156.069494815" watchObservedRunningTime="2026-09-10 17:31:10.654220329 +0000 UTC m=+1156.070271277"
Sep 10 17:31:11.277650 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:11.277614    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7638-b30e8a"]
Sep 10 17:31:11.282822 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:11.282783    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7638-b30e8a"]
Sep 10 17:31:11.401092 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:11.401044    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7638-a3ff8a"]
Sep 10 17:31:11.401406 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:11.401393    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb70eb0f-510b-4fd3-990a-230099850419" containerName="test-curl-7638-b30e8a"
Sep 10 17:31:11.401451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:11.401407    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb70eb0f-510b-4fd3-990a-230099850419" containerName="test-curl-7638-b30e8a"
Sep 10 17:31:11.401502 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:11.401493    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb70eb0f-510b-4fd3-990a-230099850419" containerName="test-curl-7638-b30e8a"
Sep 10 17:31:11.403533 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:11.403517    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-a3ff8a"
Sep 10 17:31:11.411250 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:11.411222    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-a3ff8a"]
Sep 10 17:31:11.541481 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:11.541445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6ht6\" (UniqueName: \"kubernetes.io/projected/45374e05-b8f5-42ad-84c6-472fcc73cee7-kube-api-access-b6ht6\") pod \"test-curl-7638-a3ff8a\" (UID: \"45374e05-b8f5-42ad-84c6-472fcc73cee7\") " pod="opendatahub/test-curl-7638-a3ff8a"
Sep 10 17:31:11.641890 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:11.641859    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6ht6\" (UniqueName: \"kubernetes.io/projected/45374e05-b8f5-42ad-84c6-472fcc73cee7-kube-api-access-b6ht6\") pod \"test-curl-7638-a3ff8a\" (UID: \"45374e05-b8f5-42ad-84c6-472fcc73cee7\") " pod="opendatahub/test-curl-7638-a3ff8a"
Sep 10 17:31:11.643989 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:11.643971    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7638-b30e8a" container="test-curl-7638-b30e8a"
Sep 10 17:31:11.651685 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:11.651630    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6ht6\" (UniqueName: \"kubernetes.io/projected/45374e05-b8f5-42ad-84c6-472fcc73cee7-kube-api-access-b6ht6\") pod \"test-curl-7638-a3ff8a\" (UID: \"45374e05-b8f5-42ad-84c6-472fcc73cee7\") " pod="opendatahub/test-curl-7638-a3ff8a"
Sep 10 17:31:11.713707 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:11.713670    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-a3ff8a"
Sep 10 17:31:11.984320 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:11.984228    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-a3ff8a"]
Sep 10 17:31:11.987577 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:31:11.987540    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45374e05_b8f5_42ad_84c6_472fcc73cee7.slice/crio-5dbea06e2a2526676357aeae5dcb843ea4c6e04b3d29cedc1db5793616c4c867 WatchSource:0}: Error finding container 5dbea06e2a2526676357aeae5dcb843ea4c6e04b3d29cedc1db5793616c4c867: Status 404 returned error can't find the container with id 5dbea06e2a2526676357aeae5dcb843ea4c6e04b3d29cedc1db5793616c4c867
Sep 10 17:31:12.650189 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:12.650152    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-a3ff8a" event={"ID":"45374e05-b8f5-42ad-84c6-472fcc73cee7","Type":"ContainerStarted","Data":"a468d4766f446b29b08bf30dc982f2199e7664e806fffd51f5022aa6973bc7d4"}
Sep 10 17:31:12.650600 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:12.650200    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-a3ff8a" event={"ID":"45374e05-b8f5-42ad-84c6-472fcc73cee7","Type":"ContainerStarted","Data":"5dbea06e2a2526676357aeae5dcb843ea4c6e04b3d29cedc1db5793616c4c867"}
Sep 10 17:31:12.650600 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:12.650276    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7638-b30e8a" podUID="cb70eb0f-510b-4fd3-990a-230099850419" containerName="test-curl-7638-b30e8a" containerID="cri-o://6a97ad59f409d64e892e6f6eb6c017c207b32ccd10b3ff61bd351b9ec9797444" gracePeriod=2
Sep 10 17:31:12.654641 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:12.654616    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-b30e8a\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="cb70eb0f-510b-4fd3-990a-230099850419" pod="opendatahub/test-curl-7638-b30e8a"
Sep 10 17:31:12.700371 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:12.700326    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-b30e8a\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="cb70eb0f-510b-4fd3-990a-230099850419" pod="opendatahub/test-curl-7638-b30e8a"
Sep 10 17:31:13.343991 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:13.343919    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7638-a3ff8a" podStartSLOduration=2.343899434 podStartE2EDuration="2.343899434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:31:12.691111772 +0000 UTC m=+1158.107162720" watchObservedRunningTime="2026-09-10 17:31:13.343899434 +0000 UTC m=+1158.759950395"
Sep 10 17:31:13.344616 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:13.344572    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7638-a3ff8a"]
Sep 10 17:31:13.351813 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:13.351788    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7638-a3ff8a"]
Sep 10 17:31:13.471396 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:13.471358    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7638-d2960c"]
Sep 10 17:31:13.471750 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:13.471734    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45374e05-b8f5-42ad-84c6-472fcc73cee7" containerName="test-curl-7638-a3ff8a"
Sep 10 17:31:13.471796 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:13.471752    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="45374e05-b8f5-42ad-84c6-472fcc73cee7" containerName="test-curl-7638-a3ff8a"
Sep 10 17:31:13.471832 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:13.471811    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="45374e05-b8f5-42ad-84c6-472fcc73cee7" containerName="test-curl-7638-a3ff8a"
Sep 10 17:31:13.474184 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:13.474169    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-d2960c"
Sep 10 17:31:13.480763 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:13.480734    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-d2960c"]
Sep 10 17:31:13.557656 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:13.557626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25d24\" (UniqueName: \"kubernetes.io/projected/08038e63-092e-4bab-920e-6ad24654d590-kube-api-access-25d24\") pod \"test-curl-7638-d2960c\" (UID: \"08038e63-092e-4bab-920e-6ad24654d590\") " pod="opendatahub/test-curl-7638-d2960c"
Sep 10 17:31:13.654886 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:13.654859    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7638-a3ff8a" container="test-curl-7638-a3ff8a"
Sep 10 17:31:13.659127 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:13.659093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25d24\" (UniqueName: \"kubernetes.io/projected/08038e63-092e-4bab-920e-6ad24654d590-kube-api-access-25d24\") pod \"test-curl-7638-d2960c\" (UID: \"08038e63-092e-4bab-920e-6ad24654d590\") " pod="opendatahub/test-curl-7638-d2960c"
Sep 10 17:31:13.668229 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:13.668207    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25d24\" (UniqueName: \"kubernetes.io/projected/08038e63-092e-4bab-920e-6ad24654d590-kube-api-access-25d24\") pod \"test-curl-7638-d2960c\" (UID: \"08038e63-092e-4bab-920e-6ad24654d590\") " pod="opendatahub/test-curl-7638-d2960c"
Sep 10 17:31:13.785664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:13.785633    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-d2960c"
Sep 10 17:31:14.059080 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:14.058984    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-d2960c"]
Sep 10 17:31:14.062069 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:31:14.062029    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08038e63_092e_4bab_920e_6ad24654d590.slice/crio-8a40407b4c30af64557b636f8acae791f3d1ce4da1431d8f4ae431f9fbe82427 WatchSource:0}: Error finding container 8a40407b4c30af64557b636f8acae791f3d1ce4da1431d8f4ae431f9fbe82427: Status 404 returned error can't find the container with id 8a40407b4c30af64557b636f8acae791f3d1ce4da1431d8f4ae431f9fbe82427
Sep 10 17:31:14.662104 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:14.662070    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-d2960c" event={"ID":"08038e63-092e-4bab-920e-6ad24654d590","Type":"ContainerStarted","Data":"bb1e9d05e7f48c86720f79f843403f4ff116cafff1f11f370e27d4574e283bab"}
Sep 10 17:31:14.662406 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:14.662119    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-d2960c" event={"ID":"08038e63-092e-4bab-920e-6ad24654d590","Type":"ContainerStarted","Data":"8a40407b4c30af64557b636f8acae791f3d1ce4da1431d8f4ae431f9fbe82427"}
Sep 10 17:31:14.662406 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:14.662229    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7638-a3ff8a" podUID="45374e05-b8f5-42ad-84c6-472fcc73cee7" containerName="test-curl-7638-a3ff8a" containerID="cri-o://a468d4766f446b29b08bf30dc982f2199e7664e806fffd51f5022aa6973bc7d4" gracePeriod=2
Sep 10 17:31:14.678233 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:14.678154    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7638-d2960c" podStartSLOduration=1.678133314 podStartE2EDuration="1.678133314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:31:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:31:14.67787987 +0000 UTC m=+1160.093930819" watchObservedRunningTime="2026-09-10 17:31:14.678133314 +0000 UTC m=+1160.094184264"
Sep 10 17:31:14.679838 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:14.679810    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-a3ff8a\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="45374e05-b8f5-42ad-84c6-472fcc73cee7" pod="opendatahub/test-curl-7638-a3ff8a"
Sep 10 17:31:14.841493 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:14.841471    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-b30e8a"
Sep 10 17:31:14.843393 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:14.843370    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-a3ff8a\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="45374e05-b8f5-42ad-84c6-472fcc73cee7" pod="opendatahub/test-curl-7638-a3ff8a"
Sep 10 17:31:14.972349 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:14.972270    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfwp7\" (UniqueName: \"kubernetes.io/projected/cb70eb0f-510b-4fd3-990a-230099850419-kube-api-access-rfwp7\") pod \"cb70eb0f-510b-4fd3-990a-230099850419\" (UID: \"cb70eb0f-510b-4fd3-990a-230099850419\") "
Sep 10 17:31:14.974208 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:14.974185    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb70eb0f-510b-4fd3-990a-230099850419-kube-api-access-rfwp7" (OuterVolumeSpecName: "kube-api-access-rfwp7") pod "cb70eb0f-510b-4fd3-990a-230099850419" (UID: "cb70eb0f-510b-4fd3-990a-230099850419"). InnerVolumeSpecName "kube-api-access-rfwp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:31:15.072990 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.072950    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfwp7\" (UniqueName: \"kubernetes.io/projected/cb70eb0f-510b-4fd3-990a-230099850419-kube-api-access-rfwp7\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:31:15.084356 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:15.084316    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-a3ff8a\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="45374e05-b8f5-42ad-84c6-472fcc73cee7" pod="opendatahub/test-curl-7638-a3ff8a"
Sep 10 17:31:15.085188 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.085161    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb70eb0f-510b-4fd3-990a-230099850419" path="/var/lib/kubelet/pods/cb70eb0f-510b-4fd3-990a-230099850419/volumes"
Sep 10 17:31:15.341913 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.341826    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7638-d2960c"]
Sep 10 17:31:15.344809 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.344784    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7638-d2960c"]
Sep 10 17:31:15.465354 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.465314    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7638-83a5a2"]
Sep 10 17:31:15.465693 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.465680    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08038e63-092e-4bab-920e-6ad24654d590" containerName="test-curl-7638-d2960c"
Sep 10 17:31:15.465693 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.465694    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="08038e63-092e-4bab-920e-6ad24654d590" containerName="test-curl-7638-d2960c"
Sep 10 17:31:15.465789 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.465748    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="08038e63-092e-4bab-920e-6ad24654d590" containerName="test-curl-7638-d2960c"
Sep 10 17:31:15.467814 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.467798    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-83a5a2"
Sep 10 17:31:15.485419 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.485387    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-83a5a2"]
Sep 10 17:31:15.576925 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.576892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bssbg\" (UniqueName: \"kubernetes.io/projected/66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435-kube-api-access-bssbg\") pod \"test-curl-7638-83a5a2\" (UID: \"66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435\") " pod="opendatahub/test-curl-7638-83a5a2"
Sep 10 17:31:15.668308 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.668272    2576 generic.go:356] "Generic (PLEG): container finished" podID="cb70eb0f-510b-4fd3-990a-230099850419" containerID="6a97ad59f409d64e892e6f6eb6c017c207b32ccd10b3ff61bd351b9ec9797444" exitCode=137
Sep 10 17:31:15.668767 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.668328    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-b30e8a"
Sep 10 17:31:15.668767 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.668378    2576 scope.go:117] "RemoveContainer" containerID="6a97ad59f409d64e892e6f6eb6c017c207b32ccd10b3ff61bd351b9ec9797444"
Sep 10 17:31:15.668767 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:15.668685    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7638-d2960c" container="test-curl-7638-d2960c"
Sep 10 17:31:15.676812 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.676792    2576 scope.go:117] "RemoveContainer" containerID="6a97ad59f409d64e892e6f6eb6c017c207b32ccd10b3ff61bd351b9ec9797444"
Sep 10 17:31:15.677102 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:15.677081    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a97ad59f409d64e892e6f6eb6c017c207b32ccd10b3ff61bd351b9ec9797444\": container with ID starting with 6a97ad59f409d64e892e6f6eb6c017c207b32ccd10b3ff61bd351b9ec9797444 not found: ID does not exist" containerID="6a97ad59f409d64e892e6f6eb6c017c207b32ccd10b3ff61bd351b9ec9797444"
Sep 10 17:31:15.677178 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.677112    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a97ad59f409d64e892e6f6eb6c017c207b32ccd10b3ff61bd351b9ec9797444"} err="failed to get container status \"6a97ad59f409d64e892e6f6eb6c017c207b32ccd10b3ff61bd351b9ec9797444\": rpc error: code = NotFound desc = could not find container \"6a97ad59f409d64e892e6f6eb6c017c207b32ccd10b3ff61bd351b9ec9797444\": container with ID starting with 6a97ad59f409d64e892e6f6eb6c017c207b32ccd10b3ff61bd351b9ec9797444 not found: ID does not exist"
Sep 10 17:31:15.677372 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.677357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bssbg\" (UniqueName: \"kubernetes.io/projected/66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435-kube-api-access-bssbg\") pod \"test-curl-7638-83a5a2\" (UID: \"66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435\") " pod="opendatahub/test-curl-7638-83a5a2"
Sep 10 17:31:15.688686 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.688654    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bssbg\" (UniqueName: \"kubernetes.io/projected/66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435-kube-api-access-bssbg\") pod \"test-curl-7638-83a5a2\" (UID: \"66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435\") " pod="opendatahub/test-curl-7638-83a5a2"
Sep 10 17:31:15.776693 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:15.776660    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-83a5a2"
Sep 10 17:31:16.047027 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:16.047002    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-83a5a2"]
Sep 10 17:31:16.049251 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:31:16.049220    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66a0a8a4_9a0f_4f69_beb8_1f54bb3f2435.slice/crio-b1f85e7a92f6741fd667d4a6f26ea1c93d3ec26ed3ca5f8f75770c6badfa2092 WatchSource:0}: Error finding container b1f85e7a92f6741fd667d4a6f26ea1c93d3ec26ed3ca5f8f75770c6badfa2092: Status 404 returned error can't find the container with id b1f85e7a92f6741fd667d4a6f26ea1c93d3ec26ed3ca5f8f75770c6badfa2092
Sep 10 17:31:16.676364 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:16.676329    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-83a5a2" event={"ID":"66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435","Type":"ContainerStarted","Data":"2f113f5a398f8418a69dc096433f0714ed8afaa9d9898204c1ebbae0c4af6126"}
Sep 10 17:31:16.676652 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:16.676375    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-83a5a2" event={"ID":"66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435","Type":"ContainerStarted","Data":"b1f85e7a92f6741fd667d4a6f26ea1c93d3ec26ed3ca5f8f75770c6badfa2092"}
Sep 10 17:31:16.676652 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:16.676481    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7638-d2960c" podUID="08038e63-092e-4bab-920e-6ad24654d590" containerName="test-curl-7638-d2960c" containerID="cri-o://bb1e9d05e7f48c86720f79f843403f4ff116cafff1f11f370e27d4574e283bab" gracePeriod=2
Sep 10 17:31:16.695273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:16.695221    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7638-83a5a2" podStartSLOduration=1.695202007 podStartE2EDuration="1.695202007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:31:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:31:16.694997441 +0000 UTC m=+1162.111048390" watchObservedRunningTime="2026-09-10 17:31:16.695202007 +0000 UTC m=+1162.111252957"
Sep 10 17:31:16.696890 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:16.696858    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-d2960c\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="08038e63-092e-4bab-920e-6ad24654d590" pod="opendatahub/test-curl-7638-d2960c"
Sep 10 17:31:16.833539 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:16.833516    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-a3ff8a"
Sep 10 17:31:16.835486 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:16.835456    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-d2960c\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="08038e63-092e-4bab-920e-6ad24654d590" pod="opendatahub/test-curl-7638-d2960c"
Sep 10 17:31:16.989160 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:16.989029    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6ht6\" (UniqueName: \"kubernetes.io/projected/45374e05-b8f5-42ad-84c6-472fcc73cee7-kube-api-access-b6ht6\") pod \"45374e05-b8f5-42ad-84c6-472fcc73cee7\" (UID: \"45374e05-b8f5-42ad-84c6-472fcc73cee7\") "
Sep 10 17:31:16.991221 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:16.991186    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45374e05-b8f5-42ad-84c6-472fcc73cee7-kube-api-access-b6ht6" (OuterVolumeSpecName: "kube-api-access-b6ht6") pod "45374e05-b8f5-42ad-84c6-472fcc73cee7" (UID: "45374e05-b8f5-42ad-84c6-472fcc73cee7"). InnerVolumeSpecName "kube-api-access-b6ht6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:31:17.086001 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:17.085964    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45374e05-b8f5-42ad-84c6-472fcc73cee7" path="/var/lib/kubelet/pods/45374e05-b8f5-42ad-84c6-472fcc73cee7/volumes"
Sep 10 17:31:17.089918 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:17.089884    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6ht6\" (UniqueName: \"kubernetes.io/projected/45374e05-b8f5-42ad-84c6-472fcc73cee7-kube-api-access-b6ht6\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:31:17.122274 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:17.122246    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:31:17.400043 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:17.400003    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7638-83a5a2"]
Sep 10 17:31:17.406265 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:17.406237    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7638-83a5a2"]
Sep 10 17:31:17.683370 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:17.683271    2576 generic.go:356] "Generic (PLEG): container finished" podID="45374e05-b8f5-42ad-84c6-472fcc73cee7" containerID="a468d4766f446b29b08bf30dc982f2199e7664e806fffd51f5022aa6973bc7d4" exitCode=137
Sep 10 17:31:17.683370 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:17.683311    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-a3ff8a"
Sep 10 17:31:17.683837 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:17.683379    2576 scope.go:117] "RemoveContainer" containerID="a468d4766f446b29b08bf30dc982f2199e7664e806fffd51f5022aa6973bc7d4"
Sep 10 17:31:17.683837 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:17.683636    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7638-83a5a2" container="test-curl-7638-83a5a2"
Sep 10 17:31:17.691611 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:17.691592    2576 scope.go:117] "RemoveContainer" containerID="a468d4766f446b29b08bf30dc982f2199e7664e806fffd51f5022aa6973bc7d4"
Sep 10 17:31:17.691886 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:17.691861    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a468d4766f446b29b08bf30dc982f2199e7664e806fffd51f5022aa6973bc7d4\": container with ID starting with a468d4766f446b29b08bf30dc982f2199e7664e806fffd51f5022aa6973bc7d4 not found: ID does not exist" containerID="a468d4766f446b29b08bf30dc982f2199e7664e806fffd51f5022aa6973bc7d4"
Sep 10 17:31:17.691962 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:17.691894    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a468d4766f446b29b08bf30dc982f2199e7664e806fffd51f5022aa6973bc7d4"} err="failed to get container status \"a468d4766f446b29b08bf30dc982f2199e7664e806fffd51f5022aa6973bc7d4\": rpc error: code = NotFound desc = could not find container \"a468d4766f446b29b08bf30dc982f2199e7664e806fffd51f5022aa6973bc7d4\": container with ID starting with a468d4766f446b29b08bf30dc982f2199e7664e806fffd51f5022aa6973bc7d4 not found: ID does not exist"
Sep 10 17:31:18.495968 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.495939    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"]
Sep 10 17:31:18.496355 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.496339    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435" containerName="test-curl-7638-83a5a2"
Sep 10 17:31:18.496456 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.496358    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435" containerName="test-curl-7638-83a5a2"
Sep 10 17:31:18.496516 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.496474    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435" containerName="test-curl-7638-83a5a2"
Sep 10 17:31:18.499555 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.499532    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.502268 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.502248    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9d28f397-openshift-default-dockercfg-nf5ls\""
Sep 10 17:31:18.514711 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.514685    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"]
Sep 10 17:31:18.605178 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.605144    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-data\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.605343 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.605197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgnkn\" (UniqueName: \"kubernetes.io/projected/0ac77ec1-5015-4237-968d-43ca2379c6da-kube-api-access-zgnkn\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.605343 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.605299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-podinfo\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.605464 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.605358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-workload-certs\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.605464 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.605400    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-credential-socket\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.605464 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.605418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ac77ec1-5015-4237-968d-43ca2379c6da-istiod-ca-cert\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.605464 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.605435    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-workload-socket\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.605657 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.605513    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-envoy\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.605657 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.605547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-token\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.690520 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.690490    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7638-83a5a2" podUID="66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435" containerName="test-curl-7638-83a5a2" containerID="cri-o://2f113f5a398f8418a69dc096433f0714ed8afaa9d9898204c1ebbae0c4af6126" gracePeriod=2
Sep 10 17:31:18.692940 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:18.692912    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-83a5a2\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435" pod="opendatahub/test-curl-7638-83a5a2"
Sep 10 17:31:18.706309 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.706279    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-workload-certs\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.706427 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.706318    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-credential-socket\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.706477 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.706436    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ac77ec1-5015-4237-968d-43ca2379c6da-istiod-ca-cert\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.706477 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.706473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-workload-socket\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.706585 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.706507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-envoy\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.706585 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.706522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-token\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.706585 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.706552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-data\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.706745 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.706596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgnkn\" (UniqueName: \"kubernetes.io/projected/0ac77ec1-5015-4237-968d-43ca2379c6da-kube-api-access-zgnkn\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.706745 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.706662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-podinfo\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.706745 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.706726    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-credential-socket\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.706894 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.706742    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-workload-certs\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.706894 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.706831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-workload-socket\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.707032 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.707007    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-data\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.707255 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.707233    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ac77ec1-5015-4237-968d-43ca2379c6da-istiod-ca-cert\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.709027 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.709010    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-envoy\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.709135 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.709070    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-podinfo\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.715367 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.715344    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-token\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.715583 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.715567    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgnkn\" (UniqueName: \"kubernetes.io/projected/0ac77ec1-5015-4237-968d-43ca2379c6da-kube-api-access-zgnkn\") pod \"e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") " pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.810564 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.810531    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:18.871269 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:18.870677    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-d2960c"
Sep 10 17:31:18.874085 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:18.874026    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-83a5a2\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435" pod="opendatahub/test-curl-7638-83a5a2"
Sep 10 17:31:19.008809 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.008779    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25d24\" (UniqueName: \"kubernetes.io/projected/08038e63-092e-4bab-920e-6ad24654d590-kube-api-access-25d24\") pod \"08038e63-092e-4bab-920e-6ad24654d590\" (UID: \"08038e63-092e-4bab-920e-6ad24654d590\") "
Sep 10 17:31:19.010903 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.010871    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08038e63-092e-4bab-920e-6ad24654d590-kube-api-access-25d24" (OuterVolumeSpecName: "kube-api-access-25d24") pod "08038e63-092e-4bab-920e-6ad24654d590" (UID: "08038e63-092e-4bab-920e-6ad24654d590"). InnerVolumeSpecName "kube-api-access-25d24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:31:19.084668 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.084593    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08038e63-092e-4bab-920e-6ad24654d590" path="/var/lib/kubelet/pods/08038e63-092e-4bab-920e-6ad24654d590/volumes"
Sep 10 17:31:19.098798 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.098772    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"]
Sep 10 17:31:19.100393 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:31:19.100370    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac77ec1_5015_4237_968d_43ca2379c6da.slice/crio-0a2789b96fad6179cd9eae4357d46ee44e419a35aa704dfab4d0331f44274138 WatchSource:0}: Error finding container 0a2789b96fad6179cd9eae4357d46ee44e419a35aa704dfab4d0331f44274138: Status 404 returned error can't find the container with id 0a2789b96fad6179cd9eae4357d46ee44e419a35aa704dfab4d0331f44274138
Sep 10 17:31:19.102668 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.102637    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:31:19.102746 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.102699    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:31:19.102746 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.102726    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:31:19.109630 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.109609    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25d24\" (UniqueName: \"kubernetes.io/projected/08038e63-092e-4bab-920e-6ad24654d590-kube-api-access-25d24\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:31:19.697780 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.697738    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr" event={"ID":"0ac77ec1-5015-4237-968d-43ca2379c6da","Type":"ContainerStarted","Data":"7b6c7bf6a526d2358ed12224854f84eba5760fb1d6ffbcb96593c3127aef0dfd"}
Sep 10 17:31:19.698220 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.697840    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr" event={"ID":"0ac77ec1-5015-4237-968d-43ca2379c6da","Type":"ContainerStarted","Data":"0a2789b96fad6179cd9eae4357d46ee44e419a35aa704dfab4d0331f44274138"}
Sep 10 17:31:19.699101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.699077    2576 generic.go:356] "Generic (PLEG): container finished" podID="08038e63-092e-4bab-920e-6ad24654d590" containerID="bb1e9d05e7f48c86720f79f843403f4ff116cafff1f11f370e27d4574e283bab" exitCode=137
Sep 10 17:31:19.699181 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.699106    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-d2960c"
Sep 10 17:31:19.699181 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.699156    2576 scope.go:117] "RemoveContainer" containerID="bb1e9d05e7f48c86720f79f843403f4ff116cafff1f11f370e27d4574e283bab"
Sep 10 17:31:19.707577 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.707559    2576 scope.go:117] "RemoveContainer" containerID="bb1e9d05e7f48c86720f79f843403f4ff116cafff1f11f370e27d4574e283bab"
Sep 10 17:31:19.707876 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:19.707856    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb1e9d05e7f48c86720f79f843403f4ff116cafff1f11f370e27d4574e283bab\": container with ID starting with bb1e9d05e7f48c86720f79f843403f4ff116cafff1f11f370e27d4574e283bab not found: ID does not exist" containerID="bb1e9d05e7f48c86720f79f843403f4ff116cafff1f11f370e27d4574e283bab"
Sep 10 17:31:19.707968 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.707885    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb1e9d05e7f48c86720f79f843403f4ff116cafff1f11f370e27d4574e283bab"} err="failed to get container status \"bb1e9d05e7f48c86720f79f843403f4ff116cafff1f11f370e27d4574e283bab\": rpc error: code = NotFound desc = could not find container \"bb1e9d05e7f48c86720f79f843403f4ff116cafff1f11f370e27d4574e283bab\": container with ID starting with bb1e9d05e7f48c86720f79f843403f4ff116cafff1f11f370e27d4574e283bab not found: ID does not exist"
Sep 10 17:31:19.721482 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.721432    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr" podStartSLOduration=1.7214143929999999 podStartE2EDuration="1.721414393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:31:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:31:19.720664489 +0000 UTC m=+1165.136715459" watchObservedRunningTime="2026-09-10 17:31:19.721414393 +0000 UTC m=+1165.137465341"
Sep 10 17:31:19.810981 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:19.810943    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:20.816951 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:20.816920    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:20.870615 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:20.870580    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-83a5a2"
Sep 10 17:31:21.026806 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:21.026720    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bssbg\" (UniqueName: \"kubernetes.io/projected/66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435-kube-api-access-bssbg\") pod \"66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435\" (UID: \"66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435\") "
Sep 10 17:31:21.028796 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:21.028774    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435-kube-api-access-bssbg" (OuterVolumeSpecName: "kube-api-access-bssbg") pod "66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435" (UID: "66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435"). InnerVolumeSpecName "kube-api-access-bssbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:31:21.086005 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:21.085973    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435" path="/var/lib/kubelet/pods/66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435/volumes"
Sep 10 17:31:21.127895 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:21.127868    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bssbg\" (UniqueName: \"kubernetes.io/projected/66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435-kube-api-access-bssbg\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:31:21.712345 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:21.712313    2576 generic.go:356] "Generic (PLEG): container finished" podID="66a0a8a4-9a0f-4f69-beb8-1f54bb3f2435" containerID="2f113f5a398f8418a69dc096433f0714ed8afaa9d9898204c1ebbae0c4af6126" exitCode=137
Sep 10 17:31:21.712547 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:21.712357    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-83a5a2"
Sep 10 17:31:21.712547 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:21.712414    2576 scope.go:117] "RemoveContainer" containerID="2f113f5a398f8418a69dc096433f0714ed8afaa9d9898204c1ebbae0c4af6126"
Sep 10 17:31:21.712708 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:21.712692    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:21.713796 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:21.713777    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:21.721047 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:21.721027    2576 scope.go:117] "RemoveContainer" containerID="2f113f5a398f8418a69dc096433f0714ed8afaa9d9898204c1ebbae0c4af6126"
Sep 10 17:31:21.721357 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:31:21.721333    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f113f5a398f8418a69dc096433f0714ed8afaa9d9898204c1ebbae0c4af6126\": container with ID starting with 2f113f5a398f8418a69dc096433f0714ed8afaa9d9898204c1ebbae0c4af6126 not found: ID does not exist" containerID="2f113f5a398f8418a69dc096433f0714ed8afaa9d9898204c1ebbae0c4af6126"
Sep 10 17:31:21.721445 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:21.721365    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f113f5a398f8418a69dc096433f0714ed8afaa9d9898204c1ebbae0c4af6126"} err="failed to get container status \"2f113f5a398f8418a69dc096433f0714ed8afaa9d9898204c1ebbae0c4af6126\": rpc error: code = NotFound desc = could not find container \"2f113f5a398f8418a69dc096433f0714ed8afaa9d9898204c1ebbae0c4af6126\": container with ID starting with 2f113f5a398f8418a69dc096433f0714ed8afaa9d9898204c1ebbae0c4af6126 not found: ID does not exist"
Sep 10 17:31:23.555799 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.555765    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"]
Sep 10 17:31:23.559331 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.559311    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"
Sep 10 17:31:23.562069 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.562033    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-9d28f397\""
Sep 10 17:31:23.572474 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.572452    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"]
Sep 10 17:31:23.637683 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.637646    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"]
Sep 10 17:31:23.640218 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.640196    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"
Sep 10 17:31:23.645017 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.644998    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-9d28f397-dockercfg-gzg6f\""
Sep 10 17:31:23.649853 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.649830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75rqr\" (UniqueName: \"kubernetes.io/projected/5f8e153d-4021-46c4-978a-34260abb8d24-kube-api-access-75rqr\") pod \"payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l\" (UID: \"5f8e153d-4021-46c4-978a-34260abb8d24\") " pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"
Sep 10 17:31:23.649993 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.649971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f8e153d-4021-46c4-978a-34260abb8d24-plugins-config-volume\") pod \"payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l\" (UID: \"5f8e153d-4021-46c4-978a-34260abb8d24\") " pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"
Sep 10 17:31:23.660690 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.660662    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"]
Sep 10 17:31:23.750974 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.750930    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwf7r\" (UniqueName: \"kubernetes.io/projected/f9e8bf9a-15a5-45db-ac36-d6b292db8737-kube-api-access-vwf7r\") pod \"payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7\" (UID: \"f9e8bf9a-15a5-45db-ac36-d6b292db8737\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"
Sep 10 17:31:23.751248 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.751016    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9e8bf9a-15a5-45db-ac36-d6b292db8737-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7\" (UID: \"f9e8bf9a-15a5-45db-ac36-d6b292db8737\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"
Sep 10 17:31:23.751248 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.751108    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f8e153d-4021-46c4-978a-34260abb8d24-plugins-config-volume\") pod \"payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l\" (UID: \"5f8e153d-4021-46c4-978a-34260abb8d24\") " pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"
Sep 10 17:31:23.751248 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.751205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75rqr\" (UniqueName: \"kubernetes.io/projected/5f8e153d-4021-46c4-978a-34260abb8d24-kube-api-access-75rqr\") pod \"payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l\" (UID: \"5f8e153d-4021-46c4-978a-34260abb8d24\") " pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"
Sep 10 17:31:23.751992 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.751967    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f8e153d-4021-46c4-978a-34260abb8d24-plugins-config-volume\") pod \"payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l\" (UID: \"5f8e153d-4021-46c4-978a-34260abb8d24\") " pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"
Sep 10 17:31:23.759771 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.759743    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75rqr\" (UniqueName: \"kubernetes.io/projected/5f8e153d-4021-46c4-978a-34260abb8d24-kube-api-access-75rqr\") pod \"payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l\" (UID: \"5f8e153d-4021-46c4-978a-34260abb8d24\") " pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"
Sep 10 17:31:23.852316 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.852229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwf7r\" (UniqueName: \"kubernetes.io/projected/f9e8bf9a-15a5-45db-ac36-d6b292db8737-kube-api-access-vwf7r\") pod \"payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7\" (UID: \"f9e8bf9a-15a5-45db-ac36-d6b292db8737\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"
Sep 10 17:31:23.852316 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.852296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9e8bf9a-15a5-45db-ac36-d6b292db8737-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7\" (UID: \"f9e8bf9a-15a5-45db-ac36-d6b292db8737\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"
Sep 10 17:31:23.853135 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.853107    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9e8bf9a-15a5-45db-ac36-d6b292db8737-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7\" (UID: \"f9e8bf9a-15a5-45db-ac36-d6b292db8737\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"
Sep 10 17:31:23.861748 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.861724    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwf7r\" (UniqueName: \"kubernetes.io/projected/f9e8bf9a-15a5-45db-ac36-d6b292db8737-kube-api-access-vwf7r\") pod \"payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7\" (UID: \"f9e8bf9a-15a5-45db-ac36-d6b292db8737\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"
Sep 10 17:31:23.869515 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.869496    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"
Sep 10 17:31:23.950598 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:23.950513    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"
Sep 10 17:31:24.143241 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:24.143205    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"]
Sep 10 17:31:24.146232 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:31:24.146209    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8e153d_4021_46c4_978a_34260abb8d24.slice/crio-d49f48883d5629c9a58dfd48a8c74910beb169a690525d6c322e52c5d8e15434 WatchSource:0}: Error finding container d49f48883d5629c9a58dfd48a8c74910beb169a690525d6c322e52c5d8e15434: Status 404 returned error can't find the container with id d49f48883d5629c9a58dfd48a8c74910beb169a690525d6c322e52c5d8e15434
Sep 10 17:31:24.231470 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:24.231344    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"]
Sep 10 17:31:24.233593 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:31:24.233561    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e8bf9a_15a5_45db_ac36_d6b292db8737.slice/crio-61b305bc4f9cdbee965d1f9c311bfdbedbf3d619058303f3c3226f676386380e WatchSource:0}: Error finding container 61b305bc4f9cdbee965d1f9c311bfdbedbf3d619058303f3c3226f676386380e: Status 404 returned error can't find the container with id 61b305bc4f9cdbee965d1f9c311bfdbedbf3d619058303f3c3226f676386380e
Sep 10 17:31:24.731458 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:24.731416    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l" event={"ID":"5f8e153d-4021-46c4-978a-34260abb8d24","Type":"ContainerStarted","Data":"e765760554d63d4b062c0091e791c8e9a08aa8fe410b462904af7d9b04a5b47b"}
Sep 10 17:31:24.731935 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:24.731488    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"
Sep 10 17:31:24.731935 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:24.731512    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l" event={"ID":"5f8e153d-4021-46c4-978a-34260abb8d24","Type":"ContainerStarted","Data":"d49f48883d5629c9a58dfd48a8c74910beb169a690525d6c322e52c5d8e15434"}
Sep 10 17:31:24.733036 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:24.733013    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7" event={"ID":"f9e8bf9a-15a5-45db-ac36-d6b292db8737","Type":"ContainerStarted","Data":"952d61f9f0f54bee774d4606f0e90408cba80bbb638bd9937ef9c70b2c15f3de"}
Sep 10 17:31:24.733152 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:24.733077    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7" event={"ID":"f9e8bf9a-15a5-45db-ac36-d6b292db8737","Type":"ContainerStarted","Data":"61b305bc4f9cdbee965d1f9c311bfdbedbf3d619058303f3c3226f676386380e"}
Sep 10 17:31:24.733152 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:24.733101    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"
Sep 10 17:31:24.752229 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:24.752183    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l" podStartSLOduration=1.7521651230000002 podStartE2EDuration="1.752165123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:31:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:31:24.750007453 +0000 UTC m=+1170.166058415" watchObservedRunningTime="2026-09-10 17:31:24.752165123 +0000 UTC m=+1170.168216072"
Sep 10 17:31:24.773344 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:24.773294    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7" podStartSLOduration=1.773277942 podStartE2EDuration="1.773277942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:31:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:31:24.771090525 +0000 UTC m=+1170.187141475" watchObservedRunningTime="2026-09-10 17:31:24.773277942 +0000 UTC m=+1170.189328890"
Sep 10 17:31:35.741150 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:35.741113    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"
Sep 10 17:31:35.741543 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:35.741197    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"
Sep 10 17:31:37.213851 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:37.213815    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:31:52.510783 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:52.510735    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:31:52.754222 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:52.754180    2576 patch_prober.go:28] interesting pod/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 17:31:52.754427 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:52.754249    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr" podUID="0ac77ec1-5015-4237-968d-43ca2379c6da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 17:31:53.895858 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:53.895824    2576 generic.go:356] "Generic (PLEG): container finished" podID="0ac77ec1-5015-4237-968d-43ca2379c6da" containerID="7b6c7bf6a526d2358ed12224854f84eba5760fb1d6ffbcb96593c3127aef0dfd" exitCode=0
Sep 10 17:31:53.896392 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:53.895892    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr" event={"ID":"0ac77ec1-5015-4237-968d-43ca2379c6da","Type":"ContainerDied","Data":"7b6c7bf6a526d2358ed12224854f84eba5760fb1d6ffbcb96593c3127aef0dfd"}
Sep 10 17:31:53.896392 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:53.896320    2576 scope.go:117] "RemoveContainer" containerID="7b6c7bf6a526d2358ed12224854f84eba5760fb1d6ffbcb96593c3127aef0dfd"
Sep 10 17:31:53.897389 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:53.897359    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:31:53.897485 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:53.897424    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:31:53.897485 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:53.897475    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:31:54.907287 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:54.907251    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr" event={"ID":"0ac77ec1-5015-4237-968d-43ca2379c6da","Type":"ContainerStarted","Data":"319d1354a1edb53f36c6ca5098a6bd45f9bab17df56fb0b48a3968d175fd55b5"}
Sep 10 17:31:55.155276 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:55.155243    2576 scope.go:117] "RemoveContainer" containerID="55d2c8b14668936b2f51754ecda08c24e7863d053e57055a6f07361187113488"
Sep 10 17:31:55.163610 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:55.163584    2576 scope.go:117] "RemoveContainer" containerID="6b8e45b00e7caf6c56e36e62ab628f4ef4b079f2bf24b8b550c5e6d64fe8f6b4"
Sep 10 17:31:55.811732 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:55.811695    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:31:55.811943 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:55.811924    2576 patch_prober.go:28] interesting pod/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 10 17:31:55.811997 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:55.811971    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr" podUID="0ac77ec1-5015-4237-968d-43ca2379c6da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 10 17:31:56.811434 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:56.811391    2576 patch_prober.go:28] interesting pod/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 10 17:31:56.811826 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:56.811466    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr" podUID="0ac77ec1-5015-4237-968d-43ca2379c6da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 10 17:31:57.811375 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:57.811330    2576 patch_prober.go:28] interesting pod/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 10 17:31:57.811563 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:57.811403    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr" podUID="0ac77ec1-5015-4237-968d-43ca2379c6da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 10 17:31:58.811964 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:58.811917    2576 patch_prober.go:28] interesting pod/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 10 17:31:58.812486 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:58.811983    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr" podUID="0ac77ec1-5015-4237-968d-43ca2379c6da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 10 17:31:59.812003 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:59.811960    2576 patch_prober.go:28] interesting pod/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 10 17:31:59.812432 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:31:59.812071    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr" podUID="0ac77ec1-5015-4237-968d-43ca2379c6da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 10 17:32:00.815910 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:00.815874    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:32:00.816360 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:00.816169    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:32:00.816790 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:00.816771    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:32:11.321527 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:11.321478    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:32:29.320149 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:29.320114    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:32:46.316232 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:46.316199    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:32:52.173099 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.173005    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"]
Sep 10 17:32:52.173625 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.173282    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l" podUID="5f8e153d-4021-46c4-978a-34260abb8d24" containerName="payload-processing" containerID="cri-o://e765760554d63d4b062c0091e791c8e9a08aa8fe410b462904af7d9b04a5b47b" gracePeriod=30
Sep 10 17:32:52.183973 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.183945    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"]
Sep 10 17:32:52.184243 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.184204    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7" podUID="f9e8bf9a-15a5-45db-ac36-d6b292db8737" containerName="payload-pre-processing" containerID="cri-o://952d61f9f0f54bee774d4606f0e90408cba80bbb638bd9937ef9c70b2c15f3de" gracePeriod=30
Sep 10 17:32:52.453475 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.453448    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"
Sep 10 17:32:52.494217 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.494185    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"
Sep 10 17:32:52.587987 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.587951    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f8e153d-4021-46c4-978a-34260abb8d24-plugins-config-volume\") pod \"5f8e153d-4021-46c4-978a-34260abb8d24\" (UID: \"5f8e153d-4021-46c4-978a-34260abb8d24\") "
Sep 10 17:32:52.588181 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.588006    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9e8bf9a-15a5-45db-ac36-d6b292db8737-plugins-config-volume\") pod \"f9e8bf9a-15a5-45db-ac36-d6b292db8737\" (UID: \"f9e8bf9a-15a5-45db-ac36-d6b292db8737\") "
Sep 10 17:32:52.588181 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.588028    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75rqr\" (UniqueName: \"kubernetes.io/projected/5f8e153d-4021-46c4-978a-34260abb8d24-kube-api-access-75rqr\") pod \"5f8e153d-4021-46c4-978a-34260abb8d24\" (UID: \"5f8e153d-4021-46c4-978a-34260abb8d24\") "
Sep 10 17:32:52.588181 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.588137    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwf7r\" (UniqueName: \"kubernetes.io/projected/f9e8bf9a-15a5-45db-ac36-d6b292db8737-kube-api-access-vwf7r\") pod \"f9e8bf9a-15a5-45db-ac36-d6b292db8737\" (UID: \"f9e8bf9a-15a5-45db-ac36-d6b292db8737\") "
Sep 10 17:32:52.588375 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.588342    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e8bf9a-15a5-45db-ac36-d6b292db8737-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f9e8bf9a-15a5-45db-ac36-d6b292db8737" (UID: "f9e8bf9a-15a5-45db-ac36-d6b292db8737"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:32:52.588507 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.588416    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f8e153d-4021-46c4-978a-34260abb8d24-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5f8e153d-4021-46c4-978a-34260abb8d24" (UID: "5f8e153d-4021-46c4-978a-34260abb8d24"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:32:52.588560 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.588512    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9e8bf9a-15a5-45db-ac36-d6b292db8737-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:32:52.588560 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.588527    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f8e153d-4021-46c4-978a-34260abb8d24-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:32:52.590179 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.590158    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e8bf9a-15a5-45db-ac36-d6b292db8737-kube-api-access-vwf7r" (OuterVolumeSpecName: "kube-api-access-vwf7r") pod "f9e8bf9a-15a5-45db-ac36-d6b292db8737" (UID: "f9e8bf9a-15a5-45db-ac36-d6b292db8737"). InnerVolumeSpecName "kube-api-access-vwf7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:32:52.590244 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.590204    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f8e153d-4021-46c4-978a-34260abb8d24-kube-api-access-75rqr" (OuterVolumeSpecName: "kube-api-access-75rqr") pod "5f8e153d-4021-46c4-978a-34260abb8d24" (UID: "5f8e153d-4021-46c4-978a-34260abb8d24"). InnerVolumeSpecName "kube-api-access-75rqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:32:52.689943 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.689851    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwf7r\" (UniqueName: \"kubernetes.io/projected/f9e8bf9a-15a5-45db-ac36-d6b292db8737-kube-api-access-vwf7r\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:32:52.689943 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:52.689885    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75rqr\" (UniqueName: \"kubernetes.io/projected/5f8e153d-4021-46c4-978a-34260abb8d24-kube-api-access-75rqr\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:32:53.216127 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.216094    2576 generic.go:356] "Generic (PLEG): container finished" podID="5f8e153d-4021-46c4-978a-34260abb8d24" containerID="e765760554d63d4b062c0091e791c8e9a08aa8fe410b462904af7d9b04a5b47b" exitCode=0
Sep 10 17:32:53.216557 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.216143    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"
Sep 10 17:32:53.216557 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.216181    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l" event={"ID":"5f8e153d-4021-46c4-978a-34260abb8d24","Type":"ContainerDied","Data":"e765760554d63d4b062c0091e791c8e9a08aa8fe410b462904af7d9b04a5b47b"}
Sep 10 17:32:53.216557 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.216232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l" event={"ID":"5f8e153d-4021-46c4-978a-34260abb8d24","Type":"ContainerDied","Data":"d49f48883d5629c9a58dfd48a8c74910beb169a690525d6c322e52c5d8e15434"}
Sep 10 17:32:53.216557 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.216261    2576 scope.go:117] "RemoveContainer" containerID="e765760554d63d4b062c0091e791c8e9a08aa8fe410b462904af7d9b04a5b47b"
Sep 10 17:32:53.217790 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.217769    2576 generic.go:356] "Generic (PLEG): container finished" podID="f9e8bf9a-15a5-45db-ac36-d6b292db8737" containerID="952d61f9f0f54bee774d4606f0e90408cba80bbb638bd9937ef9c70b2c15f3de" exitCode=0
Sep 10 17:32:53.217856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.217820    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7" event={"ID":"f9e8bf9a-15a5-45db-ac36-d6b292db8737","Type":"ContainerDied","Data":"952d61f9f0f54bee774d4606f0e90408cba80bbb638bd9937ef9c70b2c15f3de"}
Sep 10 17:32:53.217856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.217814    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"
Sep 10 17:32:53.217950 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.217856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7" event={"ID":"f9e8bf9a-15a5-45db-ac36-d6b292db8737","Type":"ContainerDied","Data":"61b305bc4f9cdbee965d1f9c311bfdbedbf3d619058303f3c3226f676386380e"}
Sep 10 17:32:53.225490 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.225471    2576 scope.go:117] "RemoveContainer" containerID="e765760554d63d4b062c0091e791c8e9a08aa8fe410b462904af7d9b04a5b47b"
Sep 10 17:32:53.225795 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:32:53.225776    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e765760554d63d4b062c0091e791c8e9a08aa8fe410b462904af7d9b04a5b47b\": container with ID starting with e765760554d63d4b062c0091e791c8e9a08aa8fe410b462904af7d9b04a5b47b not found: ID does not exist" containerID="e765760554d63d4b062c0091e791c8e9a08aa8fe410b462904af7d9b04a5b47b"
Sep 10 17:32:53.225848 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.225804    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e765760554d63d4b062c0091e791c8e9a08aa8fe410b462904af7d9b04a5b47b"} err="failed to get container status \"e765760554d63d4b062c0091e791c8e9a08aa8fe410b462904af7d9b04a5b47b\": rpc error: code = NotFound desc = could not find container \"e765760554d63d4b062c0091e791c8e9a08aa8fe410b462904af7d9b04a5b47b\": container with ID starting with e765760554d63d4b062c0091e791c8e9a08aa8fe410b462904af7d9b04a5b47b not found: ID does not exist"
Sep 10 17:32:53.225848 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.225820    2576 scope.go:117] "RemoveContainer" containerID="952d61f9f0f54bee774d4606f0e90408cba80bbb638bd9937ef9c70b2c15f3de"
Sep 10 17:32:53.233733 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.233715    2576 scope.go:117] "RemoveContainer" containerID="952d61f9f0f54bee774d4606f0e90408cba80bbb638bd9937ef9c70b2c15f3de"
Sep 10 17:32:53.233998 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:32:53.233980    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"952d61f9f0f54bee774d4606f0e90408cba80bbb638bd9937ef9c70b2c15f3de\": container with ID starting with 952d61f9f0f54bee774d4606f0e90408cba80bbb638bd9937ef9c70b2c15f3de not found: ID does not exist" containerID="952d61f9f0f54bee774d4606f0e90408cba80bbb638bd9937ef9c70b2c15f3de"
Sep 10 17:32:53.234078 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.234005    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"952d61f9f0f54bee774d4606f0e90408cba80bbb638bd9937ef9c70b2c15f3de"} err="failed to get container status \"952d61f9f0f54bee774d4606f0e90408cba80bbb638bd9937ef9c70b2c15f3de\": rpc error: code = NotFound desc = could not find container \"952d61f9f0f54bee774d4606f0e90408cba80bbb638bd9937ef9c70b2c15f3de\": container with ID starting with 952d61f9f0f54bee774d4606f0e90408cba80bbb638bd9937ef9c70b2c15f3de not found: ID does not exist"
Sep 10 17:32:53.240152 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.240125    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"]
Sep 10 17:32:53.247792 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.247769    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9d28f397-7f458c6f66-6q6b7"]
Sep 10 17:32:53.258531 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.258510    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"]
Sep 10 17:32:53.263627 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:53.263607    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9d28f397-6cd4b74585-l4b9l"]
Sep 10 17:32:55.084211 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:55.084179    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f8e153d-4021-46c4-978a-34260abb8d24" path="/var/lib/kubelet/pods/5f8e153d-4021-46c4-978a-34260abb8d24/volumes"
Sep 10 17:32:55.084570 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:55.084540    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9e8bf9a-15a5-45db-ac36-d6b292db8737" path="/var/lib/kubelet/pods/f9e8bf9a-15a5-45db-ac36-d6b292db8737/volumes"
Sep 10 17:32:55.224423 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:55.224389    2576 scope.go:117] "RemoveContainer" containerID="7fbb4c7f9e5fd62302a2f35c7c56b09516d8b23be05bcf13cc692d177812888c"
Sep 10 17:32:55.233183 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:32:55.233160    2576 scope.go:117] "RemoveContainer" containerID="3eef8977dbc6d076886d064f00a7ec838b325bc0209b494a8c15892a2a8add02"
Sep 10 17:33:08.302011 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:08.301976    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:33:24.710357 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:24.710317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:33:33.209331 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:33.209294    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7641-938823"]
Sep 10 17:33:33.209724 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:33.209675    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e8bf9a-15a5-45db-ac36-d6b292db8737" containerName="payload-pre-processing"
Sep 10 17:33:33.209724 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:33.209687    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e8bf9a-15a5-45db-ac36-d6b292db8737" containerName="payload-pre-processing"
Sep 10 17:33:33.209724 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:33.209700    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f8e153d-4021-46c4-978a-34260abb8d24" containerName="payload-processing"
Sep 10 17:33:33.209724 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:33.209705    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f8e153d-4021-46c4-978a-34260abb8d24" containerName="payload-processing"
Sep 10 17:33:33.209856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:33.209767    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f8e153d-4021-46c4-978a-34260abb8d24" containerName="payload-processing"
Sep 10 17:33:33.209856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:33.209777    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e8bf9a-15a5-45db-ac36-d6b292db8737" containerName="payload-pre-processing"
Sep 10 17:33:33.217037 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:33.217004    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7641-938823"
Sep 10 17:33:33.221846 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:33.221821    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7641-938823"]
Sep 10 17:33:33.224278 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:33.224257    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4gkv4\""
Sep 10 17:33:33.354640 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:33.354605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8688\" (UniqueName: \"kubernetes.io/projected/561d2ea3-168e-4663-9889-bed6aa6d5638-kube-api-access-j8688\") pod \"test-curl-7641-938823\" (UID: \"561d2ea3-168e-4663-9889-bed6aa6d5638\") " pod="opendatahub/test-curl-7641-938823"
Sep 10 17:33:33.456034 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:33.455986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8688\" (UniqueName: \"kubernetes.io/projected/561d2ea3-168e-4663-9889-bed6aa6d5638-kube-api-access-j8688\") pod \"test-curl-7641-938823\" (UID: \"561d2ea3-168e-4663-9889-bed6aa6d5638\") " pod="opendatahub/test-curl-7641-938823"
Sep 10 17:33:33.464507 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:33.464455    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8688\" (UniqueName: \"kubernetes.io/projected/561d2ea3-168e-4663-9889-bed6aa6d5638-kube-api-access-j8688\") pod \"test-curl-7641-938823\" (UID: \"561d2ea3-168e-4663-9889-bed6aa6d5638\") " pod="opendatahub/test-curl-7641-938823"
Sep 10 17:33:33.527915 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:33.527886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7641-938823"
Sep 10 17:33:33.799497 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:33.799413    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7641-938823"]
Sep 10 17:33:33.802810 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:33:33.802782    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod561d2ea3_168e_4663_9889_bed6aa6d5638.slice/crio-1e1f01e13c99a4fe0daa4ab362d3783374977bdc679cc84c993fdf1d3a024258 WatchSource:0}: Error finding container 1e1f01e13c99a4fe0daa4ab362d3783374977bdc679cc84c993fdf1d3a024258: Status 404 returned error can't find the container with id 1e1f01e13c99a4fe0daa4ab362d3783374977bdc679cc84c993fdf1d3a024258
Sep 10 17:33:34.426728 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:34.426695    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7641-938823" event={"ID":"561d2ea3-168e-4663-9889-bed6aa6d5638","Type":"ContainerStarted","Data":"8a1cb9165325eaaaf54319fb1e9a95984bbc405e11a1208cc71f6352e945ebcd"}
Sep 10 17:33:34.426728 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:34.426737    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7641-938823" event={"ID":"561d2ea3-168e-4663-9889-bed6aa6d5638","Type":"ContainerStarted","Data":"1e1f01e13c99a4fe0daa4ab362d3783374977bdc679cc84c993fdf1d3a024258"}
Sep 10 17:33:34.444433 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:34.444383    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7641-938823" podStartSLOduration=1.444366742 podStartE2EDuration="1.444366742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:33:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:33:34.442939811 +0000 UTC m=+1299.858990753" watchObservedRunningTime="2026-09-10 17:33:34.444366742 +0000 UTC m=+1299.860417691"
Sep 10 17:33:35.114987 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:35.114953    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7641-938823"]
Sep 10 17:33:35.121362 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:35.121327    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7641-938823"]
Sep 10 17:33:35.431981 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:33:35.431953    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7641-938823" container="test-curl-7641-938823"
Sep 10 17:33:36.437154 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:36.437113    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7641-938823" podUID="561d2ea3-168e-4663-9889-bed6aa6d5638" containerName="test-curl-7641-938823" containerID="cri-o://8a1cb9165325eaaaf54319fb1e9a95984bbc405e11a1208cc71f6352e945ebcd" gracePeriod=2
Sep 10 17:33:36.439435 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:33:36.439408    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7641-938823\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="561d2ea3-168e-4663-9889-bed6aa6d5638" pod="opendatahub/test-curl-7641-938823"
Sep 10 17:33:36.613291 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:36.613257    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:33:38.602500 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:38.602457    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7641-938823"
Sep 10 17:33:38.710650 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:38.710568    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8688\" (UniqueName: \"kubernetes.io/projected/561d2ea3-168e-4663-9889-bed6aa6d5638-kube-api-access-j8688\") pod \"561d2ea3-168e-4663-9889-bed6aa6d5638\" (UID: \"561d2ea3-168e-4663-9889-bed6aa6d5638\") "
Sep 10 17:33:38.712621 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:38.712589    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/561d2ea3-168e-4663-9889-bed6aa6d5638-kube-api-access-j8688" (OuterVolumeSpecName: "kube-api-access-j8688") pod "561d2ea3-168e-4663-9889-bed6aa6d5638" (UID: "561d2ea3-168e-4663-9889-bed6aa6d5638"). InnerVolumeSpecName "kube-api-access-j8688". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:33:38.812151 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:38.812123    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8688\" (UniqueName: \"kubernetes.io/projected/561d2ea3-168e-4663-9889-bed6aa6d5638-kube-api-access-j8688\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:33:39.085686 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:39.085609    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="561d2ea3-168e-4663-9889-bed6aa6d5638" path="/var/lib/kubelet/pods/561d2ea3-168e-4663-9889-bed6aa6d5638/volumes"
Sep 10 17:33:39.453148 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:39.453120    2576 generic.go:356] "Generic (PLEG): container finished" podID="561d2ea3-168e-4663-9889-bed6aa6d5638" containerID="8a1cb9165325eaaaf54319fb1e9a95984bbc405e11a1208cc71f6352e945ebcd" exitCode=137
Sep 10 17:33:39.453325 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:39.453163    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7641-938823"
Sep 10 17:33:39.453325 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:39.453209    2576 scope.go:117] "RemoveContainer" containerID="8a1cb9165325eaaaf54319fb1e9a95984bbc405e11a1208cc71f6352e945ebcd"
Sep 10 17:33:39.461415 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:39.461394    2576 scope.go:117] "RemoveContainer" containerID="8a1cb9165325eaaaf54319fb1e9a95984bbc405e11a1208cc71f6352e945ebcd"
Sep 10 17:33:39.461684 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:33:39.461663    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a1cb9165325eaaaf54319fb1e9a95984bbc405e11a1208cc71f6352e945ebcd\": container with ID starting with 8a1cb9165325eaaaf54319fb1e9a95984bbc405e11a1208cc71f6352e945ebcd not found: ID does not exist" containerID="8a1cb9165325eaaaf54319fb1e9a95984bbc405e11a1208cc71f6352e945ebcd"
Sep 10 17:33:39.461765 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:39.461691    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a1cb9165325eaaaf54319fb1e9a95984bbc405e11a1208cc71f6352e945ebcd"} err="failed to get container status \"8a1cb9165325eaaaf54319fb1e9a95984bbc405e11a1208cc71f6352e945ebcd\": rpc error: code = NotFound desc = could not find container \"8a1cb9165325eaaaf54319fb1e9a95984bbc405e11a1208cc71f6352e945ebcd\": container with ID starting with 8a1cb9165325eaaaf54319fb1e9a95984bbc405e11a1208cc71f6352e945ebcd not found: ID does not exist"
Sep 10 17:33:48.753761 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:48.753724    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:33:55.263958 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:33:55.263925    2576 scope.go:117] "RemoveContainer" containerID="85415dd2ac4360e49999f82a8eab005bb55f9e60174db3c700f26300cbbac67d"
Sep 10 17:34:06.822863 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:06.822825    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:34:09.741903 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:09.741862    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"]
Sep 10 17:34:09.742412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:09.742206    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr" podUID="0ac77ec1-5015-4237-968d-43ca2379c6da" containerName="istio-proxy" containerID="cri-o://319d1354a1edb53f36c6ca5098a6bd45f9bab17df56fb0b48a3968d175fd55b5" gracePeriod=30
Sep 10 17:34:14.995896 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:14.995867    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:34:15.142870 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.142829    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-data\") pod \"0ac77ec1-5015-4237-968d-43ca2379c6da\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") "
Sep 10 17:34:15.142870 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.142871    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-token\") pod \"0ac77ec1-5015-4237-968d-43ca2379c6da\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") "
Sep 10 17:34:15.143188 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.142923    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-envoy\") pod \"0ac77ec1-5015-4237-968d-43ca2379c6da\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") "
Sep 10 17:34:15.143188 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.142975    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-podinfo\") pod \"0ac77ec1-5015-4237-968d-43ca2379c6da\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") "
Sep 10 17:34:15.143188 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.143083    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-credential-socket\") pod \"0ac77ec1-5015-4237-968d-43ca2379c6da\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") "
Sep 10 17:34:15.143188 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.143138    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-workload-socket\") pod \"0ac77ec1-5015-4237-968d-43ca2379c6da\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") "
Sep 10 17:34:15.143188 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.143172    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-workload-certs\") pod \"0ac77ec1-5015-4237-968d-43ca2379c6da\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") "
Sep 10 17:34:15.143473 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.143197    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ac77ec1-5015-4237-968d-43ca2379c6da-istiod-ca-cert\") pod \"0ac77ec1-5015-4237-968d-43ca2379c6da\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") "
Sep 10 17:34:15.143473 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.143235    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-data" (OuterVolumeSpecName: "istio-data") pod "0ac77ec1-5015-4237-968d-43ca2379c6da" (UID: "0ac77ec1-5015-4237-968d-43ca2379c6da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:34:15.143473 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.143396    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0ac77ec1-5015-4237-968d-43ca2379c6da" (UID: "0ac77ec1-5015-4237-968d-43ca2379c6da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:34:15.143473 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.143462    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0ac77ec1-5015-4237-968d-43ca2379c6da" (UID: "0ac77ec1-5015-4237-968d-43ca2379c6da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:34:15.143694 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.143481    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0ac77ec1-5015-4237-968d-43ca2379c6da" (UID: "0ac77ec1-5015-4237-968d-43ca2379c6da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:34:15.143694 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.143566    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ac77ec1-5015-4237-968d-43ca2379c6da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0ac77ec1-5015-4237-968d-43ca2379c6da" (UID: "0ac77ec1-5015-4237-968d-43ca2379c6da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:34:15.143694 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.143227    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgnkn\" (UniqueName: \"kubernetes.io/projected/0ac77ec1-5015-4237-968d-43ca2379c6da-kube-api-access-zgnkn\") pod \"0ac77ec1-5015-4237-968d-43ca2379c6da\" (UID: \"0ac77ec1-5015-4237-968d-43ca2379c6da\") "
Sep 10 17:34:15.144016 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.143993    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:34:15.144119 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.144018    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:34:15.144119 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.144033    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:34:15.144119 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.144047    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ac77ec1-5015-4237-968d-43ca2379c6da-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:34:15.144119 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.144078    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:34:15.145383 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.145351    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0ac77ec1-5015-4237-968d-43ca2379c6da" (UID: "0ac77ec1-5015-4237-968d-43ca2379c6da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:34:15.145499 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.145443    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-token" (OuterVolumeSpecName: "istio-token") pod "0ac77ec1-5015-4237-968d-43ca2379c6da" (UID: "0ac77ec1-5015-4237-968d-43ca2379c6da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:34:15.145606 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.145585    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0ac77ec1-5015-4237-968d-43ca2379c6da" (UID: "0ac77ec1-5015-4237-968d-43ca2379c6da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:34:15.145702 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.145684    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ac77ec1-5015-4237-968d-43ca2379c6da-kube-api-access-zgnkn" (OuterVolumeSpecName: "kube-api-access-zgnkn") pod "0ac77ec1-5015-4237-968d-43ca2379c6da" (UID: "0ac77ec1-5015-4237-968d-43ca2379c6da"). InnerVolumeSpecName "kube-api-access-zgnkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:34:15.244496 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.244451    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgnkn\" (UniqueName: \"kubernetes.io/projected/0ac77ec1-5015-4237-968d-43ca2379c6da-kube-api-access-zgnkn\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:34:15.244496 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.244487    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:34:15.244496 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.244497    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:34:15.244496 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.244507    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ac77ec1-5015-4237-968d-43ca2379c6da-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:34:15.638722 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.638685    2576 generic.go:356] "Generic (PLEG): container finished" podID="0ac77ec1-5015-4237-968d-43ca2379c6da" containerID="319d1354a1edb53f36c6ca5098a6bd45f9bab17df56fb0b48a3968d175fd55b5" exitCode=0
Sep 10 17:34:15.638906 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.638755    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"
Sep 10 17:34:15.638906 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.638763    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr" event={"ID":"0ac77ec1-5015-4237-968d-43ca2379c6da","Type":"ContainerDied","Data":"319d1354a1edb53f36c6ca5098a6bd45f9bab17df56fb0b48a3968d175fd55b5"}
Sep 10 17:34:15.638906 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.638807    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr" event={"ID":"0ac77ec1-5015-4237-968d-43ca2379c6da","Type":"ContainerDied","Data":"0a2789b96fad6179cd9eae4357d46ee44e419a35aa704dfab4d0331f44274138"}
Sep 10 17:34:15.638906 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.638829    2576 scope.go:117] "RemoveContainer" containerID="319d1354a1edb53f36c6ca5098a6bd45f9bab17df56fb0b48a3968d175fd55b5"
Sep 10 17:34:15.648000 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.647980    2576 scope.go:117] "RemoveContainer" containerID="7b6c7bf6a526d2358ed12224854f84eba5760fb1d6ffbcb96593c3127aef0dfd"
Sep 10 17:34:15.655893 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.655873    2576 scope.go:117] "RemoveContainer" containerID="319d1354a1edb53f36c6ca5098a6bd45f9bab17df56fb0b48a3968d175fd55b5"
Sep 10 17:34:15.656253 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:34:15.656233    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"319d1354a1edb53f36c6ca5098a6bd45f9bab17df56fb0b48a3968d175fd55b5\": container with ID starting with 319d1354a1edb53f36c6ca5098a6bd45f9bab17df56fb0b48a3968d175fd55b5 not found: ID does not exist" containerID="319d1354a1edb53f36c6ca5098a6bd45f9bab17df56fb0b48a3968d175fd55b5"
Sep 10 17:34:15.656325 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.656262    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"319d1354a1edb53f36c6ca5098a6bd45f9bab17df56fb0b48a3968d175fd55b5"} err="failed to get container status \"319d1354a1edb53f36c6ca5098a6bd45f9bab17df56fb0b48a3968d175fd55b5\": rpc error: code = NotFound desc = could not find container \"319d1354a1edb53f36c6ca5098a6bd45f9bab17df56fb0b48a3968d175fd55b5\": container with ID starting with 319d1354a1edb53f36c6ca5098a6bd45f9bab17df56fb0b48a3968d175fd55b5 not found: ID does not exist"
Sep 10 17:34:15.656325 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.656280    2576 scope.go:117] "RemoveContainer" containerID="7b6c7bf6a526d2358ed12224854f84eba5760fb1d6ffbcb96593c3127aef0dfd"
Sep 10 17:34:15.656524 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:34:15.656509    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b6c7bf6a526d2358ed12224854f84eba5760fb1d6ffbcb96593c3127aef0dfd\": container with ID starting with 7b6c7bf6a526d2358ed12224854f84eba5760fb1d6ffbcb96593c3127aef0dfd not found: ID does not exist" containerID="7b6c7bf6a526d2358ed12224854f84eba5760fb1d6ffbcb96593c3127aef0dfd"
Sep 10 17:34:15.656568 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.656528    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b6c7bf6a526d2358ed12224854f84eba5760fb1d6ffbcb96593c3127aef0dfd"} err="failed to get container status \"7b6c7bf6a526d2358ed12224854f84eba5760fb1d6ffbcb96593c3127aef0dfd\": rpc error: code = NotFound desc = could not find container \"7b6c7bf6a526d2358ed12224854f84eba5760fb1d6ffbcb96593c3127aef0dfd\": container with ID starting with 7b6c7bf6a526d2358ed12224854f84eba5760fb1d6ffbcb96593c3127aef0dfd not found: ID does not exist"
Sep 10 17:34:15.660238 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.660212    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"]
Sep 10 17:34:15.664396 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:15.664374    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9d28f397-openshift-default-7b8b7c9bfb-7wsxr"]
Sep 10 17:34:17.084533 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:17.084455    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ac77ec1-5015-4237-968d-43ca2379c6da" path="/var/lib/kubelet/pods/0ac77ec1-5015-4237-968d-43ca2379c6da/volumes"
Sep 10 17:34:21.222183 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:21.222148    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:34:32.335797 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:32.335760    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:34:52.750151 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:52.750116    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:34:55.286365 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:55.286334    2576 scope.go:117] "RemoveContainer" containerID="3033fae770e8f038d9efc688f07f0f11779b2639d0c42e48de58ed40a0bc661a"
Sep 10 17:34:55.294469 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:34:55.294450    2576 scope.go:117] "RemoveContainer" containerID="24176120ef4b2c6ec1457060915e1643977a5230887a403176c664b2168378e9"
Sep 10 17:35:06.366173 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.366140    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7641-88d0d4"]
Sep 10 17:35:06.366635 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.366500    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac77ec1-5015-4237-968d-43ca2379c6da" containerName="istio-proxy"
Sep 10 17:35:06.366635 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.366512    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac77ec1-5015-4237-968d-43ca2379c6da" containerName="istio-proxy"
Sep 10 17:35:06.366635 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.366529    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="561d2ea3-168e-4663-9889-bed6aa6d5638" containerName="test-curl-7641-938823"
Sep 10 17:35:06.366635 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.366535    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="561d2ea3-168e-4663-9889-bed6aa6d5638" containerName="test-curl-7641-938823"
Sep 10 17:35:06.366635 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.366597    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ac77ec1-5015-4237-968d-43ca2379c6da" containerName="istio-proxy"
Sep 10 17:35:06.366635 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.366604    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="561d2ea3-168e-4663-9889-bed6aa6d5638" containerName="test-curl-7641-938823"
Sep 10 17:35:06.366635 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.366611    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ac77ec1-5015-4237-968d-43ca2379c6da" containerName="istio-proxy"
Sep 10 17:35:06.370230 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.370213    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7641-88d0d4"
Sep 10 17:35:06.375088 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.375066    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4gkv4\""
Sep 10 17:35:06.379831 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.379807    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7641-88d0d4"]
Sep 10 17:35:06.507199 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.507159    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-428p2\" (UniqueName: \"kubernetes.io/projected/3d54a77f-4980-4909-bd39-dc3304454753-kube-api-access-428p2\") pod \"test-curl-7641-88d0d4\" (UID: \"3d54a77f-4980-4909-bd39-dc3304454753\") " pod="opendatahub/test-curl-7641-88d0d4"
Sep 10 17:35:06.608721 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.608683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-428p2\" (UniqueName: \"kubernetes.io/projected/3d54a77f-4980-4909-bd39-dc3304454753-kube-api-access-428p2\") pod \"test-curl-7641-88d0d4\" (UID: \"3d54a77f-4980-4909-bd39-dc3304454753\") " pod="opendatahub/test-curl-7641-88d0d4"
Sep 10 17:35:06.628221 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.628179    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-428p2\" (UniqueName: \"kubernetes.io/projected/3d54a77f-4980-4909-bd39-dc3304454753-kube-api-access-428p2\") pod \"test-curl-7641-88d0d4\" (UID: \"3d54a77f-4980-4909-bd39-dc3304454753\") " pod="opendatahub/test-curl-7641-88d0d4"
Sep 10 17:35:06.639477 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.639447    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"]
Sep 10 17:35:06.639819 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.639807    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac77ec1-5015-4237-968d-43ca2379c6da" containerName="istio-proxy"
Sep 10 17:35:06.639867 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.639821    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac77ec1-5015-4237-968d-43ca2379c6da" containerName="istio-proxy"
Sep 10 17:35:06.642246 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.642226    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.649220 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.649196    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-2549d0-openshift-default-dockercfg-2lbp4\""
Sep 10 17:35:06.661480 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.661453    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"]
Sep 10 17:35:06.680132 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.680100    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7641-88d0d4"
Sep 10 17:35:06.709924 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.709882    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-credential-socket\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.710117 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.709935    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-workload-socket\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.710117 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.709963    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istiod-ca-cert\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.710117 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.710042    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-workload-certs\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.710289 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.710142    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-envoy\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.710289 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.710213    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-data\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.710289 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.710242    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpxjh\" (UniqueName: \"kubernetes.io/projected/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-kube-api-access-lpxjh\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.710412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.710341    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-podinfo\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.710412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.710393    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-token\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.812205 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.810889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-podinfo\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.812205 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.810955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-token\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.812205 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.810989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-credential-socket\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.812205 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.811027    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-workload-socket\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.812205 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.811088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istiod-ca-cert\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.812205 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.811138    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-workload-certs\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.812205 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.811188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-envoy\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.812205 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.811259    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-data\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.812205 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.811290    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpxjh\" (UniqueName: \"kubernetes.io/projected/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-kube-api-access-lpxjh\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.812806 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.812421    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-workload-certs\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.813419 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.813109    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-data\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.813419 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.813380    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-workload-socket\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.813649 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.813423    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istiod-ca-cert\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.813835 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.813793    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-credential-socket\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.815388 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.815354    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-envoy\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.816221 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.816200    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-podinfo\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.828042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.827983    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-token\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.829120 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.829096    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpxjh\" (UniqueName: \"kubernetes.io/projected/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-kube-api-access-lpxjh\") pod \"e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") " pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.953391 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.953305    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:06.958978 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:06.958955    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7641-88d0d4"]
Sep 10 17:35:06.962890 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:35:06.962866    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d54a77f_4980_4909_bd39_dc3304454753.slice/crio-19e123a8ad6c5676d03112cfb1198410bc5ea043810936a4670a3d75f0c58724 WatchSource:0}: Error finding container 19e123a8ad6c5676d03112cfb1198410bc5ea043810936a4670a3d75f0c58724: Status 404 returned error can't find the container with id 19e123a8ad6c5676d03112cfb1198410bc5ea043810936a4670a3d75f0c58724
Sep 10 17:35:07.243595 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:07.243565    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"]
Sep 10 17:35:07.245025 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:35:07.245001    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7755e53c_964d_43b4_aa78_fdf0f7eebcfa.slice/crio-8ac013a6c406da78423673a2cc43c105e7f52706f6dd0e95ba127222a3dc7ef8 WatchSource:0}: Error finding container 8ac013a6c406da78423673a2cc43c105e7f52706f6dd0e95ba127222a3dc7ef8: Status 404 returned error can't find the container with id 8ac013a6c406da78423673a2cc43c105e7f52706f6dd0e95ba127222a3dc7ef8
Sep 10 17:35:07.247300 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:07.247273    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:35:07.247377 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:07.247331    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:35:07.247377 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:07.247363    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:35:07.908165 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:07.908121    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l" event={"ID":"7755e53c-964d-43b4-aa78-fdf0f7eebcfa","Type":"ContainerStarted","Data":"a831679bb0fc4f2e361754aceb46f340db0e3e7c0329e7e554dd0e9492775f7d"}
Sep 10 17:35:07.908654 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:07.908227    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l" event={"ID":"7755e53c-964d-43b4-aa78-fdf0f7eebcfa","Type":"ContainerStarted","Data":"8ac013a6c406da78423673a2cc43c105e7f52706f6dd0e95ba127222a3dc7ef8"}
Sep 10 17:35:07.909723 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:07.909694    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7641-88d0d4" event={"ID":"3d54a77f-4980-4909-bd39-dc3304454753","Type":"ContainerStarted","Data":"f8a8e25870c943bf7cf1846d5220fc1855942417d2656e01cc7dc2085c1ac8e6"}
Sep 10 17:35:07.909858 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:07.909733    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7641-88d0d4" event={"ID":"3d54a77f-4980-4909-bd39-dc3304454753","Type":"ContainerStarted","Data":"19e123a8ad6c5676d03112cfb1198410bc5ea043810936a4670a3d75f0c58724"}
Sep 10 17:35:07.954309 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:07.954275    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:07.965412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:07.965358    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7641-88d0d4" podStartSLOduration=1.9653386720000001 podStartE2EDuration="1.965338672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:35:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:35:07.963355144 +0000 UTC m=+1393.379406094" watchObservedRunningTime="2026-09-10 17:35:07.965338672 +0000 UTC m=+1393.381389620"
Sep 10 17:35:07.965804 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:07.965781    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l" podStartSLOduration=1.965775559 podStartE2EDuration="1.965775559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:35:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:35:07.939306515 +0000 UTC m=+1393.355357475" watchObservedRunningTime="2026-09-10 17:35:07.965775559 +0000 UTC m=+1393.381826510"
Sep 10 17:35:08.719097 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:08.718992    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7641-88d0d4"]
Sep 10 17:35:08.728045 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:08.728014    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7641-88d0d4"]
Sep 10 17:35:08.848427 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:08.848389    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7641-72ff66"]
Sep 10 17:35:08.848751 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:08.848739    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d54a77f-4980-4909-bd39-dc3304454753" containerName="test-curl-7641-88d0d4"
Sep 10 17:35:08.848799 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:08.848752    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d54a77f-4980-4909-bd39-dc3304454753" containerName="test-curl-7641-88d0d4"
Sep 10 17:35:08.848832 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:08.848820    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d54a77f-4980-4909-bd39-dc3304454753" containerName="test-curl-7641-88d0d4"
Sep 10 17:35:08.851844 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:08.851826    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7641-72ff66"
Sep 10 17:35:08.858641 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:08.858615    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7641-72ff66"]
Sep 10 17:35:08.914101 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:35:08.914070    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7641-88d0d4" container="test-curl-7641-88d0d4"
Sep 10 17:35:08.932273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:08.932247    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c42l6\" (UniqueName: \"kubernetes.io/projected/fb64c3c2-2461-4fea-9f3c-3ee7dd48969f-kube-api-access-c42l6\") pod \"test-curl-7641-72ff66\" (UID: \"fb64c3c2-2461-4fea-9f3c-3ee7dd48969f\") " pod="opendatahub/test-curl-7641-72ff66"
Sep 10 17:35:08.959087 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:08.959045    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:09.033676 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:09.033312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c42l6\" (UniqueName: \"kubernetes.io/projected/fb64c3c2-2461-4fea-9f3c-3ee7dd48969f-kube-api-access-c42l6\") pod \"test-curl-7641-72ff66\" (UID: \"fb64c3c2-2461-4fea-9f3c-3ee7dd48969f\") " pod="opendatahub/test-curl-7641-72ff66"
Sep 10 17:35:09.049198 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:09.049170    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c42l6\" (UniqueName: \"kubernetes.io/projected/fb64c3c2-2461-4fea-9f3c-3ee7dd48969f-kube-api-access-c42l6\") pod \"test-curl-7641-72ff66\" (UID: \"fb64c3c2-2461-4fea-9f3c-3ee7dd48969f\") " pod="opendatahub/test-curl-7641-72ff66"
Sep 10 17:35:09.162814 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:09.162762    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7641-72ff66"
Sep 10 17:35:09.438616 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:09.438593    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7641-72ff66"]
Sep 10 17:35:09.441088 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:35:09.441046    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb64c3c2_2461_4fea_9f3c_3ee7dd48969f.slice/crio-dabec1e7c3d3860222303d62519740bf5f369e77410714de61e1f11f326e1290 WatchSource:0}: Error finding container dabec1e7c3d3860222303d62519740bf5f369e77410714de61e1f11f326e1290: Status 404 returned error can't find the container with id dabec1e7c3d3860222303d62519740bf5f369e77410714de61e1f11f326e1290
Sep 10 17:35:09.922845 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:09.922804    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7641-72ff66" event={"ID":"fb64c3c2-2461-4fea-9f3c-3ee7dd48969f","Type":"ContainerStarted","Data":"ab871f215627b3872829ea800b831c456d13f8e46160999e5d4d426c9dfb48fc"}
Sep 10 17:35:09.923311 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:09.922858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7641-72ff66" event={"ID":"fb64c3c2-2461-4fea-9f3c-3ee7dd48969f","Type":"ContainerStarted","Data":"dabec1e7c3d3860222303d62519740bf5f369e77410714de61e1f11f326e1290"}
Sep 10 17:35:09.923311 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:09.922890    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7641-88d0d4" podUID="3d54a77f-4980-4909-bd39-dc3304454753" containerName="test-curl-7641-88d0d4" containerID="cri-o://f8a8e25870c943bf7cf1846d5220fc1855942417d2656e01cc7dc2085c1ac8e6" gracePeriod=2
Sep 10 17:35:09.923311 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:09.923292    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:09.924336 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:09.924313    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:09.943655 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:09.943596    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7641-72ff66" podStartSLOduration=1.943579634 podStartE2EDuration="1.943579634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:35:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:35:09.942338322 +0000 UTC m=+1395.358389272" watchObservedRunningTime="2026-09-10 17:35:09.943579634 +0000 UTC m=+1395.359630582"
Sep 10 17:35:10.635589 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:10.635554    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7641-72ff66"]
Sep 10 17:35:10.640606 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:10.640579    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7641-72ff66"]
Sep 10 17:35:10.928251 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:35:10.928217    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7641-72ff66" container="test-curl-7641-72ff66"
Sep 10 17:35:11.728882 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:11.728848    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:35:11.933543 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:11.933512    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7641-72ff66" podUID="fb64c3c2-2461-4fea-9f3c-3ee7dd48969f" containerName="test-curl-7641-72ff66" containerID="cri-o://ab871f215627b3872829ea800b831c456d13f8e46160999e5d4d426c9dfb48fc" gracePeriod=2
Sep 10 17:35:12.098968 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.098940    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7641-88d0d4"
Sep 10 17:35:12.261392 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.261358    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"]
Sep 10 17:35:12.261737 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.261725    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb64c3c2-2461-4fea-9f3c-3ee7dd48969f" containerName="test-curl-7641-72ff66"
Sep 10 17:35:12.261789 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.261739    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb64c3c2-2461-4fea-9f3c-3ee7dd48969f" containerName="test-curl-7641-72ff66"
Sep 10 17:35:12.261835 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.261826    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb64c3c2-2461-4fea-9f3c-3ee7dd48969f" containerName="test-curl-7641-72ff66"
Sep 10 17:35:12.264719 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.264694    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-428p2\" (UniqueName: \"kubernetes.io/projected/3d54a77f-4980-4909-bd39-dc3304454753-kube-api-access-428p2\") pod \"3d54a77f-4980-4909-bd39-dc3304454753\" (UID: \"3d54a77f-4980-4909-bd39-dc3304454753\") "
Sep 10 17:35:12.264850 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.264740    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"
Sep 10 17:35:12.266868 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.266840    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d54a77f-4980-4909-bd39-dc3304454753-kube-api-access-428p2" (OuterVolumeSpecName: "kube-api-access-428p2") pod "3d54a77f-4980-4909-bd39-dc3304454753" (UID: "3d54a77f-4980-4909-bd39-dc3304454753"). InnerVolumeSpecName "kube-api-access-428p2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:35:12.272927 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.272906    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-2549d0-dockercfg-6x65p\""
Sep 10 17:35:12.273044 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.272914    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-2549d0\""
Sep 10 17:35:12.289811 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.289775    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"]
Sep 10 17:35:12.308381 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.308345    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"]
Sep 10 17:35:12.316986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.316775    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"
Sep 10 17:35:12.343088 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.341310    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"]
Sep 10 17:35:12.365649 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.365620    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnv48\" (UniqueName: \"kubernetes.io/projected/44b83f56-59b6-4f1d-aec0-19bc16c23234-kube-api-access-fnv48\") pod \"payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m\" (UID: \"44b83f56-59b6-4f1d-aec0-19bc16c23234\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"
Sep 10 17:35:12.365826 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.365707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44b83f56-59b6-4f1d-aec0-19bc16c23234-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m\" (UID: \"44b83f56-59b6-4f1d-aec0-19bc16c23234\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"
Sep 10 17:35:12.365826 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.365769    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-428p2\" (UniqueName: \"kubernetes.io/projected/3d54a77f-4980-4909-bd39-dc3304454753-kube-api-access-428p2\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:35:12.467034 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.466993    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44b83f56-59b6-4f1d-aec0-19bc16c23234-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m\" (UID: \"44b83f56-59b6-4f1d-aec0-19bc16c23234\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"
Sep 10 17:35:12.467224 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.467040    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzslq\" (UniqueName: \"kubernetes.io/projected/5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc-kube-api-access-fzslq\") pod \"payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks\" (UID: \"5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc\") " pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"
Sep 10 17:35:12.467224 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.467112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnv48\" (UniqueName: \"kubernetes.io/projected/44b83f56-59b6-4f1d-aec0-19bc16c23234-kube-api-access-fnv48\") pod \"payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m\" (UID: \"44b83f56-59b6-4f1d-aec0-19bc16c23234\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"
Sep 10 17:35:12.467224 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.467146    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks\" (UID: \"5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc\") " pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"
Sep 10 17:35:12.467816 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.467797    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44b83f56-59b6-4f1d-aec0-19bc16c23234-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m\" (UID: \"44b83f56-59b6-4f1d-aec0-19bc16c23234\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"
Sep 10 17:35:12.475921 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.475888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnv48\" (UniqueName: \"kubernetes.io/projected/44b83f56-59b6-4f1d-aec0-19bc16c23234-kube-api-access-fnv48\") pod \"payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m\" (UID: \"44b83f56-59b6-4f1d-aec0-19bc16c23234\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"
Sep 10 17:35:12.568094 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.567976    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks\" (UID: \"5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc\") " pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"
Sep 10 17:35:12.568261 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.568105    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzslq\" (UniqueName: \"kubernetes.io/projected/5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc-kube-api-access-fzslq\") pod \"payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks\" (UID: \"5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc\") " pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"
Sep 10 17:35:12.568706 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.568684    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc-plugins-config-volume\") pod \"payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks\" (UID: \"5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc\") " pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"
Sep 10 17:35:12.576601 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.576574    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzslq\" (UniqueName: \"kubernetes.io/projected/5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc-kube-api-access-fzslq\") pod \"payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks\" (UID: \"5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc\") " pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"
Sep 10 17:35:12.581433 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.581406    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"
Sep 10 17:35:12.634364 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.634338    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"
Sep 10 17:35:12.855182 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.855159    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"]
Sep 10 17:35:12.856994 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:35:12.856968    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b83f56_59b6_4f1d_aec0_19bc16c23234.slice/crio-66b21e230ca073fc20d2930015040088d7bfe5e57e4dfadc960c0ce1a85af689 WatchSource:0}: Error finding container 66b21e230ca073fc20d2930015040088d7bfe5e57e4dfadc960c0ce1a85af689: Status 404 returned error can't find the container with id 66b21e230ca073fc20d2930015040088d7bfe5e57e4dfadc960c0ce1a85af689
Sep 10 17:35:12.922192 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.922158    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"]
Sep 10 17:35:12.924735 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:35:12.924708    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a550e0b_d84e_49e2_b32e_fdcd6b9d1afc.slice/crio-34384e594f881c2116c450cdcb7226d68097f2c1c8608b2173019352cbb2d9c5 WatchSource:0}: Error finding container 34384e594f881c2116c450cdcb7226d68097f2c1c8608b2173019352cbb2d9c5: Status 404 returned error can't find the container with id 34384e594f881c2116c450cdcb7226d68097f2c1c8608b2173019352cbb2d9c5
Sep 10 17:35:12.941951 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.941918    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m" event={"ID":"44b83f56-59b6-4f1d-aec0-19bc16c23234","Type":"ContainerStarted","Data":"3ec85f5392242451da64900701421e56386f759e1ec64a069106ce1f7abd7378"}
Sep 10 17:35:12.942383 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.941982    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m" event={"ID":"44b83f56-59b6-4f1d-aec0-19bc16c23234","Type":"ContainerStarted","Data":"66b21e230ca073fc20d2930015040088d7bfe5e57e4dfadc960c0ce1a85af689"}
Sep 10 17:35:12.942383 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.942012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"
Sep 10 17:35:12.943584 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.943557    2576 generic.go:356] "Generic (PLEG): container finished" podID="3d54a77f-4980-4909-bd39-dc3304454753" containerID="f8a8e25870c943bf7cf1846d5220fc1855942417d2656e01cc7dc2085c1ac8e6" exitCode=137
Sep 10 17:35:12.943584 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.943577    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7641-88d0d4"
Sep 10 17:35:12.943834 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.943681    2576 scope.go:117] "RemoveContainer" containerID="f8a8e25870c943bf7cf1846d5220fc1855942417d2656e01cc7dc2085c1ac8e6"
Sep 10 17:35:12.946965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.946939    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks" event={"ID":"5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc","Type":"ContainerStarted","Data":"34384e594f881c2116c450cdcb7226d68097f2c1c8608b2173019352cbb2d9c5"}
Sep 10 17:35:12.959006 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.958986    2576 scope.go:117] "RemoveContainer" containerID="f8a8e25870c943bf7cf1846d5220fc1855942417d2656e01cc7dc2085c1ac8e6"
Sep 10 17:35:12.959346 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:35:12.959323    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8a8e25870c943bf7cf1846d5220fc1855942417d2656e01cc7dc2085c1ac8e6\": container with ID starting with f8a8e25870c943bf7cf1846d5220fc1855942417d2656e01cc7dc2085c1ac8e6 not found: ID does not exist" containerID="f8a8e25870c943bf7cf1846d5220fc1855942417d2656e01cc7dc2085c1ac8e6"
Sep 10 17:35:12.959451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.959355    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8a8e25870c943bf7cf1846d5220fc1855942417d2656e01cc7dc2085c1ac8e6"} err="failed to get container status \"f8a8e25870c943bf7cf1846d5220fc1855942417d2656e01cc7dc2085c1ac8e6\": rpc error: code = NotFound desc = could not find container \"f8a8e25870c943bf7cf1846d5220fc1855942417d2656e01cc7dc2085c1ac8e6\": container with ID starting with f8a8e25870c943bf7cf1846d5220fc1855942417d2656e01cc7dc2085c1ac8e6 not found: ID does not exist"
Sep 10 17:35:12.965713 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:12.965516    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m" podStartSLOduration=0.965501668 podStartE2EDuration="965.501668ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:35:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:35:12.964736384 +0000 UTC m=+1398.380787333" watchObservedRunningTime="2026-09-10 17:35:12.965501668 +0000 UTC m=+1398.381552617"
Sep 10 17:35:12.969718 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:35:12.969677    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7641-88d0d4\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="3d54a77f-4980-4909-bd39-dc3304454753" pod="opendatahub/test-curl-7641-88d0d4"
Sep 10 17:35:13.089787 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:13.088230    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d54a77f-4980-4909-bd39-dc3304454753" path="/var/lib/kubelet/pods/3d54a77f-4980-4909-bd39-dc3304454753/volumes"
Sep 10 17:35:13.954962 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:13.954934    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks" event={"ID":"5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc","Type":"ContainerStarted","Data":"0024a84a00090bfb511ec0ffc1e7578f001b3016de94e5e4bc295f66cfc39607"}
Sep 10 17:35:13.955394 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:13.955190    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"
Sep 10 17:35:13.990400 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:13.990344    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks" podStartSLOduration=1.9903282789999999 podStartE2EDuration="1.990328279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:35:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:35:13.98924336 +0000 UTC m=+1399.405294310" watchObservedRunningTime="2026-09-10 17:35:13.990328279 +0000 UTC m=+1399.406379250"
Sep 10 17:35:14.132838 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:14.132809    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7641-72ff66"
Sep 10 17:35:14.282914 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:14.282827    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c42l6\" (UniqueName: \"kubernetes.io/projected/fb64c3c2-2461-4fea-9f3c-3ee7dd48969f-kube-api-access-c42l6\") pod \"fb64c3c2-2461-4fea-9f3c-3ee7dd48969f\" (UID: \"fb64c3c2-2461-4fea-9f3c-3ee7dd48969f\") "
Sep 10 17:35:14.285158 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:14.285113    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb64c3c2-2461-4fea-9f3c-3ee7dd48969f-kube-api-access-c42l6" (OuterVolumeSpecName: "kube-api-access-c42l6") pod "fb64c3c2-2461-4fea-9f3c-3ee7dd48969f" (UID: "fb64c3c2-2461-4fea-9f3c-3ee7dd48969f"). InnerVolumeSpecName "kube-api-access-c42l6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:35:14.383967 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:14.383929    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c42l6\" (UniqueName: \"kubernetes.io/projected/fb64c3c2-2461-4fea-9f3c-3ee7dd48969f-kube-api-access-c42l6\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:35:14.961471 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:14.961435    2576 generic.go:356] "Generic (PLEG): container finished" podID="fb64c3c2-2461-4fea-9f3c-3ee7dd48969f" containerID="ab871f215627b3872829ea800b831c456d13f8e46160999e5d4d426c9dfb48fc" exitCode=137
Sep 10 17:35:14.961954 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:14.961496    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7641-72ff66"
Sep 10 17:35:14.961954 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:14.961546    2576 scope.go:117] "RemoveContainer" containerID="ab871f215627b3872829ea800b831c456d13f8e46160999e5d4d426c9dfb48fc"
Sep 10 17:35:14.970623 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:14.970601    2576 scope.go:117] "RemoveContainer" containerID="ab871f215627b3872829ea800b831c456d13f8e46160999e5d4d426c9dfb48fc"
Sep 10 17:35:14.970957 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:35:14.970937    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab871f215627b3872829ea800b831c456d13f8e46160999e5d4d426c9dfb48fc\": container with ID starting with ab871f215627b3872829ea800b831c456d13f8e46160999e5d4d426c9dfb48fc not found: ID does not exist" containerID="ab871f215627b3872829ea800b831c456d13f8e46160999e5d4d426c9dfb48fc"
Sep 10 17:35:14.971144 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:14.970970    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab871f215627b3872829ea800b831c456d13f8e46160999e5d4d426c9dfb48fc"} err="failed to get container status \"ab871f215627b3872829ea800b831c456d13f8e46160999e5d4d426c9dfb48fc\": rpc error: code = NotFound desc = could not find container \"ab871f215627b3872829ea800b831c456d13f8e46160999e5d4d426c9dfb48fc\": container with ID starting with ab871f215627b3872829ea800b831c456d13f8e46160999e5d4d426c9dfb48fc not found: ID does not exist"
Sep 10 17:35:14.972409 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:35:14.972384    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7641-72ff66\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="fb64c3c2-2461-4fea-9f3c-3ee7dd48969f" pod="opendatahub/test-curl-7641-72ff66"
Sep 10 17:35:15.082310 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:35:15.082262    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7641-72ff66\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="fb64c3c2-2461-4fea-9f3c-3ee7dd48969f" pod="opendatahub/test-curl-7641-72ff66"
Sep 10 17:35:15.086281 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:15.086254    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb64c3c2-2461-4fea-9f3c-3ee7dd48969f" path="/var/lib/kubelet/pods/fb64c3c2-2461-4fea-9f3c-3ee7dd48969f/volumes"
Sep 10 17:35:23.957798 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:23.957762    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"
Sep 10 17:35:24.963852 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:24.963817    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"
Sep 10 17:35:27.017812 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:27.017777    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:35:29.048297 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:29.048263    2576 generic.go:356] "Generic (PLEG): container finished" podID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" containerID="a831679bb0fc4f2e361754aceb46f340db0e3e7c0329e7e554dd0e9492775f7d" exitCode=0
Sep 10 17:35:29.048842 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:29.048309    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l" event={"ID":"7755e53c-964d-43b4-aa78-fdf0f7eebcfa","Type":"ContainerDied","Data":"a831679bb0fc4f2e361754aceb46f340db0e3e7c0329e7e554dd0e9492775f7d"}
Sep 10 17:35:29.048842 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:29.048756    2576 scope.go:117] "RemoveContainer" containerID="a831679bb0fc4f2e361754aceb46f340db0e3e7c0329e7e554dd0e9492775f7d"
Sep 10 17:35:29.049984 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:29.049951    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:35:29.050063 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:29.050022    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:35:29.050111 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:29.050080    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:35:30.056426 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:30.056392    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l" event={"ID":"7755e53c-964d-43b4-aa78-fdf0f7eebcfa","Type":"ContainerStarted","Data":"a326105f4aa7ad652997337b02af6b848150b2242443bac88e3d7b73c41928c9"}
Sep 10 17:35:30.953607 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:30.953569    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:30.953800 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:30.953777    2576 patch_prober.go:28] interesting pod/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 17:35:30.953847 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:30.953828    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l" podUID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 17:35:31.954244 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:31.954206    2576 patch_prober.go:28] interesting pod/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 17:35:31.954665 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:31.954263    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l" podUID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 17:35:32.953722 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:32.953687    2576 patch_prober.go:28] interesting pod/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 17:35:32.953911 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:32.953746    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l" podUID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 17:35:33.953905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:33.953866    2576 patch_prober.go:28] interesting pod/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 17:35:33.954363 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:33.953927    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l" podUID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 17:35:34.954222 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:34.954182    2576 patch_prober.go:28] interesting pod/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 10 17:35:34.954648 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:34.954236    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l" podUID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 10 17:35:35.958503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:35.958472    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:35.958999 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:35.958840    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:35.959454 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:35.959434    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:35:37.809420 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:37.809381    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:35:40.721911 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.721880    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"]
Sep 10 17:35:40.724491 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.724474    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.727431 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.727410    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-65fac0-openshift-default-dockercfg-9f2fl\""
Sep 10 17:35:40.752744 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.752713    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"]
Sep 10 17:35:40.866669 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.866636    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-envoy\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.866848 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.866681    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-data\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.866848 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.866744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmbrb\" (UniqueName: \"kubernetes.io/projected/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-kube-api-access-vmbrb\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.866848 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.866772    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-token\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.866962 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.866860    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-credential-socket\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.866962 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.866902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istiod-ca-cert\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.866962 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.866948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-workload-socket\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.867081 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.866973    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-podinfo\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.867081 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.866999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-workload-certs\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.967739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.967696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-credential-socket\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.967739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.967743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istiod-ca-cert\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.968009 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.967770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-workload-socket\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.968009 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.967883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-podinfo\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.968009 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.967918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-workload-certs\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.968009 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.967977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-envoy\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.968009 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.968005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-data\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.968314 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.968079    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmbrb\" (UniqueName: \"kubernetes.io/projected/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-kube-api-access-vmbrb\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.968314 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.968124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-token\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.968314 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.968215    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-workload-socket\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.968481 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.968323    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-credential-socket\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.968481 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.968427    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-workload-certs\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.968560 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.968478    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-data\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.968703 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.968677    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istiod-ca-cert\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.970375 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.970352    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-envoy\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.970516 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.970497    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-podinfo\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.977469 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.977409    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-token\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:40.977767 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:40.977748    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmbrb\" (UniqueName: \"kubernetes.io/projected/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-kube-api-access-vmbrb\") pod \"e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") " pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:41.035482 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:41.035448    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:41.321116 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:41.321082    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"]
Sep 10 17:35:41.323525 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:35:41.323498    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6266d8d3_f01e_46dc_8b9a_2d9ca556dec5.slice/crio-f7d2cd386c8c3770af2ee1b29a9369aa11a6f981ea0f1f3a55b537188eda5f1b WatchSource:0}: Error finding container f7d2cd386c8c3770af2ee1b29a9369aa11a6f981ea0f1f3a55b537188eda5f1b: Status 404 returned error can't find the container with id f7d2cd386c8c3770af2ee1b29a9369aa11a6f981ea0f1f3a55b537188eda5f1b
Sep 10 17:35:41.325712 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:41.325678    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:35:41.325817 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:41.325746    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:35:41.325817 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:41.325778    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:35:42.125616 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:42.125575    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9" event={"ID":"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5","Type":"ContainerStarted","Data":"6f97fb79c219218db4fda70058237f8062d769c4af70ca1468dfcf858cced745"}
Sep 10 17:35:42.125995 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:42.125633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9" event={"ID":"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5","Type":"ContainerStarted","Data":"f7d2cd386c8c3770af2ee1b29a9369aa11a6f981ea0f1f3a55b537188eda5f1b"}
Sep 10 17:35:42.153880 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:42.153831    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9" podStartSLOduration=2.153814243 podStartE2EDuration="2.153814243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:35:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:35:42.152562088 +0000 UTC m=+1427.568613037" watchObservedRunningTime="2026-09-10 17:35:42.153814243 +0000 UTC m=+1427.569865403"
Sep 10 17:35:43.035751 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:43.035711    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:43.041103 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:43.041072    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:43.130559 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:43.130523    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:43.131418 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:43.131398    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:35:55.812758 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:35:55.812720    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:36:06.250636 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:06.250600    2576 generic.go:356] "Generic (PLEG): container finished" podID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerID="6f97fb79c219218db4fda70058237f8062d769c4af70ca1468dfcf858cced745" exitCode=0
Sep 10 17:36:06.251206 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:06.250676    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9" event={"ID":"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5","Type":"ContainerDied","Data":"6f97fb79c219218db4fda70058237f8062d769c4af70ca1468dfcf858cced745"}
Sep 10 17:36:06.251287 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:06.251217    2576 scope.go:117] "RemoveContainer" containerID="6f97fb79c219218db4fda70058237f8062d769c4af70ca1468dfcf858cced745"
Sep 10 17:36:06.252407 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:06.252379    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:36:06.252474 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:06.252448    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:36:06.252511 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:06.252482    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:36:07.257712 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:07.257680    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9" event={"ID":"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5","Type":"ContainerStarted","Data":"587c4e0f58fb3496344deb847a37115119d5cc17a4da66fe43747fb2fc839141"}
Sep 10 17:36:08.036686 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:08.036643    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:36:08.036887 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:08.036859    2576 patch_prober.go:28] interesting pod/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 17:36:08.036948 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:08.036909    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9" podUID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 17:36:09.035817 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:09.035779    2576 patch_prober.go:28] interesting pod/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 17:36:09.036243 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:09.035844    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9" podUID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 17:36:10.036230 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:10.036190    2576 patch_prober.go:28] interesting pod/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 17:36:10.036634 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:10.036262    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9" podUID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 17:36:11.036874 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:11.036830    2576 patch_prober.go:28] interesting pod/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 17:36:11.037294 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:11.036890    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9" podUID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 17:36:12.036504 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:12.036461    2576 patch_prober.go:28] interesting pod/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 17:36:12.036665 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:12.036522    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9" podUID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 17:36:13.036277 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:13.036243    2576 patch_prober.go:28] interesting pod/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 17:36:13.036665 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:13.036298    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9" podUID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 17:36:13.131200 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:13.131161    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:36:14.040484 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:14.040449    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:36:14.041319 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:14.041296    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:36:24.053510 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:24.053465    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:36:27.486590 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.486556    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"]
Sep 10 17:36:27.487138 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.487063    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks" podUID="5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc" containerName="payload-processing" containerID="cri-o://0024a84a00090bfb511ec0ffc1e7578f001b3016de94e5e4bc295f66cfc39607" gracePeriod=30
Sep 10 17:36:27.494709 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.494676    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"]
Sep 10 17:36:27.494925 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.494897    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m" podUID="44b83f56-59b6-4f1d-aec0-19bc16c23234" containerName="payload-pre-processing" containerID="cri-o://3ec85f5392242451da64900701421e56386f759e1ec64a069106ce1f7abd7378" gracePeriod=30
Sep 10 17:36:27.740415 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.740345    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"
Sep 10 17:36:27.772390 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.772361    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"
Sep 10 17:36:27.812630 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.812597    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzslq\" (UniqueName: \"kubernetes.io/projected/5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc-kube-api-access-fzslq\") pod \"5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc\" (UID: \"5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc\") "
Sep 10 17:36:27.812835 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.812794    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc-plugins-config-volume\") pod \"5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc\" (UID: \"5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc\") "
Sep 10 17:36:27.813161 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.813135    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc" (UID: "5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:36:27.814709 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.814683    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc-kube-api-access-fzslq" (OuterVolumeSpecName: "kube-api-access-fzslq") pod "5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc" (UID: "5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc"). InnerVolumeSpecName "kube-api-access-fzslq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:36:27.913535 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.913457    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnv48\" (UniqueName: \"kubernetes.io/projected/44b83f56-59b6-4f1d-aec0-19bc16c23234-kube-api-access-fnv48\") pod \"44b83f56-59b6-4f1d-aec0-19bc16c23234\" (UID: \"44b83f56-59b6-4f1d-aec0-19bc16c23234\") "
Sep 10 17:36:27.913702 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.913571    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44b83f56-59b6-4f1d-aec0-19bc16c23234-plugins-config-volume\") pod \"44b83f56-59b6-4f1d-aec0-19bc16c23234\" (UID: \"44b83f56-59b6-4f1d-aec0-19bc16c23234\") "
Sep 10 17:36:27.913792 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.913778    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzslq\" (UniqueName: \"kubernetes.io/projected/5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc-kube-api-access-fzslq\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:36:27.913837 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.913794    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:36:27.913935 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.913910    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44b83f56-59b6-4f1d-aec0-19bc16c23234-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44b83f56-59b6-4f1d-aec0-19bc16c23234" (UID: "44b83f56-59b6-4f1d-aec0-19bc16c23234"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:36:27.915541 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:27.915516    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44b83f56-59b6-4f1d-aec0-19bc16c23234-kube-api-access-fnv48" (OuterVolumeSpecName: "kube-api-access-fnv48") pod "44b83f56-59b6-4f1d-aec0-19bc16c23234" (UID: "44b83f56-59b6-4f1d-aec0-19bc16c23234"). InnerVolumeSpecName "kube-api-access-fnv48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:36:28.015325 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.015238    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnv48\" (UniqueName: \"kubernetes.io/projected/44b83f56-59b6-4f1d-aec0-19bc16c23234-kube-api-access-fnv48\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:36:28.015325 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.015270    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44b83f56-59b6-4f1d-aec0-19bc16c23234-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:36:28.371443 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.371410    2576 generic.go:356] "Generic (PLEG): container finished" podID="44b83f56-59b6-4f1d-aec0-19bc16c23234" containerID="3ec85f5392242451da64900701421e56386f759e1ec64a069106ce1f7abd7378" exitCode=0
Sep 10 17:36:28.371623 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.371458    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"
Sep 10 17:36:28.371623 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.371494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m" event={"ID":"44b83f56-59b6-4f1d-aec0-19bc16c23234","Type":"ContainerDied","Data":"3ec85f5392242451da64900701421e56386f759e1ec64a069106ce1f7abd7378"}
Sep 10 17:36:28.371623 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.371550    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m" event={"ID":"44b83f56-59b6-4f1d-aec0-19bc16c23234","Type":"ContainerDied","Data":"66b21e230ca073fc20d2930015040088d7bfe5e57e4dfadc960c0ce1a85af689"}
Sep 10 17:36:28.371623 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.371579    2576 scope.go:117] "RemoveContainer" containerID="3ec85f5392242451da64900701421e56386f759e1ec64a069106ce1f7abd7378"
Sep 10 17:36:28.372954 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.372931    2576 generic.go:356] "Generic (PLEG): container finished" podID="5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc" containerID="0024a84a00090bfb511ec0ffc1e7578f001b3016de94e5e4bc295f66cfc39607" exitCode=0
Sep 10 17:36:28.373083 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.372966    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks" event={"ID":"5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc","Type":"ContainerDied","Data":"0024a84a00090bfb511ec0ffc1e7578f001b3016de94e5e4bc295f66cfc39607"}
Sep 10 17:36:28.373083 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.372973    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"
Sep 10 17:36:28.373083 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.373004    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks" event={"ID":"5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc","Type":"ContainerDied","Data":"34384e594f881c2116c450cdcb7226d68097f2c1c8608b2173019352cbb2d9c5"}
Sep 10 17:36:28.381171 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.380991    2576 scope.go:117] "RemoveContainer" containerID="3ec85f5392242451da64900701421e56386f759e1ec64a069106ce1f7abd7378"
Sep 10 17:36:28.381458 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:36:28.381436    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ec85f5392242451da64900701421e56386f759e1ec64a069106ce1f7abd7378\": container with ID starting with 3ec85f5392242451da64900701421e56386f759e1ec64a069106ce1f7abd7378 not found: ID does not exist" containerID="3ec85f5392242451da64900701421e56386f759e1ec64a069106ce1f7abd7378"
Sep 10 17:36:28.381529 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.381471    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ec85f5392242451da64900701421e56386f759e1ec64a069106ce1f7abd7378"} err="failed to get container status \"3ec85f5392242451da64900701421e56386f759e1ec64a069106ce1f7abd7378\": rpc error: code = NotFound desc = could not find container \"3ec85f5392242451da64900701421e56386f759e1ec64a069106ce1f7abd7378\": container with ID starting with 3ec85f5392242451da64900701421e56386f759e1ec64a069106ce1f7abd7378 not found: ID does not exist"
Sep 10 17:36:28.381529 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.381507    2576 scope.go:117] "RemoveContainer" containerID="0024a84a00090bfb511ec0ffc1e7578f001b3016de94e5e4bc295f66cfc39607"
Sep 10 17:36:28.389878 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.389856    2576 scope.go:117] "RemoveContainer" containerID="0024a84a00090bfb511ec0ffc1e7578f001b3016de94e5e4bc295f66cfc39607"
Sep 10 17:36:28.390205 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:36:28.390186    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0024a84a00090bfb511ec0ffc1e7578f001b3016de94e5e4bc295f66cfc39607\": container with ID starting with 0024a84a00090bfb511ec0ffc1e7578f001b3016de94e5e4bc295f66cfc39607 not found: ID does not exist" containerID="0024a84a00090bfb511ec0ffc1e7578f001b3016de94e5e4bc295f66cfc39607"
Sep 10 17:36:28.390266 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.390212    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0024a84a00090bfb511ec0ffc1e7578f001b3016de94e5e4bc295f66cfc39607"} err="failed to get container status \"0024a84a00090bfb511ec0ffc1e7578f001b3016de94e5e4bc295f66cfc39607\": rpc error: code = NotFound desc = could not find container \"0024a84a00090bfb511ec0ffc1e7578f001b3016de94e5e4bc295f66cfc39607\": container with ID starting with 0024a84a00090bfb511ec0ffc1e7578f001b3016de94e5e4bc295f66cfc39607 not found: ID does not exist"
Sep 10 17:36:28.397499 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.397475    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"]
Sep 10 17:36:28.404369 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.404345    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-2549d0-669ff45bff-rz4ks"]
Sep 10 17:36:28.415598 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.415570    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"]
Sep 10 17:36:28.420929 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:28.420906    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2549d0-59fdd4d954-fc79m"]
Sep 10 17:36:29.088908 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:29.088873    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44b83f56-59b6-4f1d-aec0-19bc16c23234" path="/var/lib/kubelet/pods/44b83f56-59b6-4f1d-aec0-19bc16c23234/volumes"
Sep 10 17:36:29.089304 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:29.089293    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc" path="/var/lib/kubelet/pods/5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc/volumes"
Sep 10 17:36:34.503018 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:34.502985    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"]
Sep 10 17:36:34.503524 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:34.503207    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l" podUID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" containerName="istio-proxy" containerID="cri-o://a326105f4aa7ad652997337b02af6b848150b2242443bac88e3d7b73c41928c9" gracePeriod=30
Sep 10 17:36:34.866321 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:34.866281    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4"]
Sep 10 17:36:34.866661 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:34.866649    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b83f56-59b6-4f1d-aec0-19bc16c23234" containerName="payload-pre-processing"
Sep 10 17:36:34.866709 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:34.866662    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b83f56-59b6-4f1d-aec0-19bc16c23234" containerName="payload-pre-processing"
Sep 10 17:36:34.866709 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:34.866675    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc" containerName="payload-processing"
Sep 10 17:36:34.866709 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:34.866681    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc" containerName="payload-processing"
Sep 10 17:36:34.866805 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:34.866753    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a550e0b-d84e-49e2-b32e-fdcd6b9d1afc" containerName="payload-processing"
Sep 10 17:36:34.866805 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:34.866761    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="44b83f56-59b6-4f1d-aec0-19bc16c23234" containerName="payload-pre-processing"
Sep 10 17:36:34.870876 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:34.870857    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4"
Sep 10 17:36:34.874524 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:34.874501    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 17:36:34.874664 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:34.874542    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4mln5\""
Sep 10 17:36:34.879511 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:34.879486    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4"]
Sep 10 17:36:34.982767 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:34.982722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b894f9-2226-4483-8057-540735c3c9a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4\" (UID: \"c8b894f9-2226-4483-8057-540735c3c9a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4"
Sep 10 17:36:35.083633 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:35.083601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b894f9-2226-4483-8057-540735c3c9a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4\" (UID: \"c8b894f9-2226-4483-8057-540735c3c9a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4"
Sep 10 17:36:35.084441 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:35.084419    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b894f9-2226-4483-8057-540735c3c9a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4\" (UID: \"c8b894f9-2226-4483-8057-540735c3c9a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4"
Sep 10 17:36:35.182897 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:35.182863    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4"
Sep 10 17:36:35.522482 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:35.522397    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4"]
Sep 10 17:36:35.533263 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:36:35.533237    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b894f9_2226_4483_8057_540735c3c9a1.slice/crio-44a3828b2f09108905dbeafbb00ca311407ce624d0d567260c08c4b1ea17b74d WatchSource:0}: Error finding container 44a3828b2f09108905dbeafbb00ca311407ce624d0d567260c08c4b1ea17b74d: Status 404 returned error can't find the container with id 44a3828b2f09108905dbeafbb00ca311407ce624d0d567260c08c4b1ea17b74d
Sep 10 17:36:35.961213 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:35.961171    2576 patch_prober.go:28] interesting pod/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 17:36:35.961394 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:35.961231    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l" podUID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 17:36:36.415445 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:36.415412    2576 generic.go:356] "Generic (PLEG): container finished" podID="c8b894f9-2226-4483-8057-540735c3c9a1" containerID="a273a7d52eb1546207e34a48989aa04dd91eef07337f443ceae69aead4184fef" exitCode=0
Sep 10 17:36:36.415618 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:36.415463    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4" event={"ID":"c8b894f9-2226-4483-8057-540735c3c9a1","Type":"ContainerDied","Data":"a273a7d52eb1546207e34a48989aa04dd91eef07337f443ceae69aead4184fef"}
Sep 10 17:36:36.415618 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:36.415502    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4" event={"ID":"c8b894f9-2226-4483-8057-540735c3c9a1","Type":"ContainerStarted","Data":"44a3828b2f09108905dbeafbb00ca311407ce624d0d567260c08c4b1ea17b74d"}
Sep 10 17:36:37.554357 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:37.554334    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4"
Sep 10 17:36:37.607568 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:37.607533    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b894f9-2226-4483-8057-540735c3c9a1-maas-api-service-ca\") pod \"c8b894f9-2226-4483-8057-540735c3c9a1\" (UID: \"c8b894f9-2226-4483-8057-540735c3c9a1\") "
Sep 10 17:36:37.607938 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:37.607917    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b894f9-2226-4483-8057-540735c3c9a1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c8b894f9-2226-4483-8057-540735c3c9a1" (UID: "c8b894f9-2226-4483-8057-540735c3c9a1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:36:37.708513 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:37.708427    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b894f9-2226-4483-8057-540735c3c9a1-maas-api-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:36:38.426802 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:38.426775    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4"
Sep 10 17:36:38.426981 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:38.426811    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4" event={"ID":"c8b894f9-2226-4483-8057-540735c3c9a1","Type":"ContainerDied","Data":"44a3828b2f09108905dbeafbb00ca311407ce624d0d567260c08c4b1ea17b74d"}
Sep 10 17:36:38.426981 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:38.426862    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44a3828b2f09108905dbeafbb00ca311407ce624d0d567260c08c4b1ea17b74d"
Sep 10 17:36:39.744823 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.744798    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:36:39.825224 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825127    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpxjh\" (UniqueName: \"kubernetes.io/projected/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-kube-api-access-lpxjh\") pod \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") "
Sep 10 17:36:39.825224 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825169    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istiod-ca-cert\") pod \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") "
Sep 10 17:36:39.825224 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825209    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-envoy\") pod \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") "
Sep 10 17:36:39.825501 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825230    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-podinfo\") pod \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") "
Sep 10 17:36:39.825501 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825329    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-workload-certs\") pod \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") "
Sep 10 17:36:39.825501 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825376    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-workload-socket\") pod \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") "
Sep 10 17:36:39.825501 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825409    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-credential-socket\") pod \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") "
Sep 10 17:36:39.825501 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825480    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-data\") pod \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") "
Sep 10 17:36:39.825762 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825504    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-token\") pod \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\" (UID: \"7755e53c-964d-43b4-aa78-fdf0f7eebcfa\") "
Sep 10 17:36:39.825762 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825596    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7755e53c-964d-43b4-aa78-fdf0f7eebcfa" (UID: "7755e53c-964d-43b4-aa78-fdf0f7eebcfa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:36:39.825762 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825648    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7755e53c-964d-43b4-aa78-fdf0f7eebcfa" (UID: "7755e53c-964d-43b4-aa78-fdf0f7eebcfa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:36:39.825762 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825697    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7755e53c-964d-43b4-aa78-fdf0f7eebcfa" (UID: "7755e53c-964d-43b4-aa78-fdf0f7eebcfa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:36:39.825965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825805    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7755e53c-964d-43b4-aa78-fdf0f7eebcfa" (UID: "7755e53c-964d-43b4-aa78-fdf0f7eebcfa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:36:39.825965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825886    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:36:39.825965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825916    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:36:39.825965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825931    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:36:39.825965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825944    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:36:39.825965 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.825885    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-data" (OuterVolumeSpecName: "istio-data") pod "7755e53c-964d-43b4-aa78-fdf0f7eebcfa" (UID: "7755e53c-964d-43b4-aa78-fdf0f7eebcfa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:36:39.827576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.827546    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7755e53c-964d-43b4-aa78-fdf0f7eebcfa" (UID: "7755e53c-964d-43b4-aa78-fdf0f7eebcfa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:36:39.827699 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.827571    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7755e53c-964d-43b4-aa78-fdf0f7eebcfa" (UID: "7755e53c-964d-43b4-aa78-fdf0f7eebcfa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:36:39.827699 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.827592    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-token" (OuterVolumeSpecName: "istio-token") pod "7755e53c-964d-43b4-aa78-fdf0f7eebcfa" (UID: "7755e53c-964d-43b4-aa78-fdf0f7eebcfa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:36:39.827699 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.827573    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-kube-api-access-lpxjh" (OuterVolumeSpecName: "kube-api-access-lpxjh") pod "7755e53c-964d-43b4-aa78-fdf0f7eebcfa" (UID: "7755e53c-964d-43b4-aa78-fdf0f7eebcfa"). InnerVolumeSpecName "kube-api-access-lpxjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:36:39.927339 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.927300    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:36:39.927339 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.927329    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:36:39.927339 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.927337    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:36:39.927339 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.927347    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:36:39.927613 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:39.927356    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpxjh\" (UniqueName: \"kubernetes.io/projected/7755e53c-964d-43b4-aa78-fdf0f7eebcfa-kube-api-access-lpxjh\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:36:40.439445 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:40.439400    2576 generic.go:356] "Generic (PLEG): container finished" podID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" containerID="a326105f4aa7ad652997337b02af6b848150b2242443bac88e3d7b73c41928c9" exitCode=0
Sep 10 17:36:40.439638 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:40.439457    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"
Sep 10 17:36:40.439638 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:40.439481    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l" event={"ID":"7755e53c-964d-43b4-aa78-fdf0f7eebcfa","Type":"ContainerDied","Data":"a326105f4aa7ad652997337b02af6b848150b2242443bac88e3d7b73c41928c9"}
Sep 10 17:36:40.439638 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:40.439546    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l" event={"ID":"7755e53c-964d-43b4-aa78-fdf0f7eebcfa","Type":"ContainerDied","Data":"8ac013a6c406da78423673a2cc43c105e7f52706f6dd0e95ba127222a3dc7ef8"}
Sep 10 17:36:40.439638 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:40.439569    2576 scope.go:117] "RemoveContainer" containerID="a326105f4aa7ad652997337b02af6b848150b2242443bac88e3d7b73c41928c9"
Sep 10 17:36:40.450702 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:40.450684    2576 scope.go:117] "RemoveContainer" containerID="a831679bb0fc4f2e361754aceb46f340db0e3e7c0329e7e554dd0e9492775f7d"
Sep 10 17:36:40.459723 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:40.459703    2576 scope.go:117] "RemoveContainer" containerID="a326105f4aa7ad652997337b02af6b848150b2242443bac88e3d7b73c41928c9"
Sep 10 17:36:40.460009 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:36:40.459985    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a326105f4aa7ad652997337b02af6b848150b2242443bac88e3d7b73c41928c9\": container with ID starting with a326105f4aa7ad652997337b02af6b848150b2242443bac88e3d7b73c41928c9 not found: ID does not exist" containerID="a326105f4aa7ad652997337b02af6b848150b2242443bac88e3d7b73c41928c9"
Sep 10 17:36:40.460129 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:40.460019    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a326105f4aa7ad652997337b02af6b848150b2242443bac88e3d7b73c41928c9"} err="failed to get container status \"a326105f4aa7ad652997337b02af6b848150b2242443bac88e3d7b73c41928c9\": rpc error: code = NotFound desc = could not find container \"a326105f4aa7ad652997337b02af6b848150b2242443bac88e3d7b73c41928c9\": container with ID starting with a326105f4aa7ad652997337b02af6b848150b2242443bac88e3d7b73c41928c9 not found: ID does not exist"
Sep 10 17:36:40.460129 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:40.460039    2576 scope.go:117] "RemoveContainer" containerID="a831679bb0fc4f2e361754aceb46f340db0e3e7c0329e7e554dd0e9492775f7d"
Sep 10 17:36:40.460448 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:36:40.460421    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a831679bb0fc4f2e361754aceb46f340db0e3e7c0329e7e554dd0e9492775f7d\": container with ID starting with a831679bb0fc4f2e361754aceb46f340db0e3e7c0329e7e554dd0e9492775f7d not found: ID does not exist" containerID="a831679bb0fc4f2e361754aceb46f340db0e3e7c0329e7e554dd0e9492775f7d"
Sep 10 17:36:40.460551 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:40.460458    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a831679bb0fc4f2e361754aceb46f340db0e3e7c0329e7e554dd0e9492775f7d"} err="failed to get container status \"a831679bb0fc4f2e361754aceb46f340db0e3e7c0329e7e554dd0e9492775f7d\": rpc error: code = NotFound desc = could not find container \"a831679bb0fc4f2e361754aceb46f340db0e3e7c0329e7e554dd0e9492775f7d\": container with ID starting with a831679bb0fc4f2e361754aceb46f340db0e3e7c0329e7e554dd0e9492775f7d not found: ID does not exist"
Sep 10 17:36:40.462992 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:40.462972    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"]
Sep 10 17:36:40.468428 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:40.468407    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-2549d0-openshift-default-5944fc8648-vtd8l"]
Sep 10 17:36:41.085776 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:41.085739    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" path="/var/lib/kubelet/pods/7755e53c-964d-43b4-aa78-fdf0f7eebcfa/volumes"
Sep 10 17:36:41.101672 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:41.101638    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:36:50.871450 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:50.871419    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4"]
Sep 10 17:36:50.873233 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:50.873194    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-65fac0-nqnd4"]
Sep 10 17:36:51.084961 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:51.084924    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8b894f9-2226-4483-8057-540735c3c9a1" path="/var/lib/kubelet/pods/c8b894f9-2226-4483-8057-540735c3c9a1/volumes"
Sep 10 17:36:56.505775 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:56.505732    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:36:57.716958 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:57.716911    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"]
Sep 10 17:36:57.717472 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:57.717160    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9" podUID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerName="istio-proxy" containerID="cri-o://587c4e0f58fb3496344deb847a37115119d5cc17a4da66fe43747fb2fc839141" gracePeriod=30
Sep 10 17:36:58.077303 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.077212    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq"]
Sep 10 17:36:58.077580 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.077568    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" containerName="istio-proxy"
Sep 10 17:36:58.077633 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.077581    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" containerName="istio-proxy"
Sep 10 17:36:58.077633 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.077591    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" containerName="istio-proxy"
Sep 10 17:36:58.077633 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.077597    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" containerName="istio-proxy"
Sep 10 17:36:58.077633 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.077603    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b894f9-2226-4483-8057-540735c3c9a1" containerName="revoke-keys"
Sep 10 17:36:58.077633 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.077608    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b894f9-2226-4483-8057-540735c3c9a1" containerName="revoke-keys"
Sep 10 17:36:58.077810 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.077688    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" containerName="istio-proxy"
Sep 10 17:36:58.077810 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.077696    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b894f9-2226-4483-8057-540735c3c9a1" containerName="revoke-keys"
Sep 10 17:36:58.077810 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.077703    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7755e53c-964d-43b4-aa78-fdf0f7eebcfa" containerName="istio-proxy"
Sep 10 17:36:58.081790 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.081768    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq"
Sep 10 17:36:58.084350 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.084323    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 17:36:58.084490 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.084416    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4mln5\""
Sep 10 17:36:58.088222 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.088194    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq"]
Sep 10 17:36:58.193884 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.193844    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abdb2072-29f5-4115-9a8a-74a5b2c55d6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq\" (UID: \"abdb2072-29f5-4115-9a8a-74a5b2c55d6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq"
Sep 10 17:36:58.295210 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.295168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abdb2072-29f5-4115-9a8a-74a5b2c55d6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq\" (UID: \"abdb2072-29f5-4115-9a8a-74a5b2c55d6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq"
Sep 10 17:36:58.295805 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.295782    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abdb2072-29f5-4115-9a8a-74a5b2c55d6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq\" (UID: \"abdb2072-29f5-4115-9a8a-74a5b2c55d6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq"
Sep 10 17:36:58.393903 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.393869    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq"
Sep 10 17:36:58.673265 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:58.673205    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq"]
Sep 10 17:36:58.675454 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:36:58.675417    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabdb2072_29f5_4115_9a8a_74a5b2c55d6e.slice/crio-55a6533438a3fac0769d86a544acfa5d58a2b571a597723a46e70acefef3a11f WatchSource:0}: Error finding container 55a6533438a3fac0769d86a544acfa5d58a2b571a597723a46e70acefef3a11f: Status 404 returned error can't find the container with id 55a6533438a3fac0769d86a544acfa5d58a2b571a597723a46e70acefef3a11f
Sep 10 17:36:59.043448 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:59.043350    2576 patch_prober.go:28] interesting pod/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 17:36:59.043448 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:59.043419    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9" podUID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 17:36:59.538494 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:59.538453    2576 generic.go:356] "Generic (PLEG): container finished" podID="abdb2072-29f5-4115-9a8a-74a5b2c55d6e" containerID="a9480c3e5397f3c9c2c917e876b95c1bb8181f2f926f95a8471ca59c7198b3b1" exitCode=0
Sep 10 17:36:59.538692 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:59.538542    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq" event={"ID":"abdb2072-29f5-4115-9a8a-74a5b2c55d6e","Type":"ContainerDied","Data":"a9480c3e5397f3c9c2c917e876b95c1bb8181f2f926f95a8471ca59c7198b3b1"}
Sep 10 17:36:59.538692 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:36:59.538635    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq" event={"ID":"abdb2072-29f5-4115-9a8a-74a5b2c55d6e","Type":"ContainerStarted","Data":"55a6533438a3fac0769d86a544acfa5d58a2b571a597723a46e70acefef3a11f"}
Sep 10 17:37:00.676130 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:00.676105    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq"
Sep 10 17:37:00.818628 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:00.818537    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abdb2072-29f5-4115-9a8a-74a5b2c55d6e-maas-api-service-ca\") pod \"abdb2072-29f5-4115-9a8a-74a5b2c55d6e\" (UID: \"abdb2072-29f5-4115-9a8a-74a5b2c55d6e\") "
Sep 10 17:37:00.818962 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:00.818934    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abdb2072-29f5-4115-9a8a-74a5b2c55d6e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "abdb2072-29f5-4115-9a8a-74a5b2c55d6e" (UID: "abdb2072-29f5-4115-9a8a-74a5b2c55d6e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:37:00.920192 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:00.920154    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abdb2072-29f5-4115-9a8a-74a5b2c55d6e-maas-api-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:01.549041 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:01.549013    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq"
Sep 10 17:37:01.549235 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:01.549070    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq" event={"ID":"abdb2072-29f5-4115-9a8a-74a5b2c55d6e","Type":"ContainerDied","Data":"55a6533438a3fac0769d86a544acfa5d58a2b571a597723a46e70acefef3a11f"}
Sep 10 17:37:01.549235 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:01.549116    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55a6533438a3fac0769d86a544acfa5d58a2b571a597723a46e70acefef3a11f"
Sep 10 17:37:02.971686 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:02.971662    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:37:03.039377 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.039276    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-envoy\") pod \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") "
Sep 10 17:37:03.039377 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.039312    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-workload-socket\") pod \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") "
Sep 10 17:37:03.039377 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.039337    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmbrb\" (UniqueName: \"kubernetes.io/projected/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-kube-api-access-vmbrb\") pod \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") "
Sep 10 17:37:03.039377 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.039354    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istiod-ca-cert\") pod \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") "
Sep 10 17:37:03.039728 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.039381    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-token\") pod \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") "
Sep 10 17:37:03.039728 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.039425    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-workload-certs\") pod \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") "
Sep 10 17:37:03.039728 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.039474    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-podinfo\") pod \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") "
Sep 10 17:37:03.039728 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.039506    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-credential-socket\") pod \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") "
Sep 10 17:37:03.039728 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.039560    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-data\") pod \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\" (UID: \"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5\") "
Sep 10 17:37:03.039998 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.039734    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" (UID: "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:37:03.039998 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.039749    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" (UID: "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:37:03.039998 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.039829    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" (UID: "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:37:03.039998 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.039870    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:03.039998 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.039899    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" (UID: "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:37:03.039998 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.039985    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:03.040274 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.040041    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-data" (OuterVolumeSpecName: "istio-data") pod "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" (UID: "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:37:03.042118 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.042090    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" (UID: "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:37:03.042220 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.042132    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" (UID: "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:37:03.042220 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.042142    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-kube-api-access-vmbrb" (OuterVolumeSpecName: "kube-api-access-vmbrb") pod "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" (UID: "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5"). InnerVolumeSpecName "kube-api-access-vmbrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:37:03.042220 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.042145    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-token" (OuterVolumeSpecName: "istio-token") pod "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" (UID: "6266d8d3-f01e-46dc-8b9a-2d9ca556dec5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:37:03.141405 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.141366    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:03.141405 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.141399    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmbrb\" (UniqueName: \"kubernetes.io/projected/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-kube-api-access-vmbrb\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:03.141405 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.141409    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:03.141405 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.141417    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:03.141672 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.141425    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:03.141672 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.141433    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:03.141672 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.141441    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:03.560783 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.560754    2576 generic.go:356] "Generic (PLEG): container finished" podID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerID="587c4e0f58fb3496344deb847a37115119d5cc17a4da66fe43747fb2fc839141" exitCode=0
Sep 10 17:37:03.560959 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.560801    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"
Sep 10 17:37:03.560959 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.560851    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9" event={"ID":"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5","Type":"ContainerDied","Data":"587c4e0f58fb3496344deb847a37115119d5cc17a4da66fe43747fb2fc839141"}
Sep 10 17:37:03.560959 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.560905    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9" event={"ID":"6266d8d3-f01e-46dc-8b9a-2d9ca556dec5","Type":"ContainerDied","Data":"f7d2cd386c8c3770af2ee1b29a9369aa11a6f981ea0f1f3a55b537188eda5f1b"}
Sep 10 17:37:03.560959 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.560931    2576 scope.go:117] "RemoveContainer" containerID="587c4e0f58fb3496344deb847a37115119d5cc17a4da66fe43747fb2fc839141"
Sep 10 17:37:03.569844 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.569824    2576 scope.go:117] "RemoveContainer" containerID="6f97fb79c219218db4fda70058237f8062d769c4af70ca1468dfcf858cced745"
Sep 10 17:37:03.578494 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.578475    2576 scope.go:117] "RemoveContainer" containerID="587c4e0f58fb3496344deb847a37115119d5cc17a4da66fe43747fb2fc839141"
Sep 10 17:37:03.578856 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:37:03.578829    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"587c4e0f58fb3496344deb847a37115119d5cc17a4da66fe43747fb2fc839141\": container with ID starting with 587c4e0f58fb3496344deb847a37115119d5cc17a4da66fe43747fb2fc839141 not found: ID does not exist" containerID="587c4e0f58fb3496344deb847a37115119d5cc17a4da66fe43747fb2fc839141"
Sep 10 17:37:03.578971 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.578860    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"587c4e0f58fb3496344deb847a37115119d5cc17a4da66fe43747fb2fc839141"} err="failed to get container status \"587c4e0f58fb3496344deb847a37115119d5cc17a4da66fe43747fb2fc839141\": rpc error: code = NotFound desc = could not find container \"587c4e0f58fb3496344deb847a37115119d5cc17a4da66fe43747fb2fc839141\": container with ID starting with 587c4e0f58fb3496344deb847a37115119d5cc17a4da66fe43747fb2fc839141 not found: ID does not exist"
Sep 10 17:37:03.578971 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.578881    2576 scope.go:117] "RemoveContainer" containerID="6f97fb79c219218db4fda70058237f8062d769c4af70ca1468dfcf858cced745"
Sep 10 17:37:03.579270 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:37:03.579248    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f97fb79c219218db4fda70058237f8062d769c4af70ca1468dfcf858cced745\": container with ID starting with 6f97fb79c219218db4fda70058237f8062d769c4af70ca1468dfcf858cced745 not found: ID does not exist" containerID="6f97fb79c219218db4fda70058237f8062d769c4af70ca1468dfcf858cced745"
Sep 10 17:37:03.579355 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.579276    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f97fb79c219218db4fda70058237f8062d769c4af70ca1468dfcf858cced745"} err="failed to get container status \"6f97fb79c219218db4fda70058237f8062d769c4af70ca1468dfcf858cced745\": rpc error: code = NotFound desc = could not find container \"6f97fb79c219218db4fda70058237f8062d769c4af70ca1468dfcf858cced745\": container with ID starting with 6f97fb79c219218db4fda70058237f8062d769c4af70ca1468dfcf858cced745 not found: ID does not exist"
Sep 10 17:37:03.579985 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.579966    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"]
Sep 10 17:37:03.586483 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:03.586459    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-65fac0-openshift-default-767b9867cb-p8lw9"]
Sep 10 17:37:04.154344 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.154298    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"]
Sep 10 17:37:04.154812 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.154795    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerName="istio-proxy"
Sep 10 17:37:04.154860 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.154816    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerName="istio-proxy"
Sep 10 17:37:04.154860 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.154827    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerName="istio-proxy"
Sep 10 17:37:04.154860 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.154836    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerName="istio-proxy"
Sep 10 17:37:04.154860 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.154847    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abdb2072-29f5-4115-9a8a-74a5b2c55d6e" containerName="revoke-keys"
Sep 10 17:37:04.154860 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.154855    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="abdb2072-29f5-4115-9a8a-74a5b2c55d6e" containerName="revoke-keys"
Sep 10 17:37:04.155016 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.154941    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerName="istio-proxy"
Sep 10 17:37:04.155016 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.154953    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="abdb2072-29f5-4115-9a8a-74a5b2c55d6e" containerName="revoke-keys"
Sep 10 17:37:04.155016 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.154962    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" containerName="istio-proxy"
Sep 10 17:37:04.159704 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.159681    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.162005 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.161985    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-437dd7-openshift-default-dockercfg-lknxv\""
Sep 10 17:37:04.170743 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.170712    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"]
Sep 10 17:37:04.254160 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.253480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81376d7d-348c-4113-a21d-c157f74be2fa-istiod-ca-cert\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.254160 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.253595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-istio-envoy\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.254160 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.253655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-credential-socket\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.254160 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.253680    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-workload-certs\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.254160 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.253729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-istio-data\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.254160 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.253771    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81376d7d-348c-4113-a21d-c157f74be2fa-istio-podinfo\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.254160 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.253830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvj46\" (UniqueName: \"kubernetes.io/projected/81376d7d-348c-4113-a21d-c157f74be2fa-kube-api-access-hvj46\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.254160 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.253864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-workload-socket\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.254160 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.253920    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81376d7d-348c-4113-a21d-c157f74be2fa-istio-token\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.354906 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.354862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-istio-envoy\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.354906 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.354911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-credential-socket\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.355186 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.355010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-workload-certs\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.355186 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.355046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-istio-data\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.355186 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.355102    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81376d7d-348c-4113-a21d-c157f74be2fa-istio-podinfo\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.355186 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.355150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvj46\" (UniqueName: \"kubernetes.io/projected/81376d7d-348c-4113-a21d-c157f74be2fa-kube-api-access-hvj46\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.355186 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.355171    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-workload-socket\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.355468 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.355191    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81376d7d-348c-4113-a21d-c157f74be2fa-istio-token\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.355468 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.355403    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-credential-socket\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.355468 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.355417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81376d7d-348c-4113-a21d-c157f74be2fa-istiod-ca-cert\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.355633 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.355463    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-istio-data\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.355633 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.355511    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-workload-certs\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.355765 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.355743    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-workload-socket\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.356075 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.356027    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81376d7d-348c-4113-a21d-c157f74be2fa-istiod-ca-cert\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.357239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.357211    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-istio-envoy\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.357669 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.357652    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81376d7d-348c-4113-a21d-c157f74be2fa-istio-podinfo\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.364499 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.364473    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81376d7d-348c-4113-a21d-c157f74be2fa-istio-token\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.364644 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.364612    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvj46\" (UniqueName: \"kubernetes.io/projected/81376d7d-348c-4113-a21d-c157f74be2fa-kube-api-access-hvj46\") pod \"e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") " pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.470845 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.470759    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:04.749600 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.749572    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"]
Sep 10 17:37:04.751954 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:37:04.751927    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81376d7d_348c_4113_a21d_c157f74be2fa.slice/crio-858752ebc2bcc54e9f28a65cfc20f150da5efdc22c64db5fade7adc5ed4719c7 WatchSource:0}: Error finding container 858752ebc2bcc54e9f28a65cfc20f150da5efdc22c64db5fade7adc5ed4719c7: Status 404 returned error can't find the container with id 858752ebc2bcc54e9f28a65cfc20f150da5efdc22c64db5fade7adc5ed4719c7
Sep 10 17:37:04.754222 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.754185    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:37:04.754300 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.754269    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:37:04.754337 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:04.754309    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:37:05.085353 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:05.085269    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6266d8d3-f01e-46dc-8b9a-2d9ca556dec5" path="/var/lib/kubelet/pods/6266d8d3-f01e-46dc-8b9a-2d9ca556dec5/volumes"
Sep 10 17:37:05.573588 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:05.573546    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x" event={"ID":"81376d7d-348c-4113-a21d-c157f74be2fa","Type":"ContainerStarted","Data":"a1dca09b0dbe944efa115656233b01b90e56c005d4f85a70528b973ce72c522f"}
Sep 10 17:37:05.573986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:05.573612    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x" event={"ID":"81376d7d-348c-4113-a21d-c157f74be2fa","Type":"ContainerStarted","Data":"858752ebc2bcc54e9f28a65cfc20f150da5efdc22c64db5fade7adc5ed4719c7"}
Sep 10 17:37:05.594204 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:05.594144    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x" podStartSLOduration=1.594119697 podStartE2EDuration="1.594119697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:37:05.591790894 +0000 UTC m=+1511.007841841" watchObservedRunningTime="2026-09-10 17:37:05.594119697 +0000 UTC m=+1511.010170647"
Sep 10 17:37:06.472004 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:06.471963    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:06.477392 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:06.477363    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:06.579003 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:06.578972    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:06.579969 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:06.579948    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:09.128730 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:09.125148    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq"]
Sep 10 17:37:09.132550 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:09.132524    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-33b7bb-gg8qq"]
Sep 10 17:37:09.704501 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:09.704465    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:37:09.962042 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:09.961945    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"]
Sep 10 17:37:09.966996 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:09.966971    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"
Sep 10 17:37:09.969389 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:09.969365    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-437dd7\""
Sep 10 17:37:09.981705 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:09.981679    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"]
Sep 10 17:37:10.110652 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:10.110600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c99df300-6a3f-476a-b996-c4c035b20e00-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc\" (UID: \"c99df300-6a3f-476a-b996-c4c035b20e00\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"
Sep 10 17:37:10.110857 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:10.110678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd66n\" (UniqueName: \"kubernetes.io/projected/c99df300-6a3f-476a-b996-c4c035b20e00-kube-api-access-nd66n\") pod \"payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc\" (UID: \"c99df300-6a3f-476a-b996-c4c035b20e00\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"
Sep 10 17:37:10.211545 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:10.211507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c99df300-6a3f-476a-b996-c4c035b20e00-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc\" (UID: \"c99df300-6a3f-476a-b996-c4c035b20e00\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"
Sep 10 17:37:10.211545 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:10.211558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd66n\" (UniqueName: \"kubernetes.io/projected/c99df300-6a3f-476a-b996-c4c035b20e00-kube-api-access-nd66n\") pod \"payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc\" (UID: \"c99df300-6a3f-476a-b996-c4c035b20e00\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"
Sep 10 17:37:10.212464 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:10.212402    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c99df300-6a3f-476a-b996-c4c035b20e00-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc\" (UID: \"c99df300-6a3f-476a-b996-c4c035b20e00\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"
Sep 10 17:37:10.221096 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:10.221046    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd66n\" (UniqueName: \"kubernetes.io/projected/c99df300-6a3f-476a-b996-c4c035b20e00-kube-api-access-nd66n\") pod \"payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc\" (UID: \"c99df300-6a3f-476a-b996-c4c035b20e00\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"
Sep 10 17:37:10.278222 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:10.278183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"
Sep 10 17:37:10.557222 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:10.557194    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"]
Sep 10 17:37:10.559148 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:37:10.559115    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99df300_6a3f_476a_b996_c4c035b20e00.slice/crio-6f6cff4eb462c2976f51bd41cfe6acab7c5cb488b71d1f5abce2ea692a5bc9cd WatchSource:0}: Error finding container 6f6cff4eb462c2976f51bd41cfe6acab7c5cb488b71d1f5abce2ea692a5bc9cd: Status 404 returned error can't find the container with id 6f6cff4eb462c2976f51bd41cfe6acab7c5cb488b71d1f5abce2ea692a5bc9cd
Sep 10 17:37:10.603220 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:10.603133    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc" event={"ID":"c99df300-6a3f-476a-b996-c4c035b20e00","Type":"ContainerStarted","Data":"6f6cff4eb462c2976f51bd41cfe6acab7c5cb488b71d1f5abce2ea692a5bc9cd"}
Sep 10 17:37:11.086580 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:11.086547    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abdb2072-29f5-4115-9a8a-74a5b2c55d6e" path="/var/lib/kubelet/pods/abdb2072-29f5-4115-9a8a-74a5b2c55d6e/volumes"
Sep 10 17:37:11.609486 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:11.609450    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc" event={"ID":"c99df300-6a3f-476a-b996-c4c035b20e00","Type":"ContainerStarted","Data":"26dbab160178324604bf192dd5ee999b19c32095588b129e162fbe973ba9abfb"}
Sep 10 17:37:11.609945 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:11.609550    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"
Sep 10 17:37:11.629960 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:11.629906    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc" podStartSLOduration=2.629886923 podStartE2EDuration="2.629886923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:37:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:37:11.627828683 +0000 UTC m=+1517.043879633" watchObservedRunningTime="2026-09-10 17:37:11.629886923 +0000 UTC m=+1517.045937872"
Sep 10 17:37:15.404459 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:15.404425    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"]
Sep 10 17:37:15.404897 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:15.404675    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd" podUID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" containerName="istio-proxy" containerID="cri-o://14253760048bfca23e01f42c6bc1e20275009539c039b7188831d1ad5c7232b2" gracePeriod=30
Sep 10 17:37:20.656716 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.656685    2576 generic.go:356] "Generic (PLEG): container finished" podID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" containerID="14253760048bfca23e01f42c6bc1e20275009539c039b7188831d1ad5c7232b2" exitCode=0
Sep 10 17:37:20.657095 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.656724    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd" event={"ID":"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4","Type":"ContainerDied","Data":"14253760048bfca23e01f42c6bc1e20275009539c039b7188831d1ad5c7232b2"}
Sep 10 17:37:20.657095 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.656793    2576 scope.go:117] "RemoveContainer" containerID="cdc3c58417f6e75c934a04608c7dac3658783d5d7e669b3dd25d72193c087589"
Sep 10 17:37:20.671222 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:37:20.671192    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdc3c58417f6e75c934a04608c7dac3658783d5d7e669b3dd25d72193c087589\": container with ID starting with cdc3c58417f6e75c934a04608c7dac3658783d5d7e669b3dd25d72193c087589 not found: ID does not exist" containerID="cdc3c58417f6e75c934a04608c7dac3658783d5d7e669b3dd25d72193c087589"
Sep 10 17:37:20.674683 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.674660    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:37:20.713296 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.713257    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istiod-ca-cert\") pod \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") "
Sep 10 17:37:20.713467 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.713311    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-podinfo\") pod \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") "
Sep 10 17:37:20.713467 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.713368    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-credential-socket\") pod \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") "
Sep 10 17:37:20.713467 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.713411    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-workload-certs\") pod \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") "
Sep 10 17:37:20.713467 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.713450    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-envoy\") pod \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") "
Sep 10 17:37:20.713625 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.713480    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmpm4\" (UniqueName: \"kubernetes.io/projected/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-kube-api-access-jmpm4\") pod \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") "
Sep 10 17:37:20.713625 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.713534    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-workload-socket\") pod \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") "
Sep 10 17:37:20.713625 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.713567    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-token\") pod \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") "
Sep 10 17:37:20.713625 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.713598    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-data\") pod \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\" (UID: \"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4\") "
Sep 10 17:37:20.713625 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.713608    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" (UID: "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:37:20.713877 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.713669    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" (UID: "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:37:20.713877 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.713754    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" (UID: "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:37:20.713996 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.713930    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:20.713996 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.713950    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:20.713996 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.713963    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:20.714327 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.714284    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" (UID: "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:37:20.714599 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.714571    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" (UID: "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:37:20.715995 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.715965    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" (UID: "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:37:20.716137 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.716108    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" (UID: "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:37:20.716225 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.716206    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" (UID: "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:37:20.716380 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.716362    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-kube-api-access-jmpm4" (OuterVolumeSpecName: "kube-api-access-jmpm4") pod "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" (UID: "92cd8f50-b364-4ed4-b6b1-fd986ffe00a4"). InnerVolumeSpecName "kube-api-access-jmpm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:37:20.814658 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.814619    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:20.814658 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.814660    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:20.814658 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.814670    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:20.814894 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.814678    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:20.814894 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.814690    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:20.814894 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:20.814698    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmpm4\" (UniqueName: \"kubernetes.io/projected/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4-kube-api-access-jmpm4\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:21.663548 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:21.663518    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"
Sep 10 17:37:21.663969 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:21.663517    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd" event={"ID":"92cd8f50-b364-4ed4-b6b1-fd986ffe00a4","Type":"ContainerDied","Data":"bfd08a72ec979bbe91c9c449903981905125c04428b3d1250029d50fcf79088d"}
Sep 10 17:37:21.663969 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:21.663648    2576 scope.go:117] "RemoveContainer" containerID="14253760048bfca23e01f42c6bc1e20275009539c039b7188831d1ad5c7232b2"
Sep 10 17:37:21.684037 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:21.683995    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"]
Sep 10 17:37:21.688278 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:21.688249    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-33b7bb-openshift-default-5785554488-d7xjd"]
Sep 10 17:37:22.616748 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:22.616716    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"
Sep 10 17:37:23.087742 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:23.087700    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" path="/var/lib/kubelet/pods/92cd8f50-b364-4ed4-b6b1-fd986ffe00a4/volumes"
Sep 10 17:37:25.903801 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:25.903628    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:37:28.702800 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:28.702765    2576 generic.go:356] "Generic (PLEG): container finished" podID="81376d7d-348c-4113-a21d-c157f74be2fa" containerID="a1dca09b0dbe944efa115656233b01b90e56c005d4f85a70528b973ce72c522f" exitCode=0
Sep 10 17:37:28.703285 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:28.702808    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x" event={"ID":"81376d7d-348c-4113-a21d-c157f74be2fa","Type":"ContainerDied","Data":"a1dca09b0dbe944efa115656233b01b90e56c005d4f85a70528b973ce72c522f"}
Sep 10 17:37:28.703285 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:28.703201    2576 scope.go:117] "RemoveContainer" containerID="a1dca09b0dbe944efa115656233b01b90e56c005d4f85a70528b973ce72c522f"
Sep 10 17:37:28.704259 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:28.704224    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:37:28.704383 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:28.704298    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:37:28.704383 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:28.704331    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:37:29.710453 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:29.710416    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x" event={"ID":"81376d7d-348c-4113-a21d-c157f74be2fa","Type":"ContainerStarted","Data":"92a835f997cec3b7246fd5e0308739ff9a795a17136545d14624653af54b907e"}
Sep 10 17:37:30.471521 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:30.471480    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:30.471743 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:30.471722    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 17:37:30.471797 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:30.471769    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x" podUID="81376d7d-348c-4113-a21d-c157f74be2fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 17:37:31.472213 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:31.472173    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 17:37:31.472606 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:31.472229    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x" podUID="81376d7d-348c-4113-a21d-c157f74be2fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 17:37:32.471437 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:32.471399    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 17:37:32.471622 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:32.471459    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x" podUID="81376d7d-348c-4113-a21d-c157f74be2fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 17:37:33.310291 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.310256    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"]
Sep 10 17:37:33.311016 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.310982    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx" podUID="7887549b-2c5c-4a91-b7b0-d4b799704e84" containerName="istio-proxy" containerID="cri-o://8dadaf547f3231ab414278d853f343271ebd4b741475c4abb600f72c33cef666" gracePeriod=30
Sep 10 17:37:33.377076 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.377023    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"]
Sep 10 17:37:33.377412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.377398    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" containerName="istio-proxy"
Sep 10 17:37:33.377491 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.377415    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" containerName="istio-proxy"
Sep 10 17:37:33.377491 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.377435    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" containerName="istio-proxy"
Sep 10 17:37:33.377491 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.377444    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" containerName="istio-proxy"
Sep 10 17:37:33.377654 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.377527    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" containerName="istio-proxy"
Sep 10 17:37:33.377654 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.377543    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="92cd8f50-b364-4ed4-b6b1-fd986ffe00a4" containerName="istio-proxy"
Sep 10 17:37:33.392370 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.392341    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.397072 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.397027    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"]
Sep 10 17:37:33.397308 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.397228    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-777ae3-openshift-default-dockercfg-x75gg\""
Sep 10 17:37:33.431158 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.431129    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istiod-ca-cert\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.431158 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.431161    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-podinfo\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.431389 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.431196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh6bk\" (UniqueName: \"kubernetes.io/projected/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-kube-api-access-fh6bk\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.431389 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.431326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-credential-socket\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.431389 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.431381    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-workload-socket\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.431523 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.431424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-data\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.431523 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.431491    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-token\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.431605 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.431525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-workload-certs\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.431605 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.431571    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-envoy\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.471273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.471239    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 17:37:33.471466 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.471318    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x" podUID="81376d7d-348c-4113-a21d-c157f74be2fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 17:37:33.532689 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.532649    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-podinfo\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.532909 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.532718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh6bk\" (UniqueName: \"kubernetes.io/projected/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-kube-api-access-fh6bk\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.532909 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.532768    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-credential-socket\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.532909 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.532800    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-workload-socket\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.532909 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.532835    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-data\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.532909 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.532878    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-token\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.532909 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.532900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-workload-certs\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.533555 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.533009    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-envoy\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.533555 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.533042    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istiod-ca-cert\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.533555 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.533278    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-credential-socket\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.533555 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.533333    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-data\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.533555 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.533374    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-workload-socket\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.533555 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.533426    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-workload-certs\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.533866 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.533787    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istiod-ca-cert\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.535342 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.535320    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-envoy\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.535455 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.535437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-podinfo\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.540420 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.540394    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-token\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.540534 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.540478    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh6bk\" (UniqueName: \"kubernetes.io/projected/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-kube-api-access-fh6bk\") pod \"e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") " pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.716015 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.715980    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:33.996099 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:33.995924    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"]
Sep 10 17:37:34.007797 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:37:34.007764    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad643e5d_7889_4a9c_bb57_5130d3f5c40e.slice/crio-162fc76446fa70ffeb2306bceba05f08f7bf2cd6e7d8c08d7a6561fd6fd18292 WatchSource:0}: Error finding container 162fc76446fa70ffeb2306bceba05f08f7bf2cd6e7d8c08d7a6561fd6fd18292: Status 404 returned error can't find the container with id 162fc76446fa70ffeb2306bceba05f08f7bf2cd6e7d8c08d7a6561fd6fd18292
Sep 10 17:37:34.010172 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:34.010138    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:37:34.010293 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:34.010224    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:37:34.010293 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:34.010273    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:37:34.471532 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:34.471500    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 10 17:37:34.471874 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:34.471564    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x" podUID="81376d7d-348c-4113-a21d-c157f74be2fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 10 17:37:34.737117 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:34.737078    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" event={"ID":"ad643e5d-7889-4a9c-bb57-5130d3f5c40e","Type":"ContainerStarted","Data":"60d1ff0cf9bb5c2a79a17708f06e44450843405ab9e48555871e0ff2a08d7b13"}
Sep 10 17:37:34.737341 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:34.737140    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" event={"ID":"ad643e5d-7889-4a9c-bb57-5130d3f5c40e","Type":"ContainerStarted","Data":"162fc76446fa70ffeb2306bceba05f08f7bf2cd6e7d8c08d7a6561fd6fd18292"}
Sep 10 17:37:34.758959 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:34.758873    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" podStartSLOduration=1.758846706 podStartE2EDuration="1.758846706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:37:34.757867121 +0000 UTC m=+1540.173918070" watchObservedRunningTime="2026-09-10 17:37:34.758846706 +0000 UTC m=+1540.174897656"
Sep 10 17:37:35.475855 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:35.475821    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:35.476291 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:35.476272    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:35.476886 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:35.476869    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:37:35.716883 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:35.716845    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:35.722303 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:35.722278    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:35.746132 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:35.745872    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:35.749161 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:35.749131    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:36.493769 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:36.493734    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:37:38.574950 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.574920    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:37:38.681320 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.681289    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-workload-certs\") pod \"7887549b-2c5c-4a91-b7b0-d4b799704e84\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") "
Sep 10 17:37:38.681527 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.681332    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-token\") pod \"7887549b-2c5c-4a91-b7b0-d4b799704e84\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") "
Sep 10 17:37:38.681527 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.681402    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-envoy\") pod \"7887549b-2c5c-4a91-b7b0-d4b799704e84\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") "
Sep 10 17:37:38.681527 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.681419    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-podinfo\") pod \"7887549b-2c5c-4a91-b7b0-d4b799704e84\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") "
Sep 10 17:37:38.681527 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.681434    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7887549b-2c5c-4a91-b7b0-d4b799704e84-istiod-ca-cert\") pod \"7887549b-2c5c-4a91-b7b0-d4b799704e84\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") "
Sep 10 17:37:38.681527 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.681464    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-workload-socket\") pod \"7887549b-2c5c-4a91-b7b0-d4b799704e84\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") "
Sep 10 17:37:38.681527 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.681513    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-credential-socket\") pod \"7887549b-2c5c-4a91-b7b0-d4b799704e84\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") "
Sep 10 17:37:38.681868 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.681554    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-data\") pod \"7887549b-2c5c-4a91-b7b0-d4b799704e84\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") "
Sep 10 17:37:38.681868 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.681611    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lh4n\" (UniqueName: \"kubernetes.io/projected/7887549b-2c5c-4a91-b7b0-d4b799704e84-kube-api-access-8lh4n\") pod \"7887549b-2c5c-4a91-b7b0-d4b799704e84\" (UID: \"7887549b-2c5c-4a91-b7b0-d4b799704e84\") "
Sep 10 17:37:38.681868 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.681618    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7887549b-2c5c-4a91-b7b0-d4b799704e84" (UID: "7887549b-2c5c-4a91-b7b0-d4b799704e84"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:37:38.681868 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.681835    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7887549b-2c5c-4a91-b7b0-d4b799704e84" (UID: "7887549b-2c5c-4a91-b7b0-d4b799704e84"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:37:38.682089 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.681973    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:38.682089 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.681999    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:38.682208 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.682126    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7887549b-2c5c-4a91-b7b0-d4b799704e84-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7887549b-2c5c-4a91-b7b0-d4b799704e84" (UID: "7887549b-2c5c-4a91-b7b0-d4b799704e84"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:37:38.682266 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.682198    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7887549b-2c5c-4a91-b7b0-d4b799704e84" (UID: "7887549b-2c5c-4a91-b7b0-d4b799704e84"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:37:38.682334 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.682276    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-data" (OuterVolumeSpecName: "istio-data") pod "7887549b-2c5c-4a91-b7b0-d4b799704e84" (UID: "7887549b-2c5c-4a91-b7b0-d4b799704e84"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:37:38.683754 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.683727    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7887549b-2c5c-4a91-b7b0-d4b799704e84" (UID: "7887549b-2c5c-4a91-b7b0-d4b799704e84"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:37:38.684263 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.684236    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7887549b-2c5c-4a91-b7b0-d4b799704e84" (UID: "7887549b-2c5c-4a91-b7b0-d4b799704e84"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:37:38.684369 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.684303    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-token" (OuterVolumeSpecName: "istio-token") pod "7887549b-2c5c-4a91-b7b0-d4b799704e84" (UID: "7887549b-2c5c-4a91-b7b0-d4b799704e84"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:37:38.684369 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.684329    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7887549b-2c5c-4a91-b7b0-d4b799704e84-kube-api-access-8lh4n" (OuterVolumeSpecName: "kube-api-access-8lh4n") pod "7887549b-2c5c-4a91-b7b0-d4b799704e84" (UID: "7887549b-2c5c-4a91-b7b0-d4b799704e84"). InnerVolumeSpecName "kube-api-access-8lh4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:37:38.760735 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.760699    2576 generic.go:356] "Generic (PLEG): container finished" podID="7887549b-2c5c-4a91-b7b0-d4b799704e84" containerID="8dadaf547f3231ab414278d853f343271ebd4b741475c4abb600f72c33cef666" exitCode=0
Sep 10 17:37:38.760933 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.760768    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"
Sep 10 17:37:38.760933 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.760779    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx" event={"ID":"7887549b-2c5c-4a91-b7b0-d4b799704e84","Type":"ContainerDied","Data":"8dadaf547f3231ab414278d853f343271ebd4b741475c4abb600f72c33cef666"}
Sep 10 17:37:38.760933 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.760831    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx" event={"ID":"7887549b-2c5c-4a91-b7b0-d4b799704e84","Type":"ContainerDied","Data":"5fadcc0cf80e51d7644fd619cddcfcc3eae70b6e64a2e1b48f8bfcc7743b499e"}
Sep 10 17:37:38.760933 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.760852    2576 scope.go:117] "RemoveContainer" containerID="8dadaf547f3231ab414278d853f343271ebd4b741475c4abb600f72c33cef666"
Sep 10 17:37:38.769948 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.769927    2576 scope.go:117] "RemoveContainer" containerID="6ef058ded20e70f34fd9593dd48c5118aacc634fec07378bd230d8605c8a2f28"
Sep 10 17:37:38.778110 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.778091    2576 scope.go:117] "RemoveContainer" containerID="8dadaf547f3231ab414278d853f343271ebd4b741475c4abb600f72c33cef666"
Sep 10 17:37:38.778398 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:37:38.778378    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dadaf547f3231ab414278d853f343271ebd4b741475c4abb600f72c33cef666\": container with ID starting with 8dadaf547f3231ab414278d853f343271ebd4b741475c4abb600f72c33cef666 not found: ID does not exist" containerID="8dadaf547f3231ab414278d853f343271ebd4b741475c4abb600f72c33cef666"
Sep 10 17:37:38.778438 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.778407    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dadaf547f3231ab414278d853f343271ebd4b741475c4abb600f72c33cef666"} err="failed to get container status \"8dadaf547f3231ab414278d853f343271ebd4b741475c4abb600f72c33cef666\": rpc error: code = NotFound desc = could not find container \"8dadaf547f3231ab414278d853f343271ebd4b741475c4abb600f72c33cef666\": container with ID starting with 8dadaf547f3231ab414278d853f343271ebd4b741475c4abb600f72c33cef666 not found: ID does not exist"
Sep 10 17:37:38.778438 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.778426    2576 scope.go:117] "RemoveContainer" containerID="6ef058ded20e70f34fd9593dd48c5118aacc634fec07378bd230d8605c8a2f28"
Sep 10 17:37:38.778691 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:37:38.778671    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ef058ded20e70f34fd9593dd48c5118aacc634fec07378bd230d8605c8a2f28\": container with ID starting with 6ef058ded20e70f34fd9593dd48c5118aacc634fec07378bd230d8605c8a2f28 not found: ID does not exist" containerID="6ef058ded20e70f34fd9593dd48c5118aacc634fec07378bd230d8605c8a2f28"
Sep 10 17:37:38.778762 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.778698    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef058ded20e70f34fd9593dd48c5118aacc634fec07378bd230d8605c8a2f28"} err="failed to get container status \"6ef058ded20e70f34fd9593dd48c5118aacc634fec07378bd230d8605c8a2f28\": rpc error: code = NotFound desc = could not find container \"6ef058ded20e70f34fd9593dd48c5118aacc634fec07378bd230d8605c8a2f28\": container with ID starting with 6ef058ded20e70f34fd9593dd48c5118aacc634fec07378bd230d8605c8a2f28 not found: ID does not exist"
Sep 10 17:37:38.783459 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.783411    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:38.783459 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.783440    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:38.783459 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.783459    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lh4n\" (UniqueName: \"kubernetes.io/projected/7887549b-2c5c-4a91-b7b0-d4b799704e84-kube-api-access-8lh4n\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:38.783643 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.783473    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:38.783643 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.783484    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:38.783643 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.783495    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7887549b-2c5c-4a91-b7b0-d4b799704e84-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:38.783643 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.783506    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7887549b-2c5c-4a91-b7b0-d4b799704e84-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:37:38.785351 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.785330    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"]
Sep 10 17:37:38.789260 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:38.789239    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx"]
Sep 10 17:37:39.085410 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:39.085330    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7887549b-2c5c-4a91-b7b0-d4b799704e84" path="/var/lib/kubelet/pods/7887549b-2c5c-4a91-b7b0-d4b799704e84/volumes"
Sep 10 17:37:39.482972 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:39.482924    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 17:37:39.483195 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:39.483006    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-edbcb5-openshift-default-75c74cdb98-khwbx" podUID="7887549b-2c5c-4a91-b7b0-d4b799704e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 17:37:48.512231 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:48.512192    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:37:51.787239 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:51.787190    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 17:37:51.787708 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:51.787262    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 17:37:53.849776 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:53.849735    2576 generic.go:356] "Generic (PLEG): container finished" podID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerID="60d1ff0cf9bb5c2a79a17708f06e44450843405ab9e48555871e0ff2a08d7b13" exitCode=0
Sep 10 17:37:53.850217 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:53.849807    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" event={"ID":"ad643e5d-7889-4a9c-bb57-5130d3f5c40e","Type":"ContainerDied","Data":"60d1ff0cf9bb5c2a79a17708f06e44450843405ab9e48555871e0ff2a08d7b13"}
Sep 10 17:37:53.850217 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:53.850206    2576 scope.go:117] "RemoveContainer" containerID="60d1ff0cf9bb5c2a79a17708f06e44450843405ab9e48555871e0ff2a08d7b13"
Sep 10 17:37:53.851245 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:53.851220    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:37:53.851334 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:53.851282    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:37:53.851334 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:53.851312    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:37:54.856896 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:54.856865    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" event={"ID":"ad643e5d-7889-4a9c-bb57-5130d3f5c40e","Type":"ContainerStarted","Data":"3ce091082ba3b87509a5cba08cce6d57b9aab68eff195689145108009fc75830"}
Sep 10 17:37:55.716875 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:55.716832    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:37:55.717096 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:55.717042    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 10 17:37:55.717164 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:55.717130    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 10 17:37:56.717451 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:56.717413    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 10 17:37:56.717855 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:56.717473    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 10 17:37:57.717268 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:57.717233    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 10 17:37:57.717435 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:57.717288    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 10 17:37:58.717039 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:58.716997    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 10 17:37:58.717498 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:58.717073    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 10 17:37:59.716367 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:59.716330    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 10 17:37:59.716549 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:37:59.716394    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 10 17:38:00.717247 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:00.717205    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 10 17:38:00.717634 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:00.717264    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 10 17:38:01.720261 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:01.720231    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:38:01.720645 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:01.720576    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:38:01.721334 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:01.721315    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:38:27.919349 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:27.919310    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:38:46.208773 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:46.208737    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:38:53.355245 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.355171    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"]
Sep 10 17:38:53.355601 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.355530    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7887549b-2c5c-4a91-b7b0-d4b799704e84" containerName="istio-proxy"
Sep 10 17:38:53.355601 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.355542    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7887549b-2c5c-4a91-b7b0-d4b799704e84" containerName="istio-proxy"
Sep 10 17:38:53.355601 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.355552    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7887549b-2c5c-4a91-b7b0-d4b799704e84" containerName="istio-proxy"
Sep 10 17:38:53.355601 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.355558    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7887549b-2c5c-4a91-b7b0-d4b799704e84" containerName="istio-proxy"
Sep 10 17:38:53.355737 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.355623    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7887549b-2c5c-4a91-b7b0-d4b799704e84" containerName="istio-proxy"
Sep 10 17:38:53.355737 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.355631    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7887549b-2c5c-4a91-b7b0-d4b799704e84" containerName="istio-proxy"
Sep 10 17:38:53.357640 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.357625    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.359948 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.359928    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-5eebb3-openshift-default-dockercfg-llv57\""
Sep 10 17:38:53.370096 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.370042    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"]
Sep 10 17:38:53.461418 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.460256    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-workload-socket\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.461418 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.460305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-credential-socket\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.461418 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.460339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-podinfo\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.461418 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.460365    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-workload-certs\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.461418 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.460472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-token\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.461418 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.460611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.461418 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.460649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-envoy\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.461418 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.460684    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cc6p\" (UniqueName: \"kubernetes.io/projected/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-kube-api-access-5cc6p\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.461418 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.460718    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-data\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.561357 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.561319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-workload-certs\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.561544 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.561390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-token\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.561544 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.561418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.561544 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.561436    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-envoy\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.561544 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.561457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cc6p\" (UniqueName: \"kubernetes.io/projected/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-kube-api-access-5cc6p\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.561544 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.561478    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-data\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.561806 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.561643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-workload-socket\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.561806 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.561692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-credential-socket\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.561806 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.561739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-podinfo\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.562013 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.561817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-workload-certs\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.562013 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.561887    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-data\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.562013 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.561966    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-workload-socket\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.562229 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.562193    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-credential-socket\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.562273 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.562232    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.563721 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.563700    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-envoy\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.564065 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.564030    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-podinfo\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.577397 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.577367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-token\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.578370 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.578348    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cc6p\" (UniqueName: \"kubernetes.io/projected/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-kube-api-access-5cc6p\") pod \"e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") " pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.668458 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.668420    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:53.961681 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.961605    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"]
Sep 10 17:38:53.966854 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:38:53.966825    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a25668e_0d10_4e1c_bab3_5d1bf3f178b2.slice/crio-55cdb6440681112e7f30a87e95c1d4b4903c56838fae43dea07ce1229e41bff7 WatchSource:0}: Error finding container 55cdb6440681112e7f30a87e95c1d4b4903c56838fae43dea07ce1229e41bff7: Status 404 returned error can't find the container with id 55cdb6440681112e7f30a87e95c1d4b4903c56838fae43dea07ce1229e41bff7
Sep 10 17:38:53.969080 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.969025    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:38:53.969171 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.969105    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:38:53.969171 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:53.969147    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:38:54.159430 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:54.159395    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h" event={"ID":"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2","Type":"ContainerStarted","Data":"2806544b9d2b0b060c93f7ecf246069c455e049dda9942fb379111bbeac572a6"}
Sep 10 17:38:54.159580 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:54.159457    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h" event={"ID":"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2","Type":"ContainerStarted","Data":"55cdb6440681112e7f30a87e95c1d4b4903c56838fae43dea07ce1229e41bff7"}
Sep 10 17:38:54.183729 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:54.183681    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h" podStartSLOduration=1.183662857 podStartE2EDuration="1.183662857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:38:54.182570357 +0000 UTC m=+1619.598621352" watchObservedRunningTime="2026-09-10 17:38:54.183662857 +0000 UTC m=+1619.599713809"
Sep 10 17:38:54.669333 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:54.669293    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:55.674198 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:55.674158    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:56.170195 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:56.170163    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:38:56.171020 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:38:56.170997    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:39:06.912208 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:06.912169    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:39:17.277356 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:17.277322    2576 generic.go:356] "Generic (PLEG): container finished" podID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" containerID="2806544b9d2b0b060c93f7ecf246069c455e049dda9942fb379111bbeac572a6" exitCode=0
Sep 10 17:39:17.277787 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:17.277372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h" event={"ID":"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2","Type":"ContainerDied","Data":"2806544b9d2b0b060c93f7ecf246069c455e049dda9942fb379111bbeac572a6"}
Sep 10 17:39:17.277787 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:17.277733    2576 scope.go:117] "RemoveContainer" containerID="2806544b9d2b0b060c93f7ecf246069c455e049dda9942fb379111bbeac572a6"
Sep 10 17:39:17.278933 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:17.278902    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:39:17.278992 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:17.278975    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:39:17.279029 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:17.279007    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 17:39:18.286452 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:18.286408    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h" event={"ID":"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2","Type":"ContainerStarted","Data":"29cce957f1eb703f55617b3e8bf653428f86828749173cb87c7e6ad6a78a2b26"}
Sep 10 17:39:18.669213 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:18.669171    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:39:18.669463 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:18.669439    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 17:39:18.669551 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:18.669497    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h" podUID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 17:39:19.669835 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:19.669788    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 17:39:19.670268 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:19.669853    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h" podUID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 17:39:20.668857 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:20.668818    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 17:39:20.669036 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:20.668899    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h" podUID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 17:39:21.669483 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:21.669447    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 17:39:21.669895 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:21.669517    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h" podUID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 17:39:22.669423 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:22.669381    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 10 17:39:22.669638 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:22.669444    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h" podUID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 10 17:39:23.746425 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:23.746394    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:39:23.746869 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:23.746753    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:39:23.747668 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:23.747650    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:39:32.201688 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:32.201649    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:39:35.440565 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:35.440534    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"]
Sep 10 17:39:35.441032 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:35.440760    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h" podUID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" containerName="istio-proxy" containerID="cri-o://29cce957f1eb703f55617b3e8bf653428f86828749173cb87c7e6ad6a78a2b26" gracePeriod=30
Sep 10 17:39:38.749789 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:38.749748    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 17:39:38.750280 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:38.749824    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h" podUID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 17:39:40.702545 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.702482    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:39:40.800384 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.800351    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-credential-socket\") pod \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") "
Sep 10 17:39:40.800384 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.800385    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-envoy\") pod \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") "
Sep 10 17:39:40.800641 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.800430    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istiod-ca-cert\") pod \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") "
Sep 10 17:39:40.800641 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.800467    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-data\") pod \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") "
Sep 10 17:39:40.800641 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.800512    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-podinfo\") pod \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") "
Sep 10 17:39:40.800641 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.800538    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cc6p\" (UniqueName: \"kubernetes.io/projected/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-kube-api-access-5cc6p\") pod \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") "
Sep 10 17:39:40.800641 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.800604    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-token\") pod \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") "
Sep 10 17:39:40.800905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.800648    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-workload-socket\") pod \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") "
Sep 10 17:39:40.800905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.800653    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" (UID: "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:39:40.800905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.800676    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-workload-certs\") pod \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\" (UID: \"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2\") "
Sep 10 17:39:40.800905 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.800813    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" (UID: "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:39:40.801131 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.800913    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" (UID: "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:39:40.801131 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.801067    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" (UID: "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:39:40.801131 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.801095    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:39:40.801131 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.801118    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:39:40.801131 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.801133    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:39:40.801385 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.801213    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" (UID: "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:39:40.802710 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.802686    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" (UID: "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:39:40.802939 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.802913    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" (UID: "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:39:40.803216 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.803184    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-kube-api-access-5cc6p" (OuterVolumeSpecName: "kube-api-access-5cc6p") pod "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" (UID: "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2"). InnerVolumeSpecName "kube-api-access-5cc6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:39:40.803216 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.803196    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" (UID: "7a25668e-0d10-4e1c-bab3-5d1bf3f178b2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:39:40.902161 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.902118    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cc6p\" (UniqueName: \"kubernetes.io/projected/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-kube-api-access-5cc6p\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:39:40.902161 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.902154    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:39:40.902161 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.902167    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:39:40.902424 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.902181    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:39:40.902424 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.902192    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:39:40.902424 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:40.902203    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:39:41.409541 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:41.409511    2576 generic.go:356] "Generic (PLEG): container finished" podID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" containerID="29cce957f1eb703f55617b3e8bf653428f86828749173cb87c7e6ad6a78a2b26" exitCode=0
Sep 10 17:39:41.409710 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:41.409557    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"
Sep 10 17:39:41.409710 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:41.409596    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h" event={"ID":"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2","Type":"ContainerDied","Data":"29cce957f1eb703f55617b3e8bf653428f86828749173cb87c7e6ad6a78a2b26"}
Sep 10 17:39:41.409710 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:41.409650    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h" event={"ID":"7a25668e-0d10-4e1c-bab3-5d1bf3f178b2","Type":"ContainerDied","Data":"55cdb6440681112e7f30a87e95c1d4b4903c56838fae43dea07ce1229e41bff7"}
Sep 10 17:39:41.409710 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:41.409673    2576 scope.go:117] "RemoveContainer" containerID="29cce957f1eb703f55617b3e8bf653428f86828749173cb87c7e6ad6a78a2b26"
Sep 10 17:39:41.424106 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:41.424081    2576 scope.go:117] "RemoveContainer" containerID="2806544b9d2b0b060c93f7ecf246069c455e049dda9942fb379111bbeac572a6"
Sep 10 17:39:41.433001 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:41.432976    2576 scope.go:117] "RemoveContainer" containerID="29cce957f1eb703f55617b3e8bf653428f86828749173cb87c7e6ad6a78a2b26"
Sep 10 17:39:41.433364 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:39:41.433337    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29cce957f1eb703f55617b3e8bf653428f86828749173cb87c7e6ad6a78a2b26\": container with ID starting with 29cce957f1eb703f55617b3e8bf653428f86828749173cb87c7e6ad6a78a2b26 not found: ID does not exist" containerID="29cce957f1eb703f55617b3e8bf653428f86828749173cb87c7e6ad6a78a2b26"
Sep 10 17:39:41.433458 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:41.433375    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29cce957f1eb703f55617b3e8bf653428f86828749173cb87c7e6ad6a78a2b26"} err="failed to get container status \"29cce957f1eb703f55617b3e8bf653428f86828749173cb87c7e6ad6a78a2b26\": rpc error: code = NotFound desc = could not find container \"29cce957f1eb703f55617b3e8bf653428f86828749173cb87c7e6ad6a78a2b26\": container with ID starting with 29cce957f1eb703f55617b3e8bf653428f86828749173cb87c7e6ad6a78a2b26 not found: ID does not exist"
Sep 10 17:39:41.433458 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:41.433401    2576 scope.go:117] "RemoveContainer" containerID="2806544b9d2b0b060c93f7ecf246069c455e049dda9942fb379111bbeac572a6"
Sep 10 17:39:41.433694 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:39:41.433675    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2806544b9d2b0b060c93f7ecf246069c455e049dda9942fb379111bbeac572a6\": container with ID starting with 2806544b9d2b0b060c93f7ecf246069c455e049dda9942fb379111bbeac572a6 not found: ID does not exist" containerID="2806544b9d2b0b060c93f7ecf246069c455e049dda9942fb379111bbeac572a6"
Sep 10 17:39:41.433753 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:41.433699    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2806544b9d2b0b060c93f7ecf246069c455e049dda9942fb379111bbeac572a6"} err="failed to get container status \"2806544b9d2b0b060c93f7ecf246069c455e049dda9942fb379111bbeac572a6\": rpc error: code = NotFound desc = could not find container \"2806544b9d2b0b060c93f7ecf246069c455e049dda9942fb379111bbeac572a6\": container with ID starting with 2806544b9d2b0b060c93f7ecf246069c455e049dda9942fb379111bbeac572a6 not found: ID does not exist"
Sep 10 17:39:41.433753 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:41.433702    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"]
Sep 10 17:39:41.446275 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:41.446250    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5eebb3-openshift-default-5ddd7f88f6-xbp9h"]
Sep 10 17:39:43.084796 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:43.084762    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" path="/var/lib/kubelet/pods/7a25668e-0d10-4e1c-bab3-5d1bf3f178b2/volumes"
Sep 10 17:39:52.210731 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:52.210692    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:39:54.741218 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:54.741182    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"]
Sep 10 17:39:54.741628 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:54.741477    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc" podUID="c99df300-6a3f-476a-b996-c4c035b20e00" containerName="payload-pre-processing" containerID="cri-o://26dbab160178324604bf192dd5ee999b19c32095588b129e162fbe973ba9abfb" gracePeriod=30
Sep 10 17:39:55.011668 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.011641    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"
Sep 10 17:39:55.018802 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.018778    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nd66n\" (UniqueName: \"kubernetes.io/projected/c99df300-6a3f-476a-b996-c4c035b20e00-kube-api-access-nd66n\") pod \"c99df300-6a3f-476a-b996-c4c035b20e00\" (UID: \"c99df300-6a3f-476a-b996-c4c035b20e00\") "
Sep 10 17:39:55.018947 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.018840    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c99df300-6a3f-476a-b996-c4c035b20e00-plugins-config-volume\") pod \"c99df300-6a3f-476a-b996-c4c035b20e00\" (UID: \"c99df300-6a3f-476a-b996-c4c035b20e00\") "
Sep 10 17:39:55.019281 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.019247    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c99df300-6a3f-476a-b996-c4c035b20e00-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c99df300-6a3f-476a-b996-c4c035b20e00" (UID: "c99df300-6a3f-476a-b996-c4c035b20e00"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:39:55.020844 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.020815    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c99df300-6a3f-476a-b996-c4c035b20e00-kube-api-access-nd66n" (OuterVolumeSpecName: "kube-api-access-nd66n") pod "c99df300-6a3f-476a-b996-c4c035b20e00" (UID: "c99df300-6a3f-476a-b996-c4c035b20e00"). InnerVolumeSpecName "kube-api-access-nd66n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:39:55.119562 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.119532    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd66n\" (UniqueName: \"kubernetes.io/projected/c99df300-6a3f-476a-b996-c4c035b20e00-kube-api-access-nd66n\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:39:55.119562 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.119560    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c99df300-6a3f-476a-b996-c4c035b20e00-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:39:55.485812 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.485776    2576 generic.go:356] "Generic (PLEG): container finished" podID="c99df300-6a3f-476a-b996-c4c035b20e00" containerID="26dbab160178324604bf192dd5ee999b19c32095588b129e162fbe973ba9abfb" exitCode=0
Sep 10 17:39:55.486007 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.485820    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"
Sep 10 17:39:55.486007 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.485861    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc" event={"ID":"c99df300-6a3f-476a-b996-c4c035b20e00","Type":"ContainerDied","Data":"26dbab160178324604bf192dd5ee999b19c32095588b129e162fbe973ba9abfb"}
Sep 10 17:39:55.486007 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.485918    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc" event={"ID":"c99df300-6a3f-476a-b996-c4c035b20e00","Type":"ContainerDied","Data":"6f6cff4eb462c2976f51bd41cfe6acab7c5cb488b71d1f5abce2ea692a5bc9cd"}
Sep 10 17:39:55.486007 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.485946    2576 scope.go:117] "RemoveContainer" containerID="26dbab160178324604bf192dd5ee999b19c32095588b129e162fbe973ba9abfb"
Sep 10 17:39:55.494168 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.494148    2576 scope.go:117] "RemoveContainer" containerID="26dbab160178324604bf192dd5ee999b19c32095588b129e162fbe973ba9abfb"
Sep 10 17:39:55.494491 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:39:55.494470    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26dbab160178324604bf192dd5ee999b19c32095588b129e162fbe973ba9abfb\": container with ID starting with 26dbab160178324604bf192dd5ee999b19c32095588b129e162fbe973ba9abfb not found: ID does not exist" containerID="26dbab160178324604bf192dd5ee999b19c32095588b129e162fbe973ba9abfb"
Sep 10 17:39:55.494563 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.494503    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26dbab160178324604bf192dd5ee999b19c32095588b129e162fbe973ba9abfb"} err="failed to get container status \"26dbab160178324604bf192dd5ee999b19c32095588b129e162fbe973ba9abfb\": rpc error: code = NotFound desc = could not find container \"26dbab160178324604bf192dd5ee999b19c32095588b129e162fbe973ba9abfb\": container with ID starting with 26dbab160178324604bf192dd5ee999b19c32095588b129e162fbe973ba9abfb not found: ID does not exist"
Sep 10 17:39:55.514177 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.514146    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"]
Sep 10 17:39:55.516338 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:55.516317    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-437dd7-7cd7d68d7d-f6zgc"]
Sep 10 17:39:57.085027 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:39:57.084998    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c99df300-6a3f-476a-b996-c4c035b20e00" path="/var/lib/kubelet/pods/c99df300-6a3f-476a-b996-c4c035b20e00/volumes"
Sep 10 17:40:05.306531 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:05.306489    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:40:43.432075 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:43.432027    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"]
Sep 10 17:40:43.432637 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:43.432357    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x" podUID="81376d7d-348c-4113-a21d-c157f74be2fa" containerName="istio-proxy" containerID="cri-o://92a835f997cec3b7246fd5e0308739ff9a795a17136545d14624653af54b907e" gracePeriod=30
Sep 10 17:40:48.688990 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.688960    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:40:48.744096 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.743996    2576 generic.go:356] "Generic (PLEG): container finished" podID="81376d7d-348c-4113-a21d-c157f74be2fa" containerID="92a835f997cec3b7246fd5e0308739ff9a795a17136545d14624653af54b907e" exitCode=0
Sep 10 17:40:48.744096 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.744046    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"
Sep 10 17:40:48.744096 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.744082    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x" event={"ID":"81376d7d-348c-4113-a21d-c157f74be2fa","Type":"ContainerDied","Data":"92a835f997cec3b7246fd5e0308739ff9a795a17136545d14624653af54b907e"}
Sep 10 17:40:48.744351 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.744143    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x" event={"ID":"81376d7d-348c-4113-a21d-c157f74be2fa","Type":"ContainerDied","Data":"858752ebc2bcc54e9f28a65cfc20f150da5efdc22c64db5fade7adc5ed4719c7"}
Sep 10 17:40:48.744351 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.744169    2576 scope.go:117] "RemoveContainer" containerID="92a835f997cec3b7246fd5e0308739ff9a795a17136545d14624653af54b907e"
Sep 10 17:40:48.752527 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.752511    2576 scope.go:117] "RemoveContainer" containerID="a1dca09b0dbe944efa115656233b01b90e56c005d4f85a70528b973ce72c522f"
Sep 10 17:40:48.760350 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.760332    2576 scope.go:117] "RemoveContainer" containerID="92a835f997cec3b7246fd5e0308739ff9a795a17136545d14624653af54b907e"
Sep 10 17:40:48.760616 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:40:48.760596    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92a835f997cec3b7246fd5e0308739ff9a795a17136545d14624653af54b907e\": container with ID starting with 92a835f997cec3b7246fd5e0308739ff9a795a17136545d14624653af54b907e not found: ID does not exist" containerID="92a835f997cec3b7246fd5e0308739ff9a795a17136545d14624653af54b907e"
Sep 10 17:40:48.760676 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.760628    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a835f997cec3b7246fd5e0308739ff9a795a17136545d14624653af54b907e"} err="failed to get container status \"92a835f997cec3b7246fd5e0308739ff9a795a17136545d14624653af54b907e\": rpc error: code = NotFound desc = could not find container \"92a835f997cec3b7246fd5e0308739ff9a795a17136545d14624653af54b907e\": container with ID starting with 92a835f997cec3b7246fd5e0308739ff9a795a17136545d14624653af54b907e not found: ID does not exist"
Sep 10 17:40:48.760676 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.760646    2576 scope.go:117] "RemoveContainer" containerID="a1dca09b0dbe944efa115656233b01b90e56c005d4f85a70528b973ce72c522f"
Sep 10 17:40:48.760890 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:40:48.760874    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1dca09b0dbe944efa115656233b01b90e56c005d4f85a70528b973ce72c522f\": container with ID starting with a1dca09b0dbe944efa115656233b01b90e56c005d4f85a70528b973ce72c522f not found: ID does not exist" containerID="a1dca09b0dbe944efa115656233b01b90e56c005d4f85a70528b973ce72c522f"
Sep 10 17:40:48.760935 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.760893    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1dca09b0dbe944efa115656233b01b90e56c005d4f85a70528b973ce72c522f"} err="failed to get container status \"a1dca09b0dbe944efa115656233b01b90e56c005d4f85a70528b973ce72c522f\": rpc error: code = NotFound desc = could not find container \"a1dca09b0dbe944efa115656233b01b90e56c005d4f85a70528b973ce72c522f\": container with ID starting with a1dca09b0dbe944efa115656233b01b90e56c005d4f85a70528b973ce72c522f not found: ID does not exist"
Sep 10 17:40:48.798133 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.798099    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81376d7d-348c-4113-a21d-c157f74be2fa-istio-podinfo\") pod \"81376d7d-348c-4113-a21d-c157f74be2fa\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") "
Sep 10 17:40:48.798295 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.798139    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81376d7d-348c-4113-a21d-c157f74be2fa-istio-token\") pod \"81376d7d-348c-4113-a21d-c157f74be2fa\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") "
Sep 10 17:40:48.798295 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.798165    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81376d7d-348c-4113-a21d-c157f74be2fa-istiod-ca-cert\") pod \"81376d7d-348c-4113-a21d-c157f74be2fa\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") "
Sep 10 17:40:48.798295 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.798197    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-istio-envoy\") pod \"81376d7d-348c-4113-a21d-c157f74be2fa\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") "
Sep 10 17:40:48.798295 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.798228    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-credential-socket\") pod \"81376d7d-348c-4113-a21d-c157f74be2fa\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") "
Sep 10 17:40:48.798295 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.798245    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-istio-data\") pod \"81376d7d-348c-4113-a21d-c157f74be2fa\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") "
Sep 10 17:40:48.798295 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.798291    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvj46\" (UniqueName: \"kubernetes.io/projected/81376d7d-348c-4113-a21d-c157f74be2fa-kube-api-access-hvj46\") pod \"81376d7d-348c-4113-a21d-c157f74be2fa\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") "
Sep 10 17:40:48.798603 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.798318    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-workload-certs\") pod \"81376d7d-348c-4113-a21d-c157f74be2fa\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") "
Sep 10 17:40:48.798603 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.798345    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-workload-socket\") pod \"81376d7d-348c-4113-a21d-c157f74be2fa\" (UID: \"81376d7d-348c-4113-a21d-c157f74be2fa\") "
Sep 10 17:40:48.798709 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.798654    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-istio-data" (OuterVolumeSpecName: "istio-data") pod "81376d7d-348c-4113-a21d-c157f74be2fa" (UID: "81376d7d-348c-4113-a21d-c157f74be2fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:40:48.798766 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.798679    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81376d7d-348c-4113-a21d-c157f74be2fa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "81376d7d-348c-4113-a21d-c157f74be2fa" (UID: "81376d7d-348c-4113-a21d-c157f74be2fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:40:48.798832 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.798767    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "81376d7d-348c-4113-a21d-c157f74be2fa" (UID: "81376d7d-348c-4113-a21d-c157f74be2fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:40:48.798832 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.798779    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "81376d7d-348c-4113-a21d-c157f74be2fa" (UID: "81376d7d-348c-4113-a21d-c157f74be2fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:40:48.798832 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.798823    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "81376d7d-348c-4113-a21d-c157f74be2fa" (UID: "81376d7d-348c-4113-a21d-c157f74be2fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:40:48.800498 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.800462    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "81376d7d-348c-4113-a21d-c157f74be2fa" (UID: "81376d7d-348c-4113-a21d-c157f74be2fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:40:48.800638 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.800507    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/81376d7d-348c-4113-a21d-c157f74be2fa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "81376d7d-348c-4113-a21d-c157f74be2fa" (UID: "81376d7d-348c-4113-a21d-c157f74be2fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:40:48.800638 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.800521    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81376d7d-348c-4113-a21d-c157f74be2fa-kube-api-access-hvj46" (OuterVolumeSpecName: "kube-api-access-hvj46") pod "81376d7d-348c-4113-a21d-c157f74be2fa" (UID: "81376d7d-348c-4113-a21d-c157f74be2fa"). InnerVolumeSpecName "kube-api-access-hvj46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:40:48.800638 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.800604    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81376d7d-348c-4113-a21d-c157f74be2fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "81376d7d-348c-4113-a21d-c157f74be2fa" (UID: "81376d7d-348c-4113-a21d-c157f74be2fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:40:48.899131 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.899090    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81376d7d-348c-4113-a21d-c157f74be2fa-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:40:48.899131 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.899124    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81376d7d-348c-4113-a21d-c157f74be2fa-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:40:48.899131 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.899137    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81376d7d-348c-4113-a21d-c157f74be2fa-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:40:48.899391 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.899147    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:40:48.899391 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.899158    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:40:48.899391 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.899169    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:40:48.899391 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.899180    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvj46\" (UniqueName: \"kubernetes.io/projected/81376d7d-348c-4113-a21d-c157f74be2fa-kube-api-access-hvj46\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:40:48.899391 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.899190    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:40:48.899391 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:48.899203    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81376d7d-348c-4113-a21d-c157f74be2fa-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:40:49.067411 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:49.067376    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"]
Sep 10 17:40:49.074171 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:49.074143    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-437dd7-openshift-default-bd8f94b48-gvq7x"]
Sep 10 17:40:49.085063 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:49.085028    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81376d7d-348c-4113-a21d-c157f74be2fa" path="/var/lib/kubelet/pods/81376d7d-348c-4113-a21d-c157f74be2fa/volumes"
Sep 10 17:40:57.602576 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:40:57.602537    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:41:01.236567 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:01.236530    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"]
Sep 10 17:41:01.237003 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:01.236740    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerName="istio-proxy" containerID="cri-o://3ce091082ba3b87509a5cba08cce6d57b9aab68eff195689145108009fc75830" gracePeriod=30
Sep 10 17:41:01.723137 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:01.723097    2576 patch_prober.go:28] interesting pod/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 17:41:01.723312 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:01.723163    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 17:41:06.486626 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.486597    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:41:06.559582 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.559483    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-workload-certs\") pod \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") "
Sep 10 17:41:06.559582 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.559551    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-envoy\") pod \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") "
Sep 10 17:41:06.559815 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.559612    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fh6bk\" (UniqueName: \"kubernetes.io/projected/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-kube-api-access-fh6bk\") pod \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") "
Sep 10 17:41:06.559815 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.559635    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-credential-socket\") pod \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") "
Sep 10 17:41:06.559815 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.559692    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-token\") pod \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") "
Sep 10 17:41:06.559815 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.559731    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-workload-socket\") pod \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") "
Sep 10 17:41:06.559815 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.559757    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-podinfo\") pod \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") "
Sep 10 17:41:06.559815 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.559780    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-data\") pod \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") "
Sep 10 17:41:06.559815 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.559783    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ad643e5d-7889-4a9c-bb57-5130d3f5c40e" (UID: "ad643e5d-7889-4a9c-bb57-5130d3f5c40e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:41:06.560194 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.559935    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istiod-ca-cert\") pod \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\" (UID: \"ad643e5d-7889-4a9c-bb57-5130d3f5c40e\") "
Sep 10 17:41:06.560194 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.559939    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ad643e5d-7889-4a9c-bb57-5130d3f5c40e" (UID: "ad643e5d-7889-4a9c-bb57-5130d3f5c40e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:41:06.560301 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.560245    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:06.560301 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.560264    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:06.560301 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.560274    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-data" (OuterVolumeSpecName: "istio-data") pod "ad643e5d-7889-4a9c-bb57-5130d3f5c40e" (UID: "ad643e5d-7889-4a9c-bb57-5130d3f5c40e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:41:06.560301 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.560289    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ad643e5d-7889-4a9c-bb57-5130d3f5c40e" (UID: "ad643e5d-7889-4a9c-bb57-5130d3f5c40e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:41:06.560545 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.560526    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ad643e5d-7889-4a9c-bb57-5130d3f5c40e" (UID: "ad643e5d-7889-4a9c-bb57-5130d3f5c40e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:41:06.561765 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.561738    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ad643e5d-7889-4a9c-bb57-5130d3f5c40e" (UID: "ad643e5d-7889-4a9c-bb57-5130d3f5c40e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:41:06.562038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.562013    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ad643e5d-7889-4a9c-bb57-5130d3f5c40e" (UID: "ad643e5d-7889-4a9c-bb57-5130d3f5c40e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:41:06.562212 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.562190    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-kube-api-access-fh6bk" (OuterVolumeSpecName: "kube-api-access-fh6bk") pod "ad643e5d-7889-4a9c-bb57-5130d3f5c40e" (UID: "ad643e5d-7889-4a9c-bb57-5130d3f5c40e"). InnerVolumeSpecName "kube-api-access-fh6bk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:41:06.562305 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.562244    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-token" (OuterVolumeSpecName: "istio-token") pod "ad643e5d-7889-4a9c-bb57-5130d3f5c40e" (UID: "ad643e5d-7889-4a9c-bb57-5130d3f5c40e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:41:06.661248 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.661215    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:06.661248 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.661244    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:06.661248 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.661253    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:06.661491 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.661262    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:06.661491 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.661271    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:06.661491 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.661278    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:06.661491 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.661287    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh6bk\" (UniqueName: \"kubernetes.io/projected/ad643e5d-7889-4a9c-bb57-5130d3f5c40e-kube-api-access-fh6bk\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:06.834355 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.834268    2576 generic.go:356] "Generic (PLEG): container finished" podID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerID="3ce091082ba3b87509a5cba08cce6d57b9aab68eff195689145108009fc75830" exitCode=0
Sep 10 17:41:06.834355 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.834320    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"
Sep 10 17:41:06.834536 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.834358    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" event={"ID":"ad643e5d-7889-4a9c-bb57-5130d3f5c40e","Type":"ContainerDied","Data":"3ce091082ba3b87509a5cba08cce6d57b9aab68eff195689145108009fc75830"}
Sep 10 17:41:06.834536 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.834453    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs" event={"ID":"ad643e5d-7889-4a9c-bb57-5130d3f5c40e","Type":"ContainerDied","Data":"162fc76446fa70ffeb2306bceba05f08f7bf2cd6e7d8c08d7a6561fd6fd18292"}
Sep 10 17:41:06.834536 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.834481    2576 scope.go:117] "RemoveContainer" containerID="3ce091082ba3b87509a5cba08cce6d57b9aab68eff195689145108009fc75830"
Sep 10 17:41:06.843305 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.843285    2576 scope.go:117] "RemoveContainer" containerID="60d1ff0cf9bb5c2a79a17708f06e44450843405ab9e48555871e0ff2a08d7b13"
Sep 10 17:41:06.851103 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.851043    2576 scope.go:117] "RemoveContainer" containerID="3ce091082ba3b87509a5cba08cce6d57b9aab68eff195689145108009fc75830"
Sep 10 17:41:06.851407 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:41:06.851384    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ce091082ba3b87509a5cba08cce6d57b9aab68eff195689145108009fc75830\": container with ID starting with 3ce091082ba3b87509a5cba08cce6d57b9aab68eff195689145108009fc75830 not found: ID does not exist" containerID="3ce091082ba3b87509a5cba08cce6d57b9aab68eff195689145108009fc75830"
Sep 10 17:41:06.851489 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.851420    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ce091082ba3b87509a5cba08cce6d57b9aab68eff195689145108009fc75830"} err="failed to get container status \"3ce091082ba3b87509a5cba08cce6d57b9aab68eff195689145108009fc75830\": rpc error: code = NotFound desc = could not find container \"3ce091082ba3b87509a5cba08cce6d57b9aab68eff195689145108009fc75830\": container with ID starting with 3ce091082ba3b87509a5cba08cce6d57b9aab68eff195689145108009fc75830 not found: ID does not exist"
Sep 10 17:41:06.851489 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.851444    2576 scope.go:117] "RemoveContainer" containerID="60d1ff0cf9bb5c2a79a17708f06e44450843405ab9e48555871e0ff2a08d7b13"
Sep 10 17:41:06.851705 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:41:06.851686    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60d1ff0cf9bb5c2a79a17708f06e44450843405ab9e48555871e0ff2a08d7b13\": container with ID starting with 60d1ff0cf9bb5c2a79a17708f06e44450843405ab9e48555871e0ff2a08d7b13 not found: ID does not exist" containerID="60d1ff0cf9bb5c2a79a17708f06e44450843405ab9e48555871e0ff2a08d7b13"
Sep 10 17:41:06.851746 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.851711    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60d1ff0cf9bb5c2a79a17708f06e44450843405ab9e48555871e0ff2a08d7b13"} err="failed to get container status \"60d1ff0cf9bb5c2a79a17708f06e44450843405ab9e48555871e0ff2a08d7b13\": rpc error: code = NotFound desc = could not find container \"60d1ff0cf9bb5c2a79a17708f06e44450843405ab9e48555871e0ff2a08d7b13\": container with ID starting with 60d1ff0cf9bb5c2a79a17708f06e44450843405ab9e48555871e0ff2a08d7b13 not found: ID does not exist"
Sep 10 17:41:06.855975 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.855951    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"]
Sep 10 17:41:06.868165 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:06.868141    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-777ae3-openshift-default-c45bdf888-fpzgs"]
Sep 10 17:41:07.084574 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:07.084495    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" path="/var/lib/kubelet/pods/ad643e5d-7889-4a9c-bb57-5130d3f5c40e/volumes"
Sep 10 17:41:15.093388 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:15.093354    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:41:30.066319 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.066286    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"]
Sep 10 17:41:30.066779 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.066550    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f" podUID="57084a0a-09f6-4e01-9002-ff2bf6195af4" containerName="payload-processing" containerID="cri-o://e0b3a13980b26dd22cbb3fd7747559153da2be6c9c715e8ded16df960c0d26ae" gracePeriod=30
Sep 10 17:41:30.080760 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.080726    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"]
Sep 10 17:41:30.080969 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.080943    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5" podUID="8f659e42-dc31-4112-9351-ae6c0cf27b2b" containerName="payload-pre-processing" containerID="cri-o://3699d091d6baf625cdfafe035446fb9eba96c278ac9275f7c05ff846ced275bc" gracePeriod=30
Sep 10 17:41:30.341629 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.341607    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"
Sep 10 17:41:30.367358 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.367327    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"
Sep 10 17:41:30.465044 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.465008    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmw26\" (UniqueName: \"kubernetes.io/projected/8f659e42-dc31-4112-9351-ae6c0cf27b2b-kube-api-access-mmw26\") pod \"8f659e42-dc31-4112-9351-ae6c0cf27b2b\" (UID: \"8f659e42-dc31-4112-9351-ae6c0cf27b2b\") "
Sep 10 17:41:30.465247 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.465113    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f659e42-dc31-4112-9351-ae6c0cf27b2b-plugins-config-volume\") pod \"8f659e42-dc31-4112-9351-ae6c0cf27b2b\" (UID: \"8f659e42-dc31-4112-9351-ae6c0cf27b2b\") "
Sep 10 17:41:30.465247 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.465162    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57084a0a-09f6-4e01-9002-ff2bf6195af4-plugins-config-volume\") pod \"57084a0a-09f6-4e01-9002-ff2bf6195af4\" (UID: \"57084a0a-09f6-4e01-9002-ff2bf6195af4\") "
Sep 10 17:41:30.465247 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.465217    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh5mn\" (UniqueName: \"kubernetes.io/projected/57084a0a-09f6-4e01-9002-ff2bf6195af4-kube-api-access-gh5mn\") pod \"57084a0a-09f6-4e01-9002-ff2bf6195af4\" (UID: \"57084a0a-09f6-4e01-9002-ff2bf6195af4\") "
Sep 10 17:41:30.465546 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.465523    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f659e42-dc31-4112-9351-ae6c0cf27b2b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8f659e42-dc31-4112-9351-ae6c0cf27b2b" (UID: "8f659e42-dc31-4112-9351-ae6c0cf27b2b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:41:30.465630 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.465558    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57084a0a-09f6-4e01-9002-ff2bf6195af4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "57084a0a-09f6-4e01-9002-ff2bf6195af4" (UID: "57084a0a-09f6-4e01-9002-ff2bf6195af4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:41:30.467071 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.467035    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f659e42-dc31-4112-9351-ae6c0cf27b2b-kube-api-access-mmw26" (OuterVolumeSpecName: "kube-api-access-mmw26") pod "8f659e42-dc31-4112-9351-ae6c0cf27b2b" (UID: "8f659e42-dc31-4112-9351-ae6c0cf27b2b"). InnerVolumeSpecName "kube-api-access-mmw26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:41:30.467147 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.467126    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57084a0a-09f6-4e01-9002-ff2bf6195af4-kube-api-access-gh5mn" (OuterVolumeSpecName: "kube-api-access-gh5mn") pod "57084a0a-09f6-4e01-9002-ff2bf6195af4" (UID: "57084a0a-09f6-4e01-9002-ff2bf6195af4"). InnerVolumeSpecName "kube-api-access-gh5mn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:41:30.566271 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.566230    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh5mn\" (UniqueName: \"kubernetes.io/projected/57084a0a-09f6-4e01-9002-ff2bf6195af4-kube-api-access-gh5mn\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:30.566271 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.566264    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmw26\" (UniqueName: \"kubernetes.io/projected/8f659e42-dc31-4112-9351-ae6c0cf27b2b-kube-api-access-mmw26\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:30.566271 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.566276    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f659e42-dc31-4112-9351-ae6c0cf27b2b-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:30.566526 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.566289    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57084a0a-09f6-4e01-9002-ff2bf6195af4-plugins-config-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:30.950106 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.950047    2576 generic.go:356] "Generic (PLEG): container finished" podID="8f659e42-dc31-4112-9351-ae6c0cf27b2b" containerID="3699d091d6baf625cdfafe035446fb9eba96c278ac9275f7c05ff846ced275bc" exitCode=0
Sep 10 17:41:30.950299 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.950119    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"
Sep 10 17:41:30.950299 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.950139    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5" event={"ID":"8f659e42-dc31-4112-9351-ae6c0cf27b2b","Type":"ContainerDied","Data":"3699d091d6baf625cdfafe035446fb9eba96c278ac9275f7c05ff846ced275bc"}
Sep 10 17:41:30.950299 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.950191    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5" event={"ID":"8f659e42-dc31-4112-9351-ae6c0cf27b2b","Type":"ContainerDied","Data":"4cafaaaec2cebb8d618eb28da328fe111c4a867df2ca55a24ff78376505626e6"}
Sep 10 17:41:30.950299 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.950215    2576 scope.go:117] "RemoveContainer" containerID="3699d091d6baf625cdfafe035446fb9eba96c278ac9275f7c05ff846ced275bc"
Sep 10 17:41:30.951574 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.951553    2576 generic.go:356] "Generic (PLEG): container finished" podID="57084a0a-09f6-4e01-9002-ff2bf6195af4" containerID="e0b3a13980b26dd22cbb3fd7747559153da2be6c9c715e8ded16df960c0d26ae" exitCode=0
Sep 10 17:41:30.951656 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.951597    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"
Sep 10 17:41:30.951656 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.951616    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f" event={"ID":"57084a0a-09f6-4e01-9002-ff2bf6195af4","Type":"ContainerDied","Data":"e0b3a13980b26dd22cbb3fd7747559153da2be6c9c715e8ded16df960c0d26ae"}
Sep 10 17:41:30.951758 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.951664    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f" event={"ID":"57084a0a-09f6-4e01-9002-ff2bf6195af4","Type":"ContainerDied","Data":"9123a8d097961771a164dae031ffe97732500b38fee27706f4b8a183f194e2b9"}
Sep 10 17:41:30.962163 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.962122    2576 scope.go:117] "RemoveContainer" containerID="3699d091d6baf625cdfafe035446fb9eba96c278ac9275f7c05ff846ced275bc"
Sep 10 17:41:30.962581 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:41:30.962555    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3699d091d6baf625cdfafe035446fb9eba96c278ac9275f7c05ff846ced275bc\": container with ID starting with 3699d091d6baf625cdfafe035446fb9eba96c278ac9275f7c05ff846ced275bc not found: ID does not exist" containerID="3699d091d6baf625cdfafe035446fb9eba96c278ac9275f7c05ff846ced275bc"
Sep 10 17:41:30.962695 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.962631    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3699d091d6baf625cdfafe035446fb9eba96c278ac9275f7c05ff846ced275bc"} err="failed to get container status \"3699d091d6baf625cdfafe035446fb9eba96c278ac9275f7c05ff846ced275bc\": rpc error: code = NotFound desc = could not find container \"3699d091d6baf625cdfafe035446fb9eba96c278ac9275f7c05ff846ced275bc\": container with ID starting with 3699d091d6baf625cdfafe035446fb9eba96c278ac9275f7c05ff846ced275bc not found: ID does not exist"
Sep 10 17:41:30.962695 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.962658    2576 scope.go:117] "RemoveContainer" containerID="e0b3a13980b26dd22cbb3fd7747559153da2be6c9c715e8ded16df960c0d26ae"
Sep 10 17:41:30.971166 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.971148    2576 scope.go:117] "RemoveContainer" containerID="e0b3a13980b26dd22cbb3fd7747559153da2be6c9c715e8ded16df960c0d26ae"
Sep 10 17:41:30.971463 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:41:30.971439    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0b3a13980b26dd22cbb3fd7747559153da2be6c9c715e8ded16df960c0d26ae\": container with ID starting with e0b3a13980b26dd22cbb3fd7747559153da2be6c9c715e8ded16df960c0d26ae not found: ID does not exist" containerID="e0b3a13980b26dd22cbb3fd7747559153da2be6c9c715e8ded16df960c0d26ae"
Sep 10 17:41:30.971533 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.971470    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0b3a13980b26dd22cbb3fd7747559153da2be6c9c715e8ded16df960c0d26ae"} err="failed to get container status \"e0b3a13980b26dd22cbb3fd7747559153da2be6c9c715e8ded16df960c0d26ae\": rpc error: code = NotFound desc = could not find container \"e0b3a13980b26dd22cbb3fd7747559153da2be6c9c715e8ded16df960c0d26ae\": container with ID starting with e0b3a13980b26dd22cbb3fd7747559153da2be6c9c715e8ded16df960c0d26ae not found: ID does not exist"
Sep 10 17:41:30.976930 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.976907    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"]
Sep 10 17:41:30.981856 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.981834    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6806f1-79b7f69c9d-h97j5"]
Sep 10 17:41:30.992101 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.992080    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"]
Sep 10 17:41:30.996981 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:30.996957    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f"]
Sep 10 17:41:31.085825 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:31.085795    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57084a0a-09f6-4e01-9002-ff2bf6195af4" path="/var/lib/kubelet/pods/57084a0a-09f6-4e01-9002-ff2bf6195af4/volumes"
Sep 10 17:41:31.086220 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:31.086149    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f659e42-dc31-4112-9351-ae6c0cf27b2b" path="/var/lib/kubelet/pods/8f659e42-dc31-4112-9351-ae6c0cf27b2b/volumes"
Sep 10 17:41:31.297828 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:31.297735    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-6806f1-575c754979-p8c7f" podUID="57084a0a-09f6-4e01-9002-ff2bf6195af4" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.58:9004: i/o timeout"
Sep 10 17:41:32.505040 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:32.504995    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:41:37.450144 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:37.450110    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"]
Sep 10 17:41:37.450648 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:37.450358    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerName="istio-proxy" containerID="cri-o://8b56da70270c12afcd7747278a109a87e71c86a835c93c3b0020754dcdb3fbfd" gracePeriod=30
Sep 10 17:41:41.408881 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:41.408840    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:41:42.697264 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.697241    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:41:42.772632 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.772551    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-envoy\") pod \"bbd2ad43-302a-4326-96ea-f8d0af258d96\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") "
Sep 10 17:41:42.772632 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.772593    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-workload-certs\") pod \"bbd2ad43-302a-4326-96ea-f8d0af258d96\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") "
Sep 10 17:41:42.772868 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.772641    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbd2ad43-302a-4326-96ea-f8d0af258d96-istiod-ca-cert\") pod \"bbd2ad43-302a-4326-96ea-f8d0af258d96\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") "
Sep 10 17:41:42.772868 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.772667    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-workload-socket\") pod \"bbd2ad43-302a-4326-96ea-f8d0af258d96\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") "
Sep 10 17:41:42.772868 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.772696    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-podinfo\") pod \"bbd2ad43-302a-4326-96ea-f8d0af258d96\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") "
Sep 10 17:41:42.772868 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.772756    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-data\") pod \"bbd2ad43-302a-4326-96ea-f8d0af258d96\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") "
Sep 10 17:41:42.772868 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.772801    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-token\") pod \"bbd2ad43-302a-4326-96ea-f8d0af258d96\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") "
Sep 10 17:41:42.772868 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.772823    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnq45\" (UniqueName: \"kubernetes.io/projected/bbd2ad43-302a-4326-96ea-f8d0af258d96-kube-api-access-fnq45\") pod \"bbd2ad43-302a-4326-96ea-f8d0af258d96\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") "
Sep 10 17:41:42.772868 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.772847    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-credential-socket\") pod \"bbd2ad43-302a-4326-96ea-f8d0af258d96\" (UID: \"bbd2ad43-302a-4326-96ea-f8d0af258d96\") "
Sep 10 17:41:42.773265 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.772900    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bbd2ad43-302a-4326-96ea-f8d0af258d96" (UID: "bbd2ad43-302a-4326-96ea-f8d0af258d96"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:41:42.773265 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.773002    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bbd2ad43-302a-4326-96ea-f8d0af258d96" (UID: "bbd2ad43-302a-4326-96ea-f8d0af258d96"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:41:42.773265 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.773125    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bbd2ad43-302a-4326-96ea-f8d0af258d96" (UID: "bbd2ad43-302a-4326-96ea-f8d0af258d96"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:41:42.773265 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.773167    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-data" (OuterVolumeSpecName: "istio-data") pod "bbd2ad43-302a-4326-96ea-f8d0af258d96" (UID: "bbd2ad43-302a-4326-96ea-f8d0af258d96"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:41:42.773265 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.773185    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbd2ad43-302a-4326-96ea-f8d0af258d96-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bbd2ad43-302a-4326-96ea-f8d0af258d96" (UID: "bbd2ad43-302a-4326-96ea-f8d0af258d96"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:41:42.773265 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.773188    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-workload-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:42.773265 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.773219    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-workload-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:42.774837 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.774812    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bbd2ad43-302a-4326-96ea-f8d0af258d96" (UID: "bbd2ad43-302a-4326-96ea-f8d0af258d96"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 17:41:42.774991 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.774972    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-token" (OuterVolumeSpecName: "istio-token") pod "bbd2ad43-302a-4326-96ea-f8d0af258d96" (UID: "bbd2ad43-302a-4326-96ea-f8d0af258d96"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:41:42.775039 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.775000    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bbd2ad43-302a-4326-96ea-f8d0af258d96" (UID: "bbd2ad43-302a-4326-96ea-f8d0af258d96"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 17:41:42.775164 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.775065    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbd2ad43-302a-4326-96ea-f8d0af258d96-kube-api-access-fnq45" (OuterVolumeSpecName: "kube-api-access-fnq45") pod "bbd2ad43-302a-4326-96ea-f8d0af258d96" (UID: "bbd2ad43-302a-4326-96ea-f8d0af258d96"). InnerVolumeSpecName "kube-api-access-fnq45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:41:42.874404 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.874366    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-data\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:42.874404 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.874398    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:42.874404 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.874408    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnq45\" (UniqueName: \"kubernetes.io/projected/bbd2ad43-302a-4326-96ea-f8d0af258d96-kube-api-access-fnq45\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:42.874652 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.874418    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-credential-socket\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:42.874652 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.874427    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-envoy\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:42.874652 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.874435    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbd2ad43-302a-4326-96ea-f8d0af258d96-istiod-ca-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:42.874652 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:42.874442    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbd2ad43-302a-4326-96ea-f8d0af258d96-istio-podinfo\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:41:43.012842 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:43.012809    2576 generic.go:356] "Generic (PLEG): container finished" podID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerID="8b56da70270c12afcd7747278a109a87e71c86a835c93c3b0020754dcdb3fbfd" exitCode=0
Sep 10 17:41:43.013019 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:43.012857    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"
Sep 10 17:41:43.013019 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:43.012855    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" event={"ID":"bbd2ad43-302a-4326-96ea-f8d0af258d96","Type":"ContainerDied","Data":"8b56da70270c12afcd7747278a109a87e71c86a835c93c3b0020754dcdb3fbfd"}
Sep 10 17:41:43.013019 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:43.012975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm" event={"ID":"bbd2ad43-302a-4326-96ea-f8d0af258d96","Type":"ContainerDied","Data":"19bf918c4710cfe19eda44878ce1640161b9e9a291e2129440b6bd99a435d61c"}
Sep 10 17:41:43.013019 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:43.013001    2576 scope.go:117] "RemoveContainer" containerID="8b56da70270c12afcd7747278a109a87e71c86a835c93c3b0020754dcdb3fbfd"
Sep 10 17:41:43.021655 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:43.021636    2576 scope.go:117] "RemoveContainer" containerID="ca9f9738e514752f4e9088ed9078d814048727442e958d37029468955fefce53"
Sep 10 17:41:43.029238 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:43.029218    2576 scope.go:117] "RemoveContainer" containerID="8b56da70270c12afcd7747278a109a87e71c86a835c93c3b0020754dcdb3fbfd"
Sep 10 17:41:43.029517 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:41:43.029497    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b56da70270c12afcd7747278a109a87e71c86a835c93c3b0020754dcdb3fbfd\": container with ID starting with 8b56da70270c12afcd7747278a109a87e71c86a835c93c3b0020754dcdb3fbfd not found: ID does not exist" containerID="8b56da70270c12afcd7747278a109a87e71c86a835c93c3b0020754dcdb3fbfd"
Sep 10 17:41:43.029571 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:43.029527    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b56da70270c12afcd7747278a109a87e71c86a835c93c3b0020754dcdb3fbfd"} err="failed to get container status \"8b56da70270c12afcd7747278a109a87e71c86a835c93c3b0020754dcdb3fbfd\": rpc error: code = NotFound desc = could not find container \"8b56da70270c12afcd7747278a109a87e71c86a835c93c3b0020754dcdb3fbfd\": container with ID starting with 8b56da70270c12afcd7747278a109a87e71c86a835c93c3b0020754dcdb3fbfd not found: ID does not exist"
Sep 10 17:41:43.029571 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:43.029543    2576 scope.go:117] "RemoveContainer" containerID="ca9f9738e514752f4e9088ed9078d814048727442e958d37029468955fefce53"
Sep 10 17:41:43.029795 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:41:43.029776    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca9f9738e514752f4e9088ed9078d814048727442e958d37029468955fefce53\": container with ID starting with ca9f9738e514752f4e9088ed9078d814048727442e958d37029468955fefce53 not found: ID does not exist" containerID="ca9f9738e514752f4e9088ed9078d814048727442e958d37029468955fefce53"
Sep 10 17:41:43.029847 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:43.029805    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca9f9738e514752f4e9088ed9078d814048727442e958d37029468955fefce53"} err="failed to get container status \"ca9f9738e514752f4e9088ed9078d814048727442e958d37029468955fefce53\": rpc error: code = NotFound desc = could not find container \"ca9f9738e514752f4e9088ed9078d814048727442e958d37029468955fefce53\": container with ID starting with ca9f9738e514752f4e9088ed9078d814048727442e958d37029468955fefce53 not found: ID does not exist"
Sep 10 17:41:43.034622 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:43.034596    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"]
Sep 10 17:41:43.037759 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:43.037737    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-6806f1-openshift-default-86958bb696-6ltkm"]
Sep 10 17:41:43.084108 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:41:43.084082    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" path="/var/lib/kubelet/pods/bbd2ad43-302a-4326-96ea-f8d0af258d96/volumes"
Sep 10 17:42:55.423873 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:42:55.423837    2576 scope.go:117] "RemoveContainer" containerID="a273a7d52eb1546207e34a48989aa04dd91eef07337f443ceae69aead4184fef"
Sep 10 17:43:02.745436 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:43:02.745400    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:43:28.810183 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:43:28.810084    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:43:36.699597 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:43:36.699560    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:43:43.900966 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:43:43.900922    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:43:52.504271 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:43:52.504236    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:43:55.441038 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:43:55.441007    2576 scope.go:117] "RemoveContainer" containerID="a9480c3e5397f3c9c2c917e876b95c1bb8181f2f926f95a8471ca59c7198b3b1"
Sep 10 17:43:59.699650 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:43:59.699618    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:44:07.308229 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:44:07.308194    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:44:15.797720 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:44:15.797680    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:45:46.101610 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:45:46.101576    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:45:51.604045 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:45:51.604004    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:46:13.913739 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:46:13.910454    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:46:28.015014 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:46:28.014929    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:46:54.618377 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:46:54.618344    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:47:03.643961 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:03.643923    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:47:10.521891 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.521857    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"]
Sep 10 17:47:10.522297 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522247    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerName="istio-proxy"
Sep 10 17:47:10.522297 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522266    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerName="istio-proxy"
Sep 10 17:47:10.522297 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522277    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c99df300-6a3f-476a-b996-c4c035b20e00" containerName="payload-pre-processing"
Sep 10 17:47:10.522297 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522282    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c99df300-6a3f-476a-b996-c4c035b20e00" containerName="payload-pre-processing"
Sep 10 17:47:10.522297 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522292    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerName="istio-proxy"
Sep 10 17:47:10.522297 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522297    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerName="istio-proxy"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522307    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerName="istio-proxy"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522312    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerName="istio-proxy"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522320    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerName="istio-proxy"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522325    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerName="istio-proxy"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522333    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" containerName="istio-proxy"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522341    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" containerName="istio-proxy"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522349    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57084a0a-09f6-4e01-9002-ff2bf6195af4" containerName="payload-processing"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522354    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="57084a0a-09f6-4e01-9002-ff2bf6195af4" containerName="payload-processing"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522368    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f659e42-dc31-4112-9351-ae6c0cf27b2b" containerName="payload-pre-processing"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522372    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f659e42-dc31-4112-9351-ae6c0cf27b2b" containerName="payload-pre-processing"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522378    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" containerName="istio-proxy"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522383    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" containerName="istio-proxy"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522390    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81376d7d-348c-4113-a21d-c157f74be2fa" containerName="istio-proxy"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522395    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="81376d7d-348c-4113-a21d-c157f74be2fa" containerName="istio-proxy"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522400    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81376d7d-348c-4113-a21d-c157f74be2fa" containerName="istio-proxy"
Sep 10 17:47:10.522503 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522405    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="81376d7d-348c-4113-a21d-c157f74be2fa" containerName="istio-proxy"
Sep 10 17:47:10.523235 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522818    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="81376d7d-348c-4113-a21d-c157f74be2fa" containerName="istio-proxy"
Sep 10 17:47:10.523235 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522836    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="57084a0a-09f6-4e01-9002-ff2bf6195af4" containerName="payload-processing"
Sep 10 17:47:10.523235 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522862    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f659e42-dc31-4112-9351-ae6c0cf27b2b" containerName="payload-pre-processing"
Sep 10 17:47:10.523235 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522872    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c99df300-6a3f-476a-b996-c4c035b20e00" containerName="payload-pre-processing"
Sep 10 17:47:10.523235 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522888    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="81376d7d-348c-4113-a21d-c157f74be2fa" containerName="istio-proxy"
Sep 10 17:47:10.523235 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522897    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerName="istio-proxy"
Sep 10 17:47:10.523235 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522908    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" containerName="istio-proxy"
Sep 10 17:47:10.523235 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.522919    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbd2ad43-302a-4326-96ea-f8d0af258d96" containerName="istio-proxy"
Sep 10 17:47:10.523235 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.523006    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerName="istio-proxy"
Sep 10 17:47:10.523235 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.523059    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad643e5d-7889-4a9c-bb57-5130d3f5c40e" containerName="istio-proxy"
Sep 10 17:47:10.529988 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.529953    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:10.533430 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.533410    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-n7zfj\""
Sep 10 17:47:10.533949 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.533931    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 17:47:10.534272 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.534255    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 17:47:10.536088 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.536046    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 17:47:10.536204 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.536142    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 17:47:10.547801 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.547773    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:47:10.549848 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.549821    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"]
Sep 10 17:47:10.646712 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.646681    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55431895-1b8b-412f-9c47-5fc54cb02a30-maas-api-tls\") pod \"maas-api-ff9f6d487-fwmdh\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") " pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:10.646900 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.646719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhwcs\" (UniqueName: \"kubernetes.io/projected/55431895-1b8b-412f-9c47-5fc54cb02a30-kube-api-access-zhwcs\") pod \"maas-api-ff9f6d487-fwmdh\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") " pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:10.646900 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.646752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55431895-1b8b-412f-9c47-5fc54cb02a30-openshift-service-ca\") pod \"maas-api-ff9f6d487-fwmdh\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") " pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:10.646900 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.646870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55431895-1b8b-412f-9c47-5fc54cb02a30-metrics-certs\") pod \"maas-api-ff9f6d487-fwmdh\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") " pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:10.747338 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.747292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55431895-1b8b-412f-9c47-5fc54cb02a30-metrics-certs\") pod \"maas-api-ff9f6d487-fwmdh\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") " pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:10.747520 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.747363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55431895-1b8b-412f-9c47-5fc54cb02a30-maas-api-tls\") pod \"maas-api-ff9f6d487-fwmdh\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") " pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:10.747520 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.747400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhwcs\" (UniqueName: \"kubernetes.io/projected/55431895-1b8b-412f-9c47-5fc54cb02a30-kube-api-access-zhwcs\") pod \"maas-api-ff9f6d487-fwmdh\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") " pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:10.747610 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.747569    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55431895-1b8b-412f-9c47-5fc54cb02a30-openshift-service-ca\") pod \"maas-api-ff9f6d487-fwmdh\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") " pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:10.748174 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.748151    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55431895-1b8b-412f-9c47-5fc54cb02a30-openshift-service-ca\") pod \"maas-api-ff9f6d487-fwmdh\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") " pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:10.750029 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.750007    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55431895-1b8b-412f-9c47-5fc54cb02a30-maas-api-tls\") pod \"maas-api-ff9f6d487-fwmdh\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") " pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:10.750102 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.750018    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55431895-1b8b-412f-9c47-5fc54cb02a30-metrics-certs\") pod \"maas-api-ff9f6d487-fwmdh\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") " pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:10.758383 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.758351    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhwcs\" (UniqueName: \"kubernetes.io/projected/55431895-1b8b-412f-9c47-5fc54cb02a30-kube-api-access-zhwcs\") pod \"maas-api-ff9f6d487-fwmdh\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") " pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:10.842920 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:10.842833    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:11.143872 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:11.143841    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"]
Sep 10 17:47:11.146895 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:47:11.146863    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55431895_1b8b_412f_9c47_5fc54cb02a30.slice/crio-f1ebdc9019e838df555a80fc033e2a942ebe0e85134eb155c79b1cab2fe0bf49 WatchSource:0}: Error finding container f1ebdc9019e838df555a80fc033e2a942ebe0e85134eb155c79b1cab2fe0bf49: Status 404 returned error can't find the container with id f1ebdc9019e838df555a80fc033e2a942ebe0e85134eb155c79b1cab2fe0bf49
Sep 10 17:47:11.148421 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:11.148403    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 17:47:11.483034 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:11.482937    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh" event={"ID":"55431895-1b8b-412f-9c47-5fc54cb02a30","Type":"ContainerStarted","Data":"f1ebdc9019e838df555a80fc033e2a942ebe0e85134eb155c79b1cab2fe0bf49"}
Sep 10 17:47:13.493895 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:13.493859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh" event={"ID":"55431895-1b8b-412f-9c47-5fc54cb02a30","Type":"ContainerStarted","Data":"ff5069475c7afae81082dfff93334c6c21df4ffcc42f91bc9409126d803e7788"}
Sep 10 17:47:13.494308 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:13.493974    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:13.513124 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:13.513017    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh" podStartSLOduration=1.244682638 podStartE2EDuration="3.512990941s" totalImagesPullingTime="2.268308303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:47:13.512037231 +0000 UTC m=+2118.928088190" watchObservedRunningTime="2026-09-10 17:47:13.512990941 +0000 UTC m=+2118.929041892"
Sep 10 17:47:18.106180 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.106142    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:47:18.456718 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.456679    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"]
Sep 10 17:47:18.456916 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.456882    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh" podUID="55431895-1b8b-412f-9c47-5fc54cb02a30" containerName="maas-api" containerID="cri-o://ff5069475c7afae81082dfff93334c6c21df4ffcc42f91bc9409126d803e7788" gracePeriod=30
Sep 10 17:47:18.462458 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.462434    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:18.704470 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.704445    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:18.804251 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.804160    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55431895-1b8b-412f-9c47-5fc54cb02a30-maas-api-tls\") pod \"55431895-1b8b-412f-9c47-5fc54cb02a30\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") "
Sep 10 17:47:18.804251 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.804224    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55431895-1b8b-412f-9c47-5fc54cb02a30-metrics-certs\") pod \"55431895-1b8b-412f-9c47-5fc54cb02a30\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") "
Sep 10 17:47:18.804251 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.804243    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhwcs\" (UniqueName: \"kubernetes.io/projected/55431895-1b8b-412f-9c47-5fc54cb02a30-kube-api-access-zhwcs\") pod \"55431895-1b8b-412f-9c47-5fc54cb02a30\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") "
Sep 10 17:47:18.806543 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.806507    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55431895-1b8b-412f-9c47-5fc54cb02a30-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "55431895-1b8b-412f-9c47-5fc54cb02a30" (UID: "55431895-1b8b-412f-9c47-5fc54cb02a30"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:47:18.806543 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.806519    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55431895-1b8b-412f-9c47-5fc54cb02a30-kube-api-access-zhwcs" (OuterVolumeSpecName: "kube-api-access-zhwcs") pod "55431895-1b8b-412f-9c47-5fc54cb02a30" (UID: "55431895-1b8b-412f-9c47-5fc54cb02a30"). InnerVolumeSpecName "kube-api-access-zhwcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 17:47:18.806543 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.806529    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55431895-1b8b-412f-9c47-5fc54cb02a30-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "55431895-1b8b-412f-9c47-5fc54cb02a30" (UID: "55431895-1b8b-412f-9c47-5fc54cb02a30"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 17:47:18.905145 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.905109    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55431895-1b8b-412f-9c47-5fc54cb02a30-openshift-service-ca\") pod \"55431895-1b8b-412f-9c47-5fc54cb02a30\" (UID: \"55431895-1b8b-412f-9c47-5fc54cb02a30\") "
Sep 10 17:47:18.905324 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.905312    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55431895-1b8b-412f-9c47-5fc54cb02a30-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:47:18.905370 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.905326    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55431895-1b8b-412f-9c47-5fc54cb02a30-metrics-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:47:18.905370 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.905335    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhwcs\" (UniqueName: \"kubernetes.io/projected/55431895-1b8b-412f-9c47-5fc54cb02a30-kube-api-access-zhwcs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:47:18.905471 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:18.905445    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55431895-1b8b-412f-9c47-5fc54cb02a30-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "55431895-1b8b-412f-9c47-5fc54cb02a30" (UID: "55431895-1b8b-412f-9c47-5fc54cb02a30"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 17:47:19.006337 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:19.006299    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55431895-1b8b-412f-9c47-5fc54cb02a30-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Sep 10 17:47:19.524655 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:19.524618    2576 generic.go:356] "Generic (PLEG): container finished" podID="55431895-1b8b-412f-9c47-5fc54cb02a30" containerID="ff5069475c7afae81082dfff93334c6c21df4ffcc42f91bc9409126d803e7788" exitCode=0
Sep 10 17:47:19.525108 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:19.524666    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"
Sep 10 17:47:19.525108 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:19.524676    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh" event={"ID":"55431895-1b8b-412f-9c47-5fc54cb02a30","Type":"ContainerDied","Data":"ff5069475c7afae81082dfff93334c6c21df4ffcc42f91bc9409126d803e7788"}
Sep 10 17:47:19.525108 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:19.524729    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh" event={"ID":"55431895-1b8b-412f-9c47-5fc54cb02a30","Type":"ContainerDied","Data":"f1ebdc9019e838df555a80fc033e2a942ebe0e85134eb155c79b1cab2fe0bf49"}
Sep 10 17:47:19.525108 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:19.524760    2576 scope.go:117] "RemoveContainer" containerID="ff5069475c7afae81082dfff93334c6c21df4ffcc42f91bc9409126d803e7788"
Sep 10 17:47:19.540988 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:19.540962    2576 scope.go:117] "RemoveContainer" containerID="ff5069475c7afae81082dfff93334c6c21df4ffcc42f91bc9409126d803e7788"
Sep 10 17:47:19.541387 ip-10-0-140-192 kubenswrapper[2576]: E0910 17:47:19.541361    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff5069475c7afae81082dfff93334c6c21df4ffcc42f91bc9409126d803e7788\": container with ID starting with ff5069475c7afae81082dfff93334c6c21df4ffcc42f91bc9409126d803e7788 not found: ID does not exist" containerID="ff5069475c7afae81082dfff93334c6c21df4ffcc42f91bc9409126d803e7788"
Sep 10 17:47:19.541465 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:19.541395    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff5069475c7afae81082dfff93334c6c21df4ffcc42f91bc9409126d803e7788"} err="failed to get container status \"ff5069475c7afae81082dfff93334c6c21df4ffcc42f91bc9409126d803e7788\": rpc error: code = NotFound desc = could not find container \"ff5069475c7afae81082dfff93334c6c21df4ffcc42f91bc9409126d803e7788\": container with ID starting with ff5069475c7afae81082dfff93334c6c21df4ffcc42f91bc9409126d803e7788 not found: ID does not exist"
Sep 10 17:47:19.546362 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:19.546338    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"]
Sep 10 17:47:19.552190 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:19.552156    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-ff9f6d487-fwmdh"]
Sep 10 17:47:21.084238 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:21.084205    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55431895-1b8b-412f-9c47-5fc54cb02a30" path="/var/lib/kubelet/pods/55431895-1b8b-412f-9c47-5fc54cb02a30/volumes"
Sep 10 17:47:25.419185 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:25.419150    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:47:33.508903 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:33.508863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:47:39.194223 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:39.194191    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wb7gb"]
Sep 10 17:47:46.850413 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:46.850382    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-lmsnj_edc43364-447c-4d74-999d-3e970c9f7db9/manager/0.log"
Sep 10 17:47:47.491668 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:47.491637    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86f7548996-lv77p_94f2273d-3b11-4997-b736-b1b93902e61f/manager/0.log"
Sep 10 17:47:47.499988 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:47.499965    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86f7548996-lv77p_94f2273d-3b11-4997-b736-b1b93902e61f/copy-manifests/0.log"
Sep 10 17:47:48.196254 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:48.196225    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817690-dmrm8_7f656fdf-d25e-4dbd-a447-8958b15b6d62/cleanup/0.log"
Sep 10 17:47:49.315236 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:49.315202    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-bdxz5_d8d7bef1-77b5-422c-a068-66c8d0525e24/manager/0.log"
Sep 10 17:47:49.425647 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:49.425613    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-ltf7w_c83e8cce-267b-475d-8295-19d87e6d4df0/manager/0.log"
Sep 10 17:47:49.776480 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:49.776451    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-wb7gb_ba36e1d0-46f2-405b-a52a-3bb855563822/limitador/0.log"
Sep 10 17:47:49.894795 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:49.894761    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-hhktr_53bb30ff-b9b5-435d-8f8e-4c33bea1a3f3/manager/0.log"
Sep 10 17:47:50.340705 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:50.340675    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jbmd9_13eaade1-fdd4-41a3-a56d-091c217bfc95/discovery/0.log"
Sep 10 17:47:50.566375 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:50.566347    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-647997b56d-cbb57_2c279008-c8c3-4434-bd3f-d680fd9722f1/kube-auth-proxy/0.log"
Sep 10 17:47:51.492655 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:51.492624    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-w2xch_db5258a4-009c-42fc-a772-e4b185834d95/main/0.log"
Sep 10 17:47:51.836321 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:47:51.836242    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fs8rzr_2bc3e119-aeb2-43fc-ab07-54ff8bc09bcb/main/0.log"
Sep 10 17:48:00.257452 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:00.257413    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-55pvg_2d4ad2d8-0a87-42e5-8f82-e0c85b7dfcff/global-pull-secret-syncer/0.log"
Sep 10 17:48:00.457283 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:00.457252    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lxx99_975bc37f-b97b-4804-b501-b1c2d87e72a3/konnectivity-agent/0.log"
Sep 10 17:48:00.560012 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:00.559929    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-192.ec2.internal_837b4f66dafcb9583a80e7a722354bf8/haproxy/0.log"
Sep 10 17:48:05.224758 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:05.224723    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-bdxz5_d8d7bef1-77b5-422c-a068-66c8d0525e24/manager/0.log"
Sep 10 17:48:05.268961 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:05.268934    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-ltf7w_c83e8cce-267b-475d-8295-19d87e6d4df0/manager/0.log"
Sep 10 17:48:05.379123 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:05.379089    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-wb7gb_ba36e1d0-46f2-405b-a52a-3bb855563822/limitador/0.log"
Sep 10 17:48:05.439993 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:05.439957    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-hhktr_53bb30ff-b9b5-435d-8f8e-4c33bea1a3f3/manager/0.log"
Sep 10 17:48:07.173035 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:07.172992    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-d8rtg_c82dbd4a-443b-4b11-b1bc-b777d8f29868/kube-state-metrics/0.log"
Sep 10 17:48:07.197671 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:07.197642    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-d8rtg_c82dbd4a-443b-4b11-b1bc-b777d8f29868/kube-rbac-proxy-main/0.log"
Sep 10 17:48:07.223402 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:07.223378    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-d8rtg_c82dbd4a-443b-4b11-b1bc-b777d8f29868/kube-rbac-proxy-self/0.log"
Sep 10 17:48:07.425466 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:07.425382    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5z272_e11ee9d7-d98c-4381-9e58-758ddb0882dd/node-exporter/0.log"
Sep 10 17:48:07.451234 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:07.451213    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5z272_e11ee9d7-d98c-4381-9e58-758ddb0882dd/kube-rbac-proxy/0.log"
Sep 10 17:48:07.490256 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:07.490231    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5z272_e11ee9d7-d98c-4381-9e58-758ddb0882dd/init-textfile/0.log"
Sep 10 17:48:10.469688 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.469658    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"]
Sep 10 17:48:10.470106 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.469972    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55431895-1b8b-412f-9c47-5fc54cb02a30" containerName="maas-api"
Sep 10 17:48:10.470106 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.469982    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="55431895-1b8b-412f-9c47-5fc54cb02a30" containerName="maas-api"
Sep 10 17:48:10.470106 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.470035    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a25668e-0d10-4e1c-bab3-5d1bf3f178b2" containerName="istio-proxy"
Sep 10 17:48:10.470106 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.470046    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="55431895-1b8b-412f-9c47-5fc54cb02a30" containerName="maas-api"
Sep 10 17:48:10.473043 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.473021    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.475370 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.475345    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mlqxs\"/\"openshift-service-ca.crt\""
Sep 10 17:48:10.475498 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.475401    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mlqxs\"/\"default-dockercfg-trhqt\""
Sep 10 17:48:10.476091 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.476076    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mlqxs\"/\"kube-root-ca.crt\""
Sep 10 17:48:10.489906 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.489879    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"]
Sep 10 17:48:10.619903 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.619868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c49d0e9-85c6-46a1-b81d-cf918f820b54-lib-modules\") pod \"perf-node-gather-daemonset-txqcf\" (UID: \"7c49d0e9-85c6-46a1-b81d-cf918f820b54\") " pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.620095 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.619912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c49d0e9-85c6-46a1-b81d-cf918f820b54-podres\") pod \"perf-node-gather-daemonset-txqcf\" (UID: \"7c49d0e9-85c6-46a1-b81d-cf918f820b54\") " pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.620095 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.619938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c49d0e9-85c6-46a1-b81d-cf918f820b54-sys\") pod \"perf-node-gather-daemonset-txqcf\" (UID: \"7c49d0e9-85c6-46a1-b81d-cf918f820b54\") " pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.620095 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.620015    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jxwb\" (UniqueName: \"kubernetes.io/projected/7c49d0e9-85c6-46a1-b81d-cf918f820b54-kube-api-access-9jxwb\") pod \"perf-node-gather-daemonset-txqcf\" (UID: \"7c49d0e9-85c6-46a1-b81d-cf918f820b54\") " pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.620095 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.620042    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c49d0e9-85c6-46a1-b81d-cf918f820b54-proc\") pod \"perf-node-gather-daemonset-txqcf\" (UID: \"7c49d0e9-85c6-46a1-b81d-cf918f820b54\") " pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.720539 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.720446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c49d0e9-85c6-46a1-b81d-cf918f820b54-lib-modules\") pod \"perf-node-gather-daemonset-txqcf\" (UID: \"7c49d0e9-85c6-46a1-b81d-cf918f820b54\") " pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.720539 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.720493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c49d0e9-85c6-46a1-b81d-cf918f820b54-podres\") pod \"perf-node-gather-daemonset-txqcf\" (UID: \"7c49d0e9-85c6-46a1-b81d-cf918f820b54\") " pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.720539 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.720515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c49d0e9-85c6-46a1-b81d-cf918f820b54-sys\") pod \"perf-node-gather-daemonset-txqcf\" (UID: \"7c49d0e9-85c6-46a1-b81d-cf918f820b54\") " pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.720831 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.720566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jxwb\" (UniqueName: \"kubernetes.io/projected/7c49d0e9-85c6-46a1-b81d-cf918f820b54-kube-api-access-9jxwb\") pod \"perf-node-gather-daemonset-txqcf\" (UID: \"7c49d0e9-85c6-46a1-b81d-cf918f820b54\") " pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.720831 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.720585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c49d0e9-85c6-46a1-b81d-cf918f820b54-proc\") pod \"perf-node-gather-daemonset-txqcf\" (UID: \"7c49d0e9-85c6-46a1-b81d-cf918f820b54\") " pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.720831 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.720631    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c49d0e9-85c6-46a1-b81d-cf918f820b54-lib-modules\") pod \"perf-node-gather-daemonset-txqcf\" (UID: \"7c49d0e9-85c6-46a1-b81d-cf918f820b54\") " pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.720831 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.720630    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c49d0e9-85c6-46a1-b81d-cf918f820b54-podres\") pod \"perf-node-gather-daemonset-txqcf\" (UID: \"7c49d0e9-85c6-46a1-b81d-cf918f820b54\") " pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.720831 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.720660    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c49d0e9-85c6-46a1-b81d-cf918f820b54-sys\") pod \"perf-node-gather-daemonset-txqcf\" (UID: \"7c49d0e9-85c6-46a1-b81d-cf918f820b54\") " pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.720831 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.720677    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c49d0e9-85c6-46a1-b81d-cf918f820b54-proc\") pod \"perf-node-gather-daemonset-txqcf\" (UID: \"7c49d0e9-85c6-46a1-b81d-cf918f820b54\") " pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.728817 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.728781    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jxwb\" (UniqueName: \"kubernetes.io/projected/7c49d0e9-85c6-46a1-b81d-cf918f820b54-kube-api-access-9jxwb\") pod \"perf-node-gather-daemonset-txqcf\" (UID: \"7c49d0e9-85c6-46a1-b81d-cf918f820b54\") " pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:10.783524 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:10.783486    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:11.054276 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:11.054251    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"]
Sep 10 17:48:11.057025 ip-10-0-140-192 kubenswrapper[2576]: W0910 17:48:11.056998    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7c49d0e9_85c6_46a1_b81d_cf918f820b54.slice/crio-f19465c3baccd4d13db883076c5c817a48dd7de2d56afb73096a317019722b86 WatchSource:0}: Error finding container f19465c3baccd4d13db883076c5c817a48dd7de2d56afb73096a317019722b86: Status 404 returned error can't find the container with id f19465c3baccd4d13db883076c5c817a48dd7de2d56afb73096a317019722b86
Sep 10 17:48:11.752133 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:11.752093    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf" event={"ID":"7c49d0e9-85c6-46a1-b81d-cf918f820b54","Type":"ContainerStarted","Data":"5bf2d1dab772d0d18d15cde9fc5548c8713c33e0322029734a74a14c9fe1e57f"}
Sep 10 17:48:11.752534 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:11.752160    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf" event={"ID":"7c49d0e9-85c6-46a1-b81d-cf918f820b54","Type":"ContainerStarted","Data":"f19465c3baccd4d13db883076c5c817a48dd7de2d56afb73096a317019722b86"}
Sep 10 17:48:11.752534 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:11.752183    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:11.768028 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:11.767978    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf" podStartSLOduration=1.767960634 podStartE2EDuration="1.767960634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:48:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:11.767118492 +0000 UTC m=+2177.183169441" watchObservedRunningTime="2026-09-10 17:48:11.767960634 +0000 UTC m=+2177.184011613"
Sep 10 17:48:12.847358 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:12.847332    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ftqvt_7d4e0fe9-9c23-4184-a6d5-488642f43f1f/dns/0.log"
Sep 10 17:48:12.875234 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:12.875193    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ftqvt_7d4e0fe9-9c23-4184-a6d5-488642f43f1f/kube-rbac-proxy/0.log"
Sep 10 17:48:13.042840 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:13.042814    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gv72m_7573c74d-3687-455c-85c9-4bf2b6441696/dns-node-resolver/0.log"
Sep 10 17:48:13.711843 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:13.711814    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ntdxg_bafbd9c5-ad9e-446b-8a01-64cdd4895832/node-ca/0.log"
Sep 10 17:48:14.964478 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:14.964448    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jbmd9_13eaade1-fdd4-41a3-a56d-091c217bfc95/discovery/0.log"
Sep 10 17:48:15.018986 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:15.018956    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-647997b56d-cbb57_2c279008-c8c3-4434-bd3f-d680fd9722f1/kube-auth-proxy/0.log"
Sep 10 17:48:16.131205 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:16.131173    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v4gw2_f81944b4-eafc-4f91-b8f4-0d2b22f34d96/serve-healthcheck-canary/0.log"
Sep 10 17:48:16.756383 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:16.756356    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8fgsv_c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c/kube-rbac-proxy/0.log"
Sep 10 17:48:16.788657 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:16.788624    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8fgsv_c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c/exporter/0.log"
Sep 10 17:48:16.818165 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:16.818140    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8fgsv_c2aa2d6e-b8c7-4d9c-b8f1-97a531bfc26c/extractor/0.log"
Sep 10 17:48:17.767092 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:17.767047    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mlqxs/perf-node-gather-daemonset-txqcf"
Sep 10 17:48:19.463679 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:19.463586    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-lmsnj_edc43364-447c-4d74-999d-3e970c9f7db9/manager/0.log"
Sep 10 17:48:19.891431 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:19.891382    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86f7548996-lv77p_94f2273d-3b11-4997-b736-b1b93902e61f/manager/0.log"
Sep 10 17:48:19.922552 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:19.922523    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86f7548996-lv77p_94f2273d-3b11-4997-b736-b1b93902e61f/copy-manifests/0.log"
Sep 10 17:48:21.617661 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:21.617632    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jbmd9_13eaade1-fdd4-41a3-a56d-091c217bfc95/discovery/0.log"
Sep 10 17:48:21.627816 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:21.627790    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-98vw2_4a8b52d8-fdf9-45df-b6b4-6fea939b648b/openshift-lws-operator/0.log"
Sep 10 17:48:21.647391 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:21.647372    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-647997b56d-cbb57_2c279008-c8c3-4434-bd3f-d680fd9722f1/kube-auth-proxy/0.log"
Sep 10 17:48:23.550412 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:23.550383    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jbmd9_13eaade1-fdd4-41a3-a56d-091c217bfc95/discovery/0.log"
Sep 10 17:48:23.586108 ip-10-0-140-192 kubenswrapper[2576]: I0910 17:48:23.586075    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-647997b56d-cbb57_2c279008-c8c3-4434-bd3f-d680fd9722f1/kube-auth-proxy/0.log"